feat(assignments): Change layout of the worker/portal assignments - #220

Merged

define-null merged 39 commits into

mainfrom

defnull/chunk-versions-and-generations

Aug 18, 2026

Commits on Aug 14, 2026

Version chunks so batch jobs can republish them
define-null
committed
8993c31
Make version 0 read as a version, and portal chunks nameable
define-null
committed
004bd7c
State the assignment schemas in the present tense
define-null
committed
8118b32
Pin vtable slots with explicit ids, drop the chunk's dataset_id
define-null
committed
a6e381f
Make the portal assignment's chunks columns
define-null
committed
3d98216
Keep the dataset's last_block_hash
define-null
committed
081fc23
Tighten the schema comments
define-null
committed
5fd8ed9
Move base_url off the worker chunk onto its dataset
define-null
committed
82c07b6
Add a timestamp survey for legacy assignments
define-null
committed
a67e0c1
Cut the timestamp report down to the chunk and its timestamp
define-null
committed
96698b3
Flip the timestamp report to find timestamps that aren't milliseconds
define-null
committed
e80a71e
Convert legacy assignments into the split pair
define-null
committed
291db17
Write zstd copies alongside gzip
define-null
committed
80bd074
Report how long each compressor took
define-null
committed
2275873
Drop the timestamp report
define-null
committed
03a5de7
Read compressed assignments, and size against the uncompressed source
define-null
committed
4885022
Benchmark the split formats against legacy
define-null
committed
253c0be
Make the worker assignment's chunks columns
define-null
committed
d28f04b
Keep write_schema_id and tables_present as they were
define-null
committed
a87a9cf
Let the benchmarks run against a real assignment
define-null
committed
580ae50
Read each column once per search, not once per element
define-null
committed
4f93bac
Build chunk ids without std::fmt
define-null
committed
5c0ecbf
Let the converter write somewhere other than the working directory
define-null
committed
00175c0
Reject columns that contradict each other
define-null
committed
41ddd3f
Prove the portal's column check too
define-null
committed
b822ca9
Pin the hand-rolled id format against std::fmt
define-null
committed
cea3028
Check a chunk is filed under the dataset it names
define-null
committed
eb4243c

Commits on Aug 15, 2026

Write the ephemeral identity only when something seals with it
define-null
committed
49745db
Reject hashes the portal would refuse
define-null
committed
c5bdefe
Cut the commentary back
define-null
committed
4e3f6d3

Commits on Aug 17, 2026

Merge branch 'main' into defnull/chunk-versions-and-generations
define-null
authored
69a7cae
Update crates/assignments/Cargo.toml
define-null
authored
0a9b3cf
Update lock file
define-null
committed
483037b
Fix api
define-null
committed
79faac6
Wrap the line CI's rustfmt would reject

define-null
and
claude
committed
339a0d7
Stop allocating per staged chunk in the split builders (#5)

authored and
defnull
committed
625de07
Pick the decompressor by suffix, not by magic bytes

define-null
and
claude
committed
4939971

Commits on Aug 18, 2026

Reduce prose
define-null
committed
8bb53af
feat(messages): add chunk version to queries
define-null
committed
6c489b7