Repository navigation

perf: decode shuffle blocks against a cached schema instead of re-parsing per block - #5809

Merged

sunchao merged 11 commits into

apache:mainfrom

peterxcli:perf/shuffle-reader-schema-cache

Sep 20, 2026

Merged

perf: decode shuffle blocks against a cached schema instead of re-parsing per block#5809
sunchao merged 11 commits into
apache:mainfrom
peterxcli:perf/shuffle-reader-schema-cache

Commits on Sep 9, 2026
- bench: add a shuffle read benchmark covering the per-block schema parse
  
  peterxcli
  and
  claude
  committed
  d3b1488
- perf: decode shuffle blocks against a cached schema instead of re-parsing per block
  
  peterxcli
  and
  claude
  committed
  266b4d4
Commits on Sep 10, 2026
- review: trim comments to what they need to say
  
  peterxcli
  and
  claude
  committed
  bf16d59
- Merge perf/shuffle-read-schema-parse-bench into perf/shuffle-reader-schema-cache
  
  peterxcli
  and
  claude
  committed
  1ca3586
- review: trim comments to what they need to say
  
  peterxcli
  and
  claude
  committed
  cc6b3d8
Commits on Sep 13, 2026
- Merge upstream/main into perf/shuffle-reader-schema-cache
  
  peterxcli
  and
  claude
  committed
  0f61f35
Commits on Sep 14, 2026
- review: stream each block message by message and serve the cached schema without parsing it
  
  peterxcli
  and
  claude
  committed
  a5290ca
Commits on Sep 15, 2026
- review: probe allocations against StreamReader, validate corrupt arrays on a warm cache, bench the validated entry point
  
  peterxcli
  and
  claude
  committed
  fe93ff2
- Merge branch 'main' into perf/shuffle-reader-schema-cache
  peterxcli
  authored
  872c979
Commits on Sep 17, 2026
- Merge branch 'main' into perf/shuffle-reader-schema-cache
  peterxcli
  committed
  dad9d9e
Commits on Sep 20, 2026
- Merge branch 'main' into perf/shuffle-reader-schema-cache
  peterxcli
  authored
  0612e8b