Repository navigation

Support Arrow IPC Stream Files - #18457

Merged

timsaucer merged 49 commits into

apache:mainfrom

corasaurus-hex:cs--register-arrow-ipc-stream-format-files

Nov 10, 2025

Merged

Support Arrow IPC Stream Files#18457
timsaucer merged 49 commits into
apache:mainfrom
corasaurus-hex:cs--register-arrow-ipc-stream-format-files

Commits on Nov 3, 2025
- Infer stream ipc format for arrow data sources
  corasaurus-hex
  committed
  3e6a570
- Allow FileOpener for ArrowSource to open both IPC formats
  corasaurus-hex
  committed
  0ad62ed
- Split reading file vs stream because repartitioning + ranges
  corasaurus-hex
  committed
  34ccba4
- Fix rewind bug
  corasaurus-hex
  committed
  99ebe62
- Remove a comment that isn't needed anymore
  corasaurus-hex
  committed
  936b2e3
- Stray reference left over from Rename Symbol fail
  corasaurus-hex
  committed
  a8bc19d
- Merge branch 'main' into cs--register-arrow-ipc-stream-format-files
  corasaurus-hex
  authored
  93d26b1
Commits on Nov 4, 2025
Commits on Nov 6, 2025
- Pull out the stream format check into an independent function
  corasaurus-hex
  committed
  07593b4
Commits on Nov 7, 2025
- Refactor schema inference
  corasaurus-hex
  committed
  0446c32
- Let's move the `into()` outside the parens
  corasaurus-hex
  committed
  7409462
- Err, no, on the inside
  corasaurus-hex
  committed
  3f72b0c
- Merge branch 'main' into cs--register-arrow-ipc-stream-format-files
  corasaurus-hex
  authored
  9e63fc7
- Also include a test for arrow stream source
  corasaurus-hex
  committed
  c6d4a06
- Add a bunch more tests
  corasaurus-hex
  committed
  4e28ef9
- Merge branch 'main' into cs--register-arrow-ipc-stream-format-files
  corasaurus-hex
  authored
  d6c77f8
Commits on Nov 8, 2025
Commits on Nov 9, 2025
- Document rename of `ArrowSource` and addition of `ArrowStreamSource`
  corasaurus-hex
  committed
  589a1d2
- Rename ArrowStreamSource to ArrowStreamFileSource
  corasaurus-hex
  committed
  0ac2f6d
- Merge branch 'main' into cs--register-arrow-ipc-stream-format-files
  corasaurus-hex
  authored
  d0fb260
- Keep same public interface but switch between formats
  corasaurus-hex
  committed
  c8e8bd1
- whitespace fixes
  corasaurus-hex
  committed
  6f01b80
- Remove note from upgrade guide
  corasaurus-hex
  committed
  6b5ba4b
- Improve the docs a little
  corasaurus-hex
  committed
  2e857c7
- Add a note about the confusing naming
  corasaurus-hex
  committed
  c67c881
- Merge branch 'main' into cs--register-arrow-ipc-stream-format-files-wrapped
  corasaurus-hex
  authored
  724444f
- Stray line in the upgrade doc
  corasaurus-hex
  committed
  882e9fa
- Add initializers and fill out shared interface
  corasaurus-hex
  committed
  9144d9e
- Formatting
  corasaurus-hex
  committed
  d5122f0
- Merge branch 'main' into cs--register-arrow-ipc-stream-format-files-wrapped
  corasaurus-hex
  authored
  10cc7d7
- Merge branch 'main' into cs--register-arrow-ipc-stream-format-files
  corasaurus-hex
  authored
  5f064ff
- Merge branch 'main' into cs--register-arrow-ipc-stream-format-files-wrapped
  corasaurus-hex
  committed
  68d286a
- Type error and linting fix
  corasaurus-hex
  committed
  8b314a5
- Docs
  corasaurus-hex
  committed
  20c8377
- Merge branch 'cs--register-arrow-ipc-stream-format-files-wrapped' into cs--register-arrow-ipc-stream-format-files
  corasaurus-hex
  committed
  da81767
- Update docs for clarity
  corasaurus-hex
  committed
  2ddd690
Commits on Nov 10, 2025
- Add more comments describing the format so that it's easier to
  corasaurus-hex
  committed
  cf08a7d
- Test querying from empty stream format file
  corasaurus-hex
  committed
  057e0de
- Add tests for corrupted stream format and empty stream
  corasaurus-hex
  committed
  4c30eb9
- ArrowStreamOpener -> ArrowStreamFileOpener in error text
  corasaurus-hex
  committed
  b2041d8
- Make `inner` public only within the crate
  
  corasaurus-hex
  and
  martin-g
  authored
  3718797
- Combine errors for file and stream formats
  corasaurus-hex
  committed
  1724b3b

Commits

Commits on Nov 3, 2025

Commits on Nov 4, 2025

Commits on Nov 6, 2025

Commits on Nov 7, 2025

Commits on Nov 8, 2025

Commits on Nov 9, 2025

Commits on Nov 10, 2025