You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Add API to read a Vec<RecordBatch> from SessionContext #9157
Is your feature request related to a problem or challenge?
Many APIs in DataFusion produce Vec<RecordBatch> (e.g. DataFrame::collect)
However, there is no corresponding API to create a DataFrame from a Vec<RecordBatch> which is confusing to a first time user who just wants to do something like "sort my batches"
I would like a SessionContext::read_batches API that takes an iterator of RecordBatches (like a Vec)
implSessionContext/// Creates a [`DataFrame`] for reading a [`RecordBatch`]pubfnread_batch(&self,batches:implIntoIter<Item = RecordBatch>) -> Result<DataFrame>{
...}}
Along with:
A doc example showing how to read a Vec<RecordBatch> (which would also serve as a test)
Describe alternatives you've considered
No response
Additional context
I was speaking with @carols10cents today, and she noted that m
Activity
Lordworms commentedon Feb 8, 2024
I can do this one
alamb commentedon Feb 8, 2024
Thank you @Lordworms
feat: issue apache#9157 adding record_batches for Vec<BatchRecord>
Add `SessionContext::record_batches` (#9197)