You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Use arrow row format in GroupByHash rather than datafusion row format #4179
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Arrow now has a row format https://docs.rs/arrow/26.0.0/arrow/row/index.html that is both well documented and likely to get additional functionality (as it will be used for sorting, etc)
It would be good to use that in DataFusion to benefit from upstream efforts including more type support as it is added
I think we should probably file a follow on ticket for the group state (aka the aggregates) as I am not sure the existing row format is actually the right thing. I'll try and sort this out tomorrow when filing tickets
Activity
tustvold commentedon Jan 17, 2023
I believe this was closed by #4830
crepererum commentedon Jan 17, 2023
Only for the group key, not for the group state.
alamb commentedon Jan 17, 2023
I think we should probably file a follow on ticket for the group state (aka the aggregates) as I am not sure the existing row format is actually the right thing. I'll try and sort this out tomorrow when filing tickets