Repository navigation
New functions for working with arrays #6119
Description
Is your feature request related to a problem or challenge?
Arrow-DataFusion can support creating an array of a certain data type (make_array), but there are no functions to work with them.
In my opinion, the documentation of the database PostgreSQL can serve as a reference for working on arrays.
Array functions:
- array_append
- array_concat
- array_ndims
- array_dims
- array_fill
- array_length
- array_position
- array_positions
- array_prepend
- array_remove
- array_replace
- array_to_string
- cardinality
- string_to_array
Describe the solution you'd like
Series of PR, active discussion of features.
Describe alternatives you've considered
The significance of some features can be disproven as a result of conversations.
Additional context
Sources:
The array documentation: PostgreSQL
#6073
#6075
Activity
mustafaakin commentedon May 11, 2023
We have a lot of nested data at Resmo and currently using PartiQL but we were exploring to switch to datafusion. We make use a lot of unnest.
izveigor commentedon May 11, 2023
Hello, @mustafaakin!
I think I can create PR with the implementation unnest soon
alamb commentedon Jun 1, 2023
Thank you @izveigor -- I have added this ticket to the tracking epic for working with lists in DataFusion: #2326
bubbajoe commentedon Jun 7, 2023
@alamb Isn't there still some functions/operators that need to be finished (or issued created)?
alamb commentedon Jun 8, 2023
I agree -- thanks @bubbajoe . @izveigor FYI I reopened this one. Perhaps it would be good to file a follow on ticket with what is not yet implemented and then we can close this ticket
[-]New functions and operations for working with arrays[/-][+]New functions for working with arrays[/+]izveigor commentedon Jun 8, 2023
@alamb @bubbajoe Yes, I created two additional tickets for the remaining cases.
So, I think I can close this ticket now.