Improve the performance of "DictionaryValue" row encoding

@tustvold

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

We are consider using the "don't use dictionary interning" in DataFusion for high cardinality columns: apache/datafusion#7200 (comment)

@tustvold mentioned this mode could be made faster

Describe the solution you'd like
Review and optimize Code::DictionaryValues

Perhaps this could be made faster:

Line 1417 in b810e8f

Codec::DictionaryValues(converter, _) => {

(I am not sure)

Describe alternatives you've considered
There may not be any way to make this faster, but I wanted to file the ticket as follow on to the meeting

Additional context

For the record, this was fixed b/c we deleted the code that it tracked optimizing 🔥

label_issue.py automatically added labels {'arrow'} from #4819

label_issue.py automatically added labels {'arrow-flight'} from #4819

Navigation Menu