Repository navigation
improve performance for apporx_distinct when each group do no have many distinct value #22767
Description
Is your feature request related to a problem or challenge?
when i do one test use below sql, i find the performance is not except
SELECT
client_ip,
approx_distinct(trace_id) AS cnt
FROM
"*.parquet"
GROUP BY
client_ip ORDER BY cnt DESC LIMIT 10i have 100M rows, and 0.5 M unique client_ip
datafusli-cli need 900s to get the result, but duckdb only need 3s
Describe the solution you'd like
No response
Describe alternatives you've considered
No response
Additional context
No response
Activity
haohuaijin commentedon Jun 5, 2026
take
[-]improve perforance for `apporx_distinct` when each group do no have many distinct value[/-][+]improve performance for `apporx_distinct` when each group do no have many distinct value[/+]perf: improve approx_distinct performance 100x when there are fewer d…
perf: improve approx_distinct performance 100x when there are fewer d…