Repository navigation
DataFusion 1TB single machine benchmark #19815
Description
Is your feature request related to a problem or challenge?
There was a challenge recently https://www.confessionsofadataguy.com/duckdb-beats-polars-for-1tb-of-data/ and I think it would be beneficial also to run the same for DataFusion
Describe the solution you'd like
No response
Describe alternatives you've considered
No response
Additional context
No response
Activity
GaneshPatil7517 commentedon Jan 14, 2026
take
comphead commentedon Jan 14, 2026
Thanks @GaneshPatil7517 I think we can try to reuse the same data generator proposed in the article https://github.com/danielbeach/rustGenerate1TB and query generator https://github.com/danielbeach/duckdbAndDaftEat1TB
comphead commentedon Jan 16, 2026
danielbeach/duckdbAndDaftEat1TB#1
GaneshPatil7517 commentedon Jan 17, 2026
great @comphead ....