Repository navigation
Release DataFusion 52.0.0 (Dec 2025 / Jan 2026) #18566
Description
Activity
@alamb is it ok if I add "test with ballista" checkbox to the list ?
TLDR / Ask
If you have things you would like to include in the 52 release (including issues that are already completed) please add them to the "Community Wishlist" item above.
Background
@brancz asked about the status of this release this morning in discord (link) and it came up on the sync meeting this mrining too
One thing @brancz referenced as a motivation for the release are the changes for schema evolution of structs, for example
In my mind there is also some follow on work in this area we probably should include in 52:
@timsaucer mentioned he would like to try and get in some FFI things. Perhaps these (but I don't know)
- Support user defined functions as expressions in FFI calls #18671
- expose TableProviderFactory via FFI #17942
- Stabilize FFI Boundary #17374
I think @milenkovicm @timsaucer also may have some thought / ideas as well
p.s. Note we have been talking about a 51.1.0 patch release too:
I think we're very close to the release. How about starting testing next early week?
Also, let us know the PRs you're looking forward to including in the release!
I think we're very close to the release. How about starting testing next early week?
Works with me!
I think many people are on reduced time / vacation this week due to the holidays at this time of year. Not sure if that effects the release schedule. Given how much we have queued up in the 52 release we should probably start stabalizing things sooner rather than later
any thoughts @adriangb or @zhuqi-lucas ?
I think many people are on reduced time / vacation this week
Yeah, the Chinese holiday is also this week (From Thu). And I'm here next week, so I can take this release
Reacted by Andrew LambI'll be around as normal from now on
I'm available for next week as normal.
Ballista tested with 9a9ff8d looks ok
Tested with sail and looks good!
Reacted by Andrew LambTested with vortex and it looks good - vortex-data/vortex#5863
Reacted by Andrew Lamb- added a commit that references this issue
on Jan 6, 2026 26 remaining items
@tobixdev it looks like Lia is already looking into this. I'd guess you're not doing anything wrong, we probably have a bug that we'll have to patch in 52.1.0.
Reacted by Tobias Schwarzinger and Alexander HirnerI might have some ideas on why the inner struct ref count is not getting updated, @tobixdev i will move the discussion to #19715
Reacted by Adrian Garcia Badaracco and Alexander HirnerReacted by Tobias Schwarzingerdelta-rs DF52 upgrade is stable and in verification.
Changes:
- Migrated scan planning to TableSchema API
- Added PhysicalExprAdapterFactory to honor schema_force_view_types in next scan path
- Fixed predicate normalization for Utf8/Utf8View literal mismatches
Local tests pass:
- cargo test -p deltalake-core --features datafusion --test integration_datafusion
- cargo test -p deltalake-core --features datafusion --test datafusion_table_provider
Reacted by Andrew Lamb and Adrian Garcia Badaraccoamazing
Reacted by Ethan Urbanski52.0.0 is released, and I've updated the crate.io
Reacted by Ethan Urbanski, Tobias Schwarzinger, Lía Adriana, Oleks V, Pepijn Van Eeckhoudt, Qi Zhu and Shehab AminReacted by Adrian Garcia Badaracco, Shehab Amin and David LópezAmazing thank you!
Thank you so much @xudong963 and everyone who helped with this release (120 contributors this time 🤯 )
I'm not 100% sure (too lazy to check archives) but number of users verifying release was probably record breaking
Reacted by Andrew Lamb
Is your feature request related to a problem or challenge?
Tracking ticket for next release, also a place to track desired inclusions
Previous release will be #17558 (Nov, 2025) so next major release would be approximately late Dec 2025 / early Jan 2026
Steps:
branch-52branch:53.0.0(Feb 2026 / Mar 2026) #1969252.0.0release #19691Features to mention in the blog (if they make it)
TableProviders#14993 / Plan to replaceSchemaAdapterwithPhysicalExprAdapter#16800 from @adriangbCoalesceBatchesExecoperator #18779Bugs that should be fixed
force_filter_selectionsto restorepushdown_filtersbehavior prior to parquet 57.1.0 upgrade #19003 (review)StaticFiltersfor different data types #18824cache::list_files_cache::tests::test_cache_with_ttl_and_lru( seems flaky) #19114Community Wishlist
DataFrameWriteOptions::with_single_file_outputproduces a directory #13323to_timestampand related functions #18025