Repository navigation
Release DataFusion 53.1.0 (minor) (Apr 2026) #21079
Description
Activity
@alamb : Can we add the following issues to this release please?
Reacted by Andrew Lamb and Oleks V- added a commit that references this issue
on Mar 25, 2026 I am happy to run this release unless someone else wants to
I'll plan to get it ready for next week sometime
I am happy to run this release unless someone else wants to
I can continue with 53ish to get a full picture on release and hotfixes
Reacted by Andrew Lamb, xudong.w and Martin GrigorovSold! I'll assign it you you @comphead
Thank you
I will then help with some of the backports with myfreed up time
I'm planning to make all backports today
Thanks @comphead -- We should also make sure that anything backported into 52.5.0 is ported to branch-53. I will do that review tomorrow and make any additional backports needed
-
fix: do not recompute hash join exec properties if not required #20900 was applied before, prob its missing from change log
-
fix: use spill writer's schema instead of the first batch schema for spill files #21293 backport [branch-53] fix: use spill writer's schema instead of the first batch schema for … #21451
-
fix: use datafusion_expr instead of datafusion crate in spark #21043 backport [branch-53] fix: use datafusion_expr instead of datafusion crate in spark bitmap/… #21452
-
Remove the statistics() api in execution plan #20319 exists, missing from change log
-
feat: Add null-aware anti join support #19635 is huge, needs to be merged properly
-
can we add this to the list?
Reacted by Andrew Lambcan we add this to the list?
Added
Reacted by Huaijin17 remaining items
After we merge that one I think we need a PR to update the version / changelog and we'll be good to go for 53.1.0 from my perspective
After we merge that one I think we need a PR to update the version / changelog and we'll be good to go for 53.1.0 from my perspective
Merged, looks like we are stable now, I'll start with version/changelog releases PR tomorrow
Reacted by Andrew Lamb and HuaijinChangelog PR #21559
- added a commit that references this issue
on Apr 13, 2026 Testing with Comet apache/datafusion-comet#3946
Reacted by Oleks VReacted by Andrew Lamb#21625 is the hotfix blocker
Release completed, crates.io updated.
Changelog backport to main #21686Shouldn't we bump the version in
mainto 53.1.0?Reacted by Oleks VShouldn't we bump the version in
mainto 53.1.0?Correct, backporting that, thanks for catching. Created #21708
- added a commit that references this issue
on Apr 21, 2026 - added a commit that references this issue
on Apr 30, 2026
Is your feature request related to a problem or challenge?
53.0.0(Feb 2026 / Mar 2026) #19692I suspect we'll end up needing to backport a few bugs on the
branch-53release, so I am proactively opening a ticket to propose / track such a releaseSteps:
Potential Content:
NOTE: we should also make sure that we backport / release anything that also went into the branch-52 line:
Requested Bug Fixes. Format: Issue / Requester / Backport PR
main#20831 / @alamb / Update to arrow/parquet58.1.0#21044Requested improvements