Repository navigation
Expects PARTITION BY expression to be ordered in DataFusion 51 release #18527
Description
Describe the bug
@shehabgamin reports in #17558 (comment):
Regressions
One of our tests related to window functions is failing with the error:Expects PARTITION BY expression to be orderedHere is the test in question:
https://github.com/lakehq/sail/blob/8bc2a05d595f02aba3a23fcd26aef81df36a7b96/python/pysail/tests/spark/test_execution.py#L124-L148
To Reproduce
Not sure
Expected behavior
No response
Additional context
No response
Activity
alamb commentedon Nov 7, 2025
I looked at that briefly at that test and it isn't clear where "Expects PARTITION BY expression to be ordered" is coming from. While the window function does have a partition by expression, I don't see why the partition by would be ordered.
So in other words, I am not sure what the bug is
linhr commentedon Jan 30, 2026
This turns out to be an issue within Sail when certain distributed query plans are constructed incorrectly, causing validation to fail for
BoundedWindowAggExec. So nothing goes wrong in DataFusion.The issue was only noticed after DataFusion 51, possibly due to how validation/optimization logic changed recently for physical planning in DataFusion.
@alamb Feel free to close this issue!
alamb commentedon Feb 3, 2026
Thanks @linhr