Repository navigation
[EPIC] Improve Comet metrics #3996
Description
What is the problem the feature request solves?
The epic to track Comet improvements to report Spark UI metrics
- Add encoding + compression metrics to columnar shuffle #1212
-
native_datafusiondoesn't report input metrics #3735 - Native writer doesn't report written bytes #3608
- native shuffle read metrics
- native shuffle write metrics
- Task metrics (bytes read) for CometIcebergNativeScan #4002
Describe the potential solution
No response
Additional context
No response
Activity
mbutrovich commentedon Apr 20, 2026
Should add #4002 to the task list.
peterxcli commentedon Sep 5, 2026
@comphead I think this can be closed cause #5554 #5370 are merged. also that would be good to update the pr description to add the two PRs
comphead commentedon Sep 5, 2026
Thanks @peterxcli lets close it for now, and open bug fix requests if anything still arises