feat: comet native scan improvements - Dynamic Partition Pruning #3546

Closed

Shekharrajak wants to merge 14 commits into

apache:mainfrom

Shekharrajak:feature/comet-native-scan-improvements

Commits on Feb 23, 2026

feat: add DPP support to CometNativeScanExec for V1 native scans
Shekharrajak
committed
test: add DPP tests for CometNativeScanExec
Shekharrajak
committed
test: add DPP benchmark comparing Spark vs Comet native scan
Shekharrajak
committed
test: add benchmarks proving 4x speedup for native Parquet scan
Shekharrajak
committed
bench: add CometDPPBenchmark following standard benchmark pattern
Shekharrajak
committed
fix: fall back to Spark for DPP in non-AQE mode with native_datafusion scan
Shekharrajak
committed
fix: remove unused variable in DPP fallback test
Shekharrajak
committed
fix: native_datafusion DPP requires AQE - fall back in non-AQE mode
Shekharrajak
committed
Fix unused variable in CometNativeScanDPPSuite
Shekharrajak
committed
Update golden files for DPP fallback message
Shekharrajak
committed

Commits on Mar 3, 2026

Merge branch 'main' into feature/comet-native-scan-improvements
Shekharrajak
authored

Commits on Apr 2, 2026

Merge branch 'main' into feature/comet-native-scan-improvements
mbutrovich
authored

Commits on Apr 3, 2026