Skip to content

feat: add DataFrame checkpoint and local checkpoint support - #1969

Closed
lonless9 wants to merge 49 commits into
mainfrom
feat-checkpoint
Closed

feat: add DataFrame checkpoint and local checkpoint support#1969
lonless9 wants to merge 49 commits into
mainfrom
feat-checkpoint

linter

63a030a
Select commit
Loading
Failed to load commit list.
Codecov / codecov/project succeeded Jul 18, 2026 in 0s

77.83% (-1.59%) compared to 012157d

View this Pull Request on Codecov

77.83% (-1.59%) compared to 012157d

Details

Codecov Report

❌ Patch coverage is 86.88142% with 281 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
crates/sail-cache/src/cached_relation.rs 88.97% 139 Missing ⚠️
...es/sail-spark-connect/src/service/plan_executor.rs 74.73% 47 Missing ⚠️
crates/sail-physical-plan/src/checkpoint.rs 90.42% 25 Missing ⚠️
crates/sail-session/src/checkpoint.rs 85.49% 19 Missing ⚠️
crates/sail-logical-plan/src/cached_relation.rs 70.73% 12 Missing ⚠️
crates/sail-plan/src/lib.rs 47.36% 10 Missing ⚠️
crates/sail-execution/src/proto/codec.rs 85.00% 9 Missing ⚠️
crates/sail-object-store/src/path.rs 93.51% 7 Missing ⚠️
crates/sail-session/src/planner.rs 14.28% 6 Missing ⚠️
crates/sail-cache/src/checkpoint.rs 90.62% 3 Missing ⚠️
... and 3 more
@@            Coverage Diff             @@
##             main    #1969      +/-   ##
==========================================
- Coverage   79.42%   77.83%   -1.59%     
==========================================
  Files         906      912       +6     
  Lines      171251   174459    +3208     
==========================================
- Hits       136014   135796     -218     
- Misses      35237    38663    +3426     
Files with missing lines Coverage Δ
crates/sail-cache/src/lib.rs 0.00% <ø> (ø)
crates/sail-plan/src/resolver/query/mod.rs 73.46% <100.00%> (-24.25%) ⬇️
crates/sail-session/src/session_factory/server.rs 75.24% <100.00%> (-12.05%) ⬇️
crates/sail-spark-connect/src/server.rs 65.71% <100.00%> (-17.41%) ⬇️
...s/sail-common-datafusion/src/array/record_batch.rs 76.17% <88.88%> (+0.30%) ⬆️
.../sail-common-datafusion/src/rename/logical_plan.rs 75.00% <85.71%> (-8.34%) ⬇️
.../sail-session/src/session_manager/actor/handler.rs 44.19% <60.00%> (-7.35%) ⬇️
crates/sail-cache/src/checkpoint.rs 90.62% <90.62%> (ø)
crates/sail-session/src/planner.rs 63.51% <14.28%> (-29.53%) ⬇️
crates/sail-object-store/src/path.rs 93.51% <93.51%> (ø)
... and 7 more

... and 82 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.