Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
49 commits
Select commit Hold shift + click to select a range
05caceb
base
lonless9 May 21, 2026
cf4ebfa
update
lonless9 May 21, 2026
129d1a2
update
lonless9 May 22, 2026
3812b4a
update
lonless9 May 22, 2026
142c0d9
Merge remote-tracking branch 'origin/main' into feat-checkpoint
lonless9 Jun 21, 2026
ccdf643
refactor: update checkpoint handling to use Arrow-backed storage
lonless9 Jun 21, 2026
95cefd7
feat: materialize checkpoints as arrow object-store plans
lonless9 Jun 21, 2026
45544d7
refactor: route checkpoint storage through session object store
lonless9 Jun 21, 2026
d87f3b5
test: split dataframe checkpoint tests
lonless9 Jun 21, 2026
1ad1e4f
fix: harden checkpoint materialization lifecycle
lonless9 Jun 21, 2026
6c2fad1
refactor: clean checkpoint implementation
lonless9 Jun 21, 2026
54166c2
test: skip checkpoint tests on unsupported PySpark
lonless9 Jun 21, 2026
3c9908c
test: skip JVM-specific checkpoint parity cases
lonless9 Jun 21, 2026
29ef109
Merge remote-tracking branch 'origin/main' into feat-checkpoint
lonless9 Jun 25, 2026
7ad572a
fix: enable checkpoint execution on workers
lonless9 Jun 25, 2026
1e8fb09
Merge remote-tracking branch 'origin/main' into feat-checkpoint
lonless9 Jun 25, 2026
ca2fdab
Merge remote-tracking branch 'origin/main' into feat-checkpoint
lonless9 Jul 7, 2026
4b885a6
tmp
lonless9 Jul 8, 2026
167807b
Merge remote-tracking branch 'origin/main' into feat-checkpoint
lonless9 Jul 10, 2026
fd71293
ci: increase Rust test stack
lonless9 Jul 10, 2026
c1489fd
style: format Rust imports
lonless9 Jul 10, 2026
15d0cb5
test: make checkpoint plans cluster-compatible
lonless9 Jul 10, 2026
d83b4c3
fix: preserve checkpoint lifecycle semantics
lonless9 Jul 10, 2026
8506fee
Merge remote-tracking branch 'origin/main' into feat-checkpoint
lonless9 Jul 14, 2026
90b0c2e
test: cover checkpoint lifecycle and properties
lonless9 Jul 14, 2026
29c1d3b
fix: preserve checkpoint execution semantics
lonless9 Jul 14, 2026
0438b35
remove RUST_MIN_STACK environment variable
lonless9 Jul 14, 2026
fc0cc60
refactor
lonless9 Jul 15, 2026
fc37129
Merge remote-tracking branch 'origin/main' into feat-checkpoint
lonless9 Jul 15, 2026
473752a
test: capture checkpoint parity gaps
lonless9 Jul 16, 2026
276fe88
fix: isolate checkpoint cleanup paths
lonless9 Jul 16, 2026
4ee4a38
fix: refresh cached relation partitioning after rewrites
lonless9 Jul 16, 2026
952f57f
fix: reset lazy checkpoint plans before retry
lonless9 Jul 16, 2026
15a3024
fix: resolve duplicate checkpoint columns by position
lonless9 Jul 16, 2026
7b6de7d
fix: release checkpoint leases from completed jobs
lonless9 Jul 16, 2026
594688c
fix: keep checkpoint data out of worker plans
lonless9 Jul 16, 2026
d2d746d
fix: commit reliable checkpoint attempt winners
lonless9 Jul 16, 2026
5b1157a
Revert "fix: keep checkpoint data out of worker plans"
lonless9 Jul 16, 2026
492c0bc
Revert "fix: release checkpoint leases from completed jobs"
lonless9 Jul 16, 2026
d7c0a50
test: simplify checkpoint test values
lonless9 Jul 16, 2026
01ec5cc
Merge remote-tracking branch 'origin/main' into feat-checkpoint
lonless9 Jul 16, 2026
aeda7d2
test: document checkpoint xfail limits
lonless9 Jul 17, 2026
0625516
Merge remote-tracking branch 'origin/main' into feat-checkpoint
lonless9 Jul 17, 2026
80f9fb3
fix: preserve checkpoint properties across rewrites
lonless9 Jul 17, 2026
00a3df9
refactor(cache): account local checkpoints in memory pool
lonless9 Jul 17, 2026
c5512e2
fix(object-store): reject URL user information
lonless9 Jul 17, 2026
649759f
refactor(object-store): stream checkpoint prefix cleanup
lonless9 Jul 17, 2026
5b9019f
chore(spark-connect): note checkpoint executor follow-up
lonless9 Jul 17, 2026
63a030a
linter
lonless9 Jul 17, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 13 additions & 0 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

9 changes: 9 additions & 0 deletions crates/sail-cache/Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -8,10 +8,19 @@ workspace = true

[dependencies]
sail-common = { path = "../sail-common" }
sail-common-datafusion = { path = "../sail-common-datafusion" }
sail-logical-plan = { path = "../sail-logical-plan" }
sail-physical-plan = { path = "../sail-physical-plan" }

async-trait = { workspace = true }
thiserror = { workspace = true }
object_store = { workspace = true }
datafusion = { workspace = true }
datafusion-common = { workspace = true }
datafusion-datasource = { workspace = true }
datafusion-expr = { workspace = true }
chrono = { workspace = true }
futures = { workspace = true }
log = { workspace = true }
moka = { workspace = true }
tokio = { workspace = true }
Loading
Loading