Skip to content

Add incremental CDC retention cleanup#600

Merged
Osvaldo Andrade (osvaldoandrade) merged 2 commits into
masterfrom
fix/disable-stream-retention-loop
Jun 27, 2026
Merged

Add incremental CDC retention cleanup#600
Osvaldo Andrade (osvaldoandrade) merged 2 commits into
masterfrom
fix/disable-stream-retention-loop

Conversation

@osvaldoandrade

@osvaldoandrade Osvaldo Andrade (osvaldoandrade) commented Jun 27, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Replace stream retention full-changelog scans with per-record expiration pointers and bounded physical cleanup.
  • Persist the changelog high-water mark so sequence numbers remain monotonic after expired records are removed.
  • Keep stream read paths on persisted trim state only; FAST materialized views and PITR now depend on the retained CDC window.
  • Add cleanup interval and batch-size config/Helm wiring; keep negative intervals as the explicit off switch.

Validation

  • go test ./...
  • git diff --check
  • helm template cefas ./dist/helm/cefas

@osvaldoandrade Osvaldo Andrade (osvaldoandrade) changed the title Disable automatic stream retention scans Add incremental CDC retention cleanup Jun 27, 2026
@osvaldoandrade Osvaldo Andrade (osvaldoandrade) marked this pull request as ready for review June 27, 2026 17:17
@osvaldoandrade Osvaldo Andrade (osvaldoandrade) merged commit 00ded15 into master Jun 27, 2026
8 checks passed
@osvaldoandrade Osvaldo Andrade (osvaldoandrade) deleted the fix/disable-stream-retention-loop branch June 27, 2026 17:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant