Skip to content

Self-healing after spark-evaluate restarts #3

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
2 tasks
Tracked by #47
juliangruber opened this issue Sep 5, 2023 · 2 comments · May be fixed by #342
Open
2 tasks
Tracked by #47

Self-healing after spark-evaluate restarts #3

juliangruber opened this issue Sep 5, 2023 · 2 comments · May be fixed by #342
Assignees
@juliangruber

Comments

@juliangruber
Copy link
Member

juliangruber commented Sep 5, 2023 •
edited
Loading

  • self heal / discover all measurements that haven't been preprocessed yet, and all rounds that haven't been evaluated yet
  • Since we are keeping all measurements in memory, I think we should handle the case where our service starts in the middle of an IE round, and we receive only some of the MeasurementsAdded events for this round
@juliangruber juliangruber self-assigned this Sep 5, 2023
@juliangruber juliangruber moved this to 📥 todo in Space Meridian Sep 5, 2023
@juliangruber juliangruber mentioned this issue Sep 5, 2023
Merged
1 task
@bajtos bajtos moved this from 📥 todo to ✅ done in Space Meridian Sep 21, 2023
This was referenced Oct 12, 2023
Closed
Closed
Closed
@bajtos bajtos moved this from ✅ done to 📥 todo in Space Meridian Oct 16, 2023
@bajtos bajtos mentioned this issue Nov 9, 2023
Closed
@patrickwoodhead
Copy link

@juliangruber did we finish this one?

@juliangruber
Copy link
Member Author

Not yet, currently we're accepting that some data will be lost

juliangruber added a commit that referenced this issue Aug 31, 2024
@juliangruber
Add persistent round buffer. Closes #3
e52f9e2
@juliangruber juliangruber linked a pull request Aug 31, 2024 that will close this issue
Draft
4 tasks
@bajtos bajtos mentioned this issue Sep 2, 2024
Closed
@pyropy pyropy mentioned this issue Jan 28, 2025
Closed
58 tasks
@bajtos bajtos changed the title Self-healing Self-healing after spark-evaluate restarts Mar 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@juliangruber juliangruber

Labels
None yet
Projects
Space Meridian
Status: 📥 next
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add round buffer. Closes #3 CheckerNetwork/spark-evaluate
2 participants
@juliangruber @patrickwoodhead