Skip to content

ops: backup and disaster recovery for off-chain state #62

Description

@joelpeace48-cell

Problem

Some state exists only off-chain: dispute evidence, API keys, export artifacts,
idempotency records. Losing it is unrecoverable — unlike the index, which can be
rebuilt from the ledger. There is currently no backup plan and no statement of
what the service guarantees.

What to do

  • Classify state explicitly: reconstructible from chain (index, cached
    reads) versus irreplaceable (evidence, keys, audit logs). The backup
    strategy follows the classification.
  • Automated encrypted backups of the irreplaceable set, stored in a separate
    failure domain from the primary.
  • Restore drills on a schedule. A backup that has never been restored is a
    hypothesis, not a backup.
  • Document the rebuild-from-chain procedure for the reconstructible set, with a
    measured time-to-rebuild.
  • Publish RPO and RTO targets and hold the design to them.

Acceptance criteria

  • State classified and documented
  • Automated encrypted backups in a separate failure domain
  • Restore drill run and timed, with results recorded
  • Rebuild-from-chain procedure documented and timed
  • RPO and RTO published

Notes

Dispute evidence is the item to worry about most: it is irreplaceable, it is
what a disagreement turns on, and it is exactly what someone would want to
destroy.

Metadata

Metadata

Assignees

No one assigned

    Labels

    GrantFox OSSIssue tracked in GrantFox OSSThird CampaignCampaign: Third Campaignarea:opsDeploy, observability, CIdifficulty:hardDesign judgement required; subtle failure modespriority:highNeeded for the next milestonetype:choreTooling, CI, dependencies

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions