Repository navigation
feat!: proof gossiping #1115
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Draft
agureev
wants to merge
73
commits into
dev
Choose a base branch
from
artem/proof-gossip
base: dev
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Draft
feat!: proof gossiping #1115
Changes from 26 commits
Commits
Show all changes
73 commits
Select commit
Hold shift + click to select a range
2311463
refactor(common): route block inscriptions through one codec
agureev 0b8974c
fix(sequencer): size blocks by their inscription bytes
agureev d032b50
feat!: hash transactions and blocks over proof digests, and fetch pro…
agureev 486331d
test: pin the digest-form hashes, the proof store and fetching proofs…
agureev 8be3ca5
feat!: inscribe blocks in digest form and settle them by the skip rule
agureev 98a4551
test(chain_state): select and settle by the skip rule
agureev 6175399
test(sequencer, common): digest-form blocks, transaction caps and the…
agureev d399c8b
test(indexer, cross_zone): index and deliver only settled blocks
agureev 7e09fd4
Merge remote-tracking branch 'origin/dev' into artem/block-proof-gossip
agureev 8babfdf
fixup! Merge remote-tracking branch 'origin/dev' into artem/block-pro…
agureev dab220c
fixup! Merge remote-tracking branch 'origin/dev' into artem/block-pro…
agureev ab8872d
refactor(executor): take the proof store from the chain state
agureev 50f2dc1
refactor(common): read a transaction's or a block's proofs through on…
agureev 84a8a76
refactor(common): hydrate a digest-form block to an Option
agureev 02b7119
refactor(chain_state): keep one proof store handle and measure the di…
agureev 824a671
test: drop size and pinning tests another layer already pins
agureev 28edb80
refactor(gossip): fetch proofs over libp2p's JSON request-response codec
agureev 55beee4
fixup! refactor(common): read a transaction's or a block's proofs thr…
agureev 5d6058c
refactor(cross_zone): fold a peer's batch once for both structural re…
agureev c2a1029
test(chain_state): build the shared private transfer with the apply t…
agureev 50d411b
test(sequencer): run a watcher pass through one helper
agureev 6cea44b
fixup! test(chain_state): build the shared private transfer with the …
agureev caf2dc1
Revert "refactor(cross_zone): fold a peer's batch once for both struc…
agureev ce4cbf0
refactor(executor): settle a held block's deliveries in the replay's …
agureev 273ac01
refactor(indexer): chain each batch on the fold's final message
agureev 323452c
refactor(chain_state): read batches with try_unfold
agureev 5b854d5
test(chain_state): name the skip-rule fixture blocks by their roles
agureev da5411e
refactor(chain_state): check a proof against the cap in one place
agureev 0324dce
fix(executor): cache a submitted proof only within the proof cap
agureev b6cff42
refactor(lee): make the proof digest a plain 32-byte array
agureev 39ce634
refactor(chain_state): rename fold outcomes, verdicts and blocker fields
agureev a566af8
refactor(sequencer): name follow's hydration result for what it reports
agureev 538020b
refactor(indexer): name the ingestion loop's state and actions
agureev 5e32cf7
docs: describe settlement as settled state and trim review comments
agureev 6b156c8
test(chain_state): a misplaced block on the settled tip is punishable
agureev a5b308f
test(executor): cache a proof within the cap and refuse one over it
agureev 11a519f
test(chain_state): pin the skip-rule tests' windows, offences and lat…
agureev a8b509f
docs(indexer): describe what a failed pass reads again and what stays…
agureev e0ee779
Merge remote-tracking branch 'origin/dev' into artem/block-proof-gossip
agureev 09bc0b6
feat(storage): add a Logos Storage REST client
agureev d88a7fc
feat(sequencer): track verified proof locators and their holds
agureev 94828dd
feat(sequencer): bound proof downloads and keep live capacity
agureev 2ee6c7b
feat!(common): inscribe a Storage locator per private transaction
agureev 27c00a2
feat!(sequencer): announce private transactions by digest and locator
agureev a999685
feat!(sequencer): recover missing proofs by locator and digest lookup
agureev 50fa0f7
feat(indexer): fetch proofs from Logos Storage, with getProof as reco…
agureev a791bfe
feat(sequencer_stake): sign availability approvals
agureev d945c37
feat(sequencer): approve candidates whose proofs this node serves
agureev 83f2683
feat!(sequencer): publish proof-bearing blocks on a two-thirds availa…
agureev 92f9c7d
chore(docker): run a pinned Logos Storage node beside the sequencer a…
agureev c00700a
docs: document Logos Storage proof distribution
agureev 51aabe6
test(common): pin the locator inscription and its charge
agureev f9c6617
test(storage): screen manifests and bound downloads
agureev d911af8
test(sequencer): admit announced private transactions after screening
agureev 91bb07e
test(sequencer): count availability approvals and fall back to public…
agureev 7002c13
test(indexer): recover proofs by locator and by digest
agureev cc4a013
test(sequencer): recover a proof by digest after a wrong locator
agureev fd3fed6
fixup! feat!(sequencer): announce private transactions by digest and …
agureev 81746c2
fixup! feat(storage): add a Logos Storage REST client
agureev 195dc55
fixup! feat(sequencer): bound proof downloads and keep live capacity
agureev 0662be6
fixup! feat!(common): inscribe a Storage locator per private transaction
agureev 11138ea
fixup! feat!(sequencer): announce private transactions by digest and …
agureev 7e6cc7f
fixup! feat!(sequencer): recover missing proofs by locator and digest…
agureev 5669d13
fixup! feat(indexer): fetch proofs from Logos Storage, with getProof …
agureev 6632653
fixup! feat(sequencer): approve candidates whose proofs this node serves
agureev 6269903
fixup! feat!(sequencer): publish proof-bearing blocks on a two-thirds…
agureev e0cc696
fixup! test(sequencer): admit announced private transactions after sc…
agureev 3f39219
fixup! test(sequencer): count availability approvals and fall back to…
agureev 5944d95
fixup! feat(storage): add a Logos Storage REST client
agureev 417914c
fixup! feat(sequencer): bound proof downloads and keep live capacity
agureev 497155d
fixup! feat!(sequencer): recover missing proofs by locator and digest…
agureev 1d7322f
fixup! feat(indexer): fetch proofs from Logos Storage, with getProof …
agureev 047f115
fixup! feat!(sequencer): publish proof-bearing blocks on a two-thirds…
agureev File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Oops, something went wrong.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change | ||||
|---|---|---|---|---|---|---|
|
|
@@ -164,7 +164,9 @@ Titles carry no "Sequencer" prefix, since every dashboard here is about sequence | |||||
| | Is the rotation fair, and are turns used? | **Share of turns**, **Share of blocks produced**, **Blocks per turn** over the time range | | ||||||
| | Is anyone falling behind or failing? | **Blocks behind the network**, **Failed production turns in a row** | | ||||||
|
|
||||||
| `blocks_produced_total` counts a block once the channel finalizes it, signed by this sequencer: a block on the head can still be orphaned when another sequencer's inscription wins the same position, typically around a turn handover. Summed over sequencers it equals the finalized chain height, as long as none restarted. | ||||||
| `blocks_produced_total` counts a block once it settles, signed by this sequencer: until then a block on the head can still be orphaned when another sequencer's inscription wins the same position, typically around a turn handover, or cut when the next writer skips it. Summed over sequencers it equals the settled chain height, as long as none restarted. | ||||||
|
|
||||||
| `skips_total{writer}` counts the skips each writer placed, once final: blocks built on the parent of another writer's private block, cutting it. An honest writer skips a block whose proofs it never received, so a high count is evidence for eviction, not proof of a fault. | ||||||
|
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
|
||||||
| Turns come from Bedrock: the zone SDK notifies a sequencer when its turn to write starts and ends, and the Bedrock actor forwards that to the executor. `sequencer_executor_actor_metrics` records them as `turn_to_write` (1 while held) and `turns_to_write_total` (turns started; a turn notified several times counts once, while a new starting slot is a new turn even for the same holder). | ||||||
|
|
||||||
|
|
||||||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.