Code

New gossip_net backend using libp2p#3988

Code

Merged

bkase merged 220 commits intodevelopMinaProtocol/mina:developfrom feature/net2MinaProtocol/mina:feature/net2Copy head branch name to clipboardFeb 10, 2020

+4,779-43,210

Commits

Commits on Nov 25, 2019

• rip out haskell

  

  cmr

  authored and

  emberian

  committed
  4370744

• remove kademlia-haskell

  

  cmr

  authored and

  emberian

  committed
  004a5be

• remove dune mentions of kademlia

  

  cmr

  authored and

  emberian

  committed
  a08a30f

• remove build system kademlia remnants

  

  cmr

  authored and

  emberian

  committed
  0b2ab10

• some node_addrs_and_ports shuffling

  

  cmr

  authored and

  emberian

  committed
  097c3a7

• missing dune/opam files

  

  cmr

  authored and

  emberian

  committed
  481894c

• rework peer id location

  

  cmr

  authored and

  emberian

  committed
  d06c577

• Logger.spam for annoying libp2p logs

  

  cmr

  authored and

  emberian

  committed
  4ce324c

• paint the rest of the owl

  emberian

  committed
  59c995f

• remove vestigial peers_by_ip

  emberian

  committed
  c3ff0ff

• initial peers replaceme'd

  emberian

  committed
  6c3e219

• reformat

  emberian

  committed
  4e9f2e8

• list and find peers

  emberian

  committed
  f82a2db

Commits on Nov 26, 2019

• makefile: don't build libp2p_helper

  emberian

  committed
  0264bad

• replace node_addrs_and_ports field as intended

  emberian

  committed
  cdfe4c9

• logproc spam

  emberian

  committed
  adf8113

• implement subscribe_encode

  

  cmr

  committed
  fb70c3e

• update some go deps

  

  cmr

  committed
  75cd8c6

Commits on Nov 27, 2019

• ban notification pipe, not hooked up to anything

  

  cmr

  committed
  25664fd

Commits on Dec 6, 2019

• ban/unban IPs

  

  cmr

  committed
  c75660a

• remove dead var

  

  cmr

  committed
  d7f38ac

• Clock.at

  

  cmr

  committed
  695a659

• replaceme last todo

  

  cmr

  committed
  8bffd5e

• libp2p keypair management in secrets

  

  cmr

  committed
  306ab6d

• remove old peer cli, use json peers for libp2p and not kademlia

  

  cmr

  committed
  b211d20

• only non-seed peers die when there are no initial connections

  

  cmr

  committed
  d8f7f1f

• Wait 5 seconds before doing the first DHT discovery

  

  cmr

  committed
  7a0f3da

• bind-ip doc string tweak

  

  cmr

  committed
  23f46e9

• add missing keypair files

  

  cmr

  committed
  fa413bb

Commits on Dec 7, 2019

• Merge remote-tracking branch 'origin/develop' into feature/net2

  Show description for f1b4c6c
  

  cmr

  committed
  f1b4c6c

• try adding ourselves to the peer table

  

  cmr

  committed
  760ab37

• update haskell toolchain

  

  cmr

  committed
  03609c6

• new toolchain for real?

  

  cmr

  committed
  4357f9e

Commits on Dec 9, 2019

• don't conflict with #4033

  

  cmr

  committed
  54b08e0

• rename haskell toolchain

  

  cmr

  committed
  57ec24d

• use locally build deb for toolchain, instead of repo one

  

  cmr

  committed
  a30ba56

• new toolchain, replace ad-hoc discovery deb fetch

  

  cmr

  committed
  ef1f42d

• new toolchain, with manually published discovery deb

  

  cmr

  committed
  1f798dd

• replace no-cache

  

  cmr

  committed
  3d393c0

• Coda_net2.list_peers: filter out bogus entries

  

  cmr

  committed
  e563142

• put child_subprocesses back

  

  cmr

  committed
  58b9c75

Commits on Dec 10, 2019

• fix helper<->daemon mismatches, fake_network bugs

  

  cmr

  committed
  d95cba0

• fully implement Logger.Spam

  

  cmr

  committed
  95dd7c6

Commits on Dec 17, 2019

• bind IP is for both listen and outbound

  

  cmr

  committed
  9e4cb9f

• don't mention libp2p in cli help

  

  cmr

  committed
  cdaf7e9

• small sleep between checking node readiness

  

  cmr

  committed
  41f22b4

• move bootstrapping/advertisement before FindPeers loop

  

  cmr

  committed
  69eb766

• use /32 as netmask

  

  cmr

  committed
  56ca844

• put bootstrap controller trust actions back

  

  cmr

  committed
  dd3f0b9

• use Data.t in more places

  

  cmr

  committed
  a5cec72

• filter out pubsub from ourself

  

  cmr

  committed
  33cdb4a

• include header in bin_dump, expected by read_bin_prot

  

  cmr

  committed
  fdeff15

• remove current_peers, no longer used

  

  cmr

  committed
  967ad28

• reformat

  

  cmr

  committed
  06d9d64

• downgrade log from info

  

  cmr

  committed
  ba349d7

• apply trust action on pubsub decode failure

  

  cmr

  committed
  ecf2db3

• remove stray comment

  

  cmr

  committed
  442fbc3

• bump timeout?

  

  cmr

  committed
  4bf7063

• remove Get_chain_id

  

  cmr

  committed
  7209022

• add issue number for ban notifications

  

  cmr

  committed
  6b457fe

• move peers comment

  

  cmr

  committed
  e932519

• Deferred.ignore

  

  cmr

  committed
  960e51b

• trust action for rpc_peer_then_random outgoing calls

  

  cmr

  committed
  809b060

• ban banned peers on startup

  

  cmr

  committed
  601cd25

• timeout a bit higher?

  

  cmr

  committed
  71d4f3e

• bump daemon_expiry

  jkrauska

  committed
  a983941

• don't suppress generate-libp2p-keypair logs

  

  cmr

  committed
  4cd9c2d

• Merge remote-tracking branch 'origin/develop' into feature/net2

  Show description for 05252cb
  

  cmr

  committed
  05252cb

• fix transition router post merge

  

  cmr

  committed
  1ca9ef8

Commits on Jan 2, 2020

• drain ban notification pipe

  

  cmr

  committed
  3067b30

• Merge remote-tracking branch 'origin/develop' into feature/net2

  Show description for ba71407
  

  cmr

  committed
  ba71407

Commits on Jan 3, 2020

• new toolchain

  

  cmr

  committed
  fb7c350

• reformat

  

  cmr

  committed
  22583ff

• don't reset the stream when it fails to be created

  

  cmr

  committed
  ee21ebe

Commits on Jan 6, 2020

• libp2p_helper: format some logs correctly, add bt

  

  cmr

  committed
  108f6f4

• ci: snark worker wait longer between work request

  Show description for 9d01558
  

  cmr

  committed
  9d01558

• go fmt

  

  cmr

  committed
  4d201b7

• new container, updated helper

  

  cmr

  committed
  e603be8

• spam is the least important variant, not most

  

  cmr

  committed
  eed94f4

• logger mli agrees

  

  cmr

  committed
  dad41ef

Commits on Jan 7, 2020

• put rpc handler back (where did this go?)

  

  cmr

  committed
  779fcc6

• less fatal stream invariant checking

  emberian

  committed
  9a4e5c6

• show, not to_string

  

  cmr

  committed
  c436651

• use show correctly

  

  cmr

  committed
  575c3bc

Commits on Jan 8, 2020

• go back and fix this commit, cmr

  

  cmr

  committed
  358e44e

• extra bit of debug

  emberian

  committed
  7c4a6ff

Commits on Jan 9, 2020

• remove debug, don't half-close streams, wait for rpc

  

  cmr

  committed
  36170e0

Commits on Jan 10, 2020

• bubble up messages from validation as 'published'

  

  cmr

  committed
  d63d8b0

• DO log gossip in CI

  

  cmr

  committed
  681f387

• Merge remote-tracking branch 'origin/develop' into feature/net2

  Show description for c5f414d
  

  cmr

  committed
  c5f414d

• source is an option now

  emberian

  committed
  a18fd9d

• Merge remote-tracking branch 'origin/develop' into feature/net2

  Show description for 94aee62
  emberian

  committed
  94aee62

• patch up all merge mistakes

  emberian

  committed
  59a9d6b

Commits on Jan 11, 2020

• Fix #4097: thread a validation callback to the resource pool

  

  cmr

  committed
  e00c34e

• fix nil deref

  

  cmr

  committed
  6a0bc55

• patch leaks in subscription and stream table

  

  cmr

  committed
  b768626

• update toolchain

  

  cmr

  committed
  191fbb1

Commits on Jan 14, 2020

• some debugging to tests

  

  cmr

  committed
  8c1f39c

• Merge branch 'develop' into feature/net2

  

  cmr

  authored
  9bb1dca

• don't bother with envelope sender for CI

  emberian

  committed
  7c3ba27

• new container, updated helper

  

  cmr

  committed
  dd77ffc

• Merge remote-tracking branch 'origin/develop' into feature/net2

  

  cmr

  committed
  a3b1ff5

• Fix changes to src/app/website/static

  bkase

  committed
  9aaa302

Commits on Jan 15, 2020

• unsafe_no_trust_ip more thoroughly, remover stray debug

  emberian

  committed
  31f89ce

• Merge branch 'feature/net2' of github.com:codaprotocol/coda into feature/net2

  emberian

  committed
  ee0410a

• new container, updated helper

  

  cmr

  committed
  a9ea37a

• longer validation timeout

  emberian

  committed
  d8662fc

• Merge remote-tracking branch 'origin/develop' into feature/net2

  emberian

  committed
  0c05f30

• Merge branch 'feature/net2' of github.com:codaprotocol/coda into feature/net2

  emberian

  committed
  9519a32

• libp2p helper sig

  emberian

  committed
  03cd20a

• err != nil

  emberian

  committed
  7639532

• WIP docker

  bkase

  committed
  4f3cfaa

Commits on Jan 16, 2020

• Update deps container

  bkase

  committed
  a8315ef

• Revert "WIP docker"

  Show description for 58b8d79
  bkase

  committed
  58b8d79

• Merge branch 'develop' into feature/net2

  bkase

  authored
  6b626ff

• only care about ports in coda peers test

  emberian

  committed
  90d2f16

• [WIP] validate locally-generated/redundant gossip

  emberian

  committed
  5ae9138

• downgrade Violated_protocol to Outgoing_connection_error

  emberian

  committed
  63dccdf

• bypass gossip validation for now

  emberian

  committed
  989d0ea

• avoid infinifte resource pool spin

  emberian

  committed
  5698531

• reformat

  emberian

  committed
  26f3c08

• new container, new helper

  

  cmr

  committed
  950ba4d

• don't block that goroutine

  emberian

  committed
  f5d1476

• don't block forever writing validation

  

  cmr

  committed
  7fa0e9a

• new container, new helper

  

  cmr

  committed
  5d9150a

• Merge branch 'feature/net2' of github.com:codaprotocol/coda into feature/net2

  emberian

  committed
  b05851b

• don't reingest outgoing validation messages

  emberian

  committed
  1d78580

• reformat

  emberian

  committed
  26c10ed

• Merge remote-tracking branch 'origin/develop' into feature/net2

  emberian

  committed
  c5d4326

• earlier validation completion

  

  cmr

  committed
  f8b4a53

• new container etc

  

  cmr

  committed
  5a0423f

• time helper rpc durations

  emberian

  committed
  b2ad32f

• Merge branch 'feature/net2' of github.com:codaprotocol/coda into feature/net2

  emberian

  committed
  e86d4a3

• don't crash when shutting down helper

  emberian

  committed
  6ca80a1

• DO ingest messages from ourselves

  emberian

  committed
  bece7a4

• WIP docker

  bkase

  committed
  4503d56

• Update deps

  bkase

  committed
  ce59f1c

• Revert "WIP docker"

  Show description for e157be8
  bkase

  committed
  e157be8

Commits on Jan 17, 2020

• fix ban_ip message

  emberian

  committed
  46d1754

• push validation callback deeper into transitions

  emberian

  committed
  ba0b2c7

• coda_net2 unit test self recv

  

  cmr

  committed
  af4ef5f

• new container, updated helper

  

  cmr

  committed
  b693404

• Merge branch 'feature/net2' of github.com:codaprotocol/coda into feature/net2

  emberian

  committed
  9214f9e

• fix unban ip

  emberian

  committed
  788e04d

• make sure new transitions get broadcast

  emberian

  committed
  c85c5cf

Commits on Jan 18, 2020

• turn up bootstrap block window

  emberian

  committed
  043aed3

• make normal logs quiet

  emberian

  committed
  48a0187

Commits on Jan 24, 2020

• Switch to base64 in helper protocol, log more

  

  Ember Arlynx

  authored and

  emberian

  committed
  fbafb31

Commits on Jan 25, 2020

• new container for the container gods

  

  Ember Arlynx

  committed
  bfe47f6

• remove test that base58_check is linear time

  emberian

  committed
  995ed8a

Commits on Jan 27, 2020

• fork mplex to set a custom max message size

  emberian

  committed
  8f4cae7

• tweak base58_check long encoding warning

  emberian

  committed
  1e27491

• remove some spare debugging

  emberian

  committed
  8d7c17d

• reformat

  emberian

  committed
  fcdd9fe

• rename real to forward

  emberian

  committed
  f1fb8a7

• tag proposed transitions with correct validation callback

  emberian

  committed
  0f39061

• add synchronization around Validators map

  emberian

  committed
  c7cdd86

• new container

  

  Ember Arlynx

  committed
  b17f0e3

Commits on Jan 28, 2020

• only throw exception if helper does OUTSIDE of normal flow

  

  Ember Arlynx

  committed
  e3a16c2

• downgrade warn to trace

  

  Ember Arlynx

  committed
  b08a6c2

• more robust helper termination handling

  

  Ember Arlynx

  committed
  88ebacb

• downgrade Violated_protocol to Outgoing_connection_error more

  emberian

  committed
  383a62e

• don't broadcast bad blocks, it gets us banned

  emberian

  committed
  03ff083

• don't exit 0 in the helper, we don't want stdin to close

  emberian

  committed
  4e53629

• let i/o pipes drain before closing ocaml i/o objects

  Show description for 0fb45a0
  

  Ember Arlynx

  committed
  0fb45a0

Commits on Jan 29, 2020

• remove unnecessary ok_exn

  

  Ember Arlynx

  committed
  3085573

• larger scanner buffer

  

  Ember Arlynx

  committed
  64c4f68

• seqno 0 for special messages

  

  Ember Arlynx

  committed
  3da4d4a

• remove concurrency limit (default is sufficient)

  

  Ember Arlynx

  committed
  01a7053

• new container, last one?

  

  Ember Arlynx

  committed
  0b8e99f

• replace sleep with trace log

  

  Ember Arlynx

  committed
  abfe4d1

Commits on Jan 30, 2020

• Merge branch 'feature/net2' of github.com:codaprotocol/coda into feature/net2

  emberian

  committed
  ba1fcc9

• more time to drain...

  emberian

  committed
  b37d75e

Commits on Feb 3, 2020

• tweak child_processes writer shutdown logic

  

  Ember Arlynx

  committed
  f6f75a9

• build helper in CI

  

  Ember Arlynx

  committed
  644db45

• container sans helper

  

  Ember Arlynx

  committed
  217dd85

• log helper stuff to a separate file for now

  

  Ember Arlynx

  committed
  9b0a3ef

• new container with nix

  

  Ember Arlynx

  committed
  a9ac1ef

• install cachix where needed

  

  Ember Arlynx

  committed
  be5b8a6

• render circleci

  

  Ember Arlynx

  committed
  25a371b

• render again with more cachix

  

  Ember Arlynx

  committed
  49aa149

• undo some staging changes

  

  Ember Arlynx

  committed
  7cc1c6a

Commits on Feb 4, 2020

• load nix.sh before installing cachix

  

  Ember Arlynx

  committed
  1f03464

• set USER env var for nix.sh

  

  Ember Arlynx

  committed
  c89c98b

• new container for USER

  

  Ember Arlynx

  committed
  c105cd9

• print cmr in lint-opt

  

  Ember Arlynx

  committed
  e1f19bc

• USER=opam since apparently the container isn't good enough

  

  Ember Arlynx

  committed
  c2eaa60

• try turning sandboxing off to prevent sethostname failure?

  

  Ember Arlynx

  committed
  78be315

• fix build-artifacts USER=opam

  

  Ember Arlynx

  committed
  c4775c3

• mkdir /tmp/artifacts in helper

  

  Ember Arlynx

  committed
  7bacf51

• nix --option sandbox false everywhere

  

  Ember Arlynx

  committed
  481a29e

• fix makefile indentation

  

  Ember Arlynx

  committed
  96c2649

• why isn't get_project_root starting in the right place?

  

  Ember Arlynx

  committed
  24b4d92

• reformat

  

  Ember Arlynx

  committed
  634f779

Commits on Feb 5, 2020

• thread peers through to local config correctly

  

  Ember Arlynx

  committed
  5dbceff

• cli help text grammar

  

  Ember Arlynx

  committed
  7a8a1d1

• 4095 fix comments

  

  Ember Arlynx

  committed
  7c8ce2a

• tests type error

  emberian

  committed
  fad9f0c

• remove helper binary

  emberian

  committed
  889665e

Commits on Feb 6, 2020

• working_dir in -background mode too

  emberian

  committed
  98324f6

• integration tests pregenerate peer ids

  emberian

  committed
  4f7bb24

• cleanup working_dir leftovers

  emberian

  committed
  23b0551

• small cleanups i noticed in review

  emberian

  committed
  6166c79

• Merge remote-tracking branch 'origin/develop' into feature/net2

  Show description for 3d8d8ef
  emberian

  committed
  3d8d8ef

• remove useless USER=opam

  emberian

  committed
  6728e84

• temporarily remove limit-concurrent-connections arg

  emberian

  committed
  6e7173a

• fix merge errors

  emberian

  committed
  36ea2b8

• new container

  emberian

  committed
  690ed16

• don't not broadcast local works?

  emberian

  committed
  d6c2c5f

Commits on Feb 7, 2020

• synchronous message pipe in gossip net

  

  Ember Arlynx

  committed
  4abd827

• support old-format discovery-keypair args

  

  Ember Arlynx

  committed
  91c6782

• reformat

  

  Ember Arlynx

  committed
  0d44ca5

• Merge remote-tracking branch 'origin/develop' into feature/net2

  

  Ember Arlynx

  committed
  e3f2bc0

• obliterate coda-discovery

  

  Ember Arlynx

  committed
  9a295b7

• fix build-auxiliary

  

  Ember Arlynx

  committed
  1798af9

• conflict new coda-daemon deb with old coda-discovery deb

  

  Ember Arlynx

  committed
  e885bd7

• don't mention SCRIPTPATH?

  

  Ember Arlynx

  committed
  5df14d2

• remove build-auxiliary from required tests

  

  Ember Arlynx

  committed
  5c0a06f

• c'mon deb!

  

  Ember Arlynx

  committed
  0d6789f

Commits on Feb 8, 2020

• update mergify config

  

  Ember Arlynx

  committed
  1a4885c