lightning-rpc file isn't created #8035
Comments
|
Strange thing is that when I checked again today, When I deleted it and restarted the container, it doesn't recreate it. |
|
I think tracking this issue might be hard for you. If some of you have a commit I can cherry pick adding printf logs left and right to narrow down the issue, I can build it and tweak it myself to help find the issue. |
|
This implies gossipd isn't starting up properly: we expect to see "io_break: gossipd_init_done". The next line, in fact, should be " DEBUG gossipd: Store compact time: NNN msec". Is it stuck reading the gossip store somehow? Is it large and/or strange? |
|
Thanks for looking at it @rustyrussell So here are the logs that have shown after 20 min or so, it actually seems cln restart continuously. The Additional context: We run on pruned nodes. Also Are logs coming from our docker container, you can dismiss this. However, the fact we see that mean that the |
|
May be related to #7724 |
|
Would be awesome to get this unblocked, since BitcoinSmiles initiative is eagerly waiting to start a new campaign, but their node is down for quite a while and blocked by this (they couldn't receive new donations for weeks now) and it would really be bad to push them into using custodial node solution or an alternative implementation, since CLN worked for them great since 2021, plus there's still funds and channels there. Thanks you guys! |
|
OK, I've got it. It's actually related to this: We stall there and don't make more progress. So gossipd itself doesn't see the entire gossip_store. Then things get really batshit: This took 1429 seconds to process. Why? Because it hasn't been processing the gossip store fully, gossipd kept adding "new" records to the end: It has 31GB of gossip in there! No wonder it took so long, and no wonder topology plugin (which tried to digest that crap) timed out. |
|
Hmm, can you send me the first 2MB of the gossip_store file BTW? And your node id? You should delete the gossip store once this is done, BTW, and this problem should resolve itself (for now: I'm still interested in HOW we got here...) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
It seems that several of BTCPay Server users are experiencing an issue with core-lightning 24.08.2.
It is hard to say when it started, but I have this issue now on two servers.
Core lightning seems to be running fine, but the
lightning-rpcisn't created.Config
Logs
Note that after
DEBUG hsmd: new_client: 0, nothing happen. No more logs ever happen even withlog-level=debug.The text was updated successfully, but these errors were encountered: