Geth is stuck on restarting

Core DAppNode Packages versions

  • bind.dnp.dappnode.eth: 0.2.6
  • core.dnp.dappnode.eth: 0.2.47
  • dappmanager.dnp.dappnode.eth: 0.2.42, branch: v0.2.43, commit: ec541936
  • ipfs.dnp.dappnode.eth: 0.2.14
  • vpn.dnp.dappnode.eth: 0.2.8, commit: f9a8743e
  • wifi.dnp.dappnode.eth: 0.2.7

System info

  • dockerComposeVersion: 1.25.5
  • dockerServerVersion: 20.10.2
  • dockerCliVersion: 20.10.2
  • os: debian
  • versionCodename: bullseye
  • architecture: amd64
  • kernel: 5.10.0-6-amd64
  • Disk usage: 23%

Ok so I have been validating a few months now with zero issues, then 4 days ago or so I had some missed attestations. When I checked on my node it showed that my geth was stuck on restarting and the logs showed this. This was on the newest updated version of geth.

INFO [08-20|01:32:54.122] Starting Geth on Ethereum mainnet…
INFO [08-20|01:32:54.122] Bumping default cache on mainnet provided=1024 updated=4096
INFO [08-20|01:32:54.122] Enabling metrics collection
INFO [08-20|01:32:54.122] Enabling stand-alone metrics HTTP endpoint address=0.0.0.0:6060
INFO [08-20|01:32:54.122] Starting metrics server addr=http://0.0.0.0:6060/debug/metrics
INFO [08-20|01:32:54.124] Maximum peer count ETH=50 LES=0 total=50
INFO [08-20|01:32:54.124] Smartcard socket not found, disabling err=“stat /run/pcscd/pcscd.comm: no such file or directory”
INFO [08-20|01:32:54.125] Set global gas cap cap=50,000,000
INFO [08-20|01:32:54.125] Allocated trie memory caches clean=614.00MiB dirty=1024.00MiB
INFO [08-20|01:32:54.125] Allocated cache and file handles database=/root/.ethereum/geth/chaindata cache=2.00GiB handles=524,288
INFO [08-20|01:32:55.031] Opened ancient database database=/root/.ethereum/geth/chaindata/ancient readonly=false
CRIT [08-20|01:32:55.033] Failed to store chain config err=“leveldb/table: corruption on data-block (pos=89094): checksum mismatch, want=0xfb233e1 got=0x9cef8e6 [file=2039978.ldb]”

A user on the discord suggested I delete geth and its data and resync. I Did that but am now getting this error when my geth size is 303gb so not done syncing. In the dashboard it does not display the geth info card and in the packages page it always shows geth as restarting.

INFO [08-22|18:41:29.477] Starting Geth on Ethereum mainnet…
INFO [08-22|18:41:29.477] Bumping default cache on mainnet provided=1024 updated=4096
INFO [08-22|18:41:29.477] Enabling metrics collection
INFO [08-22|18:41:29.477] Enabling stand-alone metrics HTTP endpoint address=0.0.0.0:6060
INFO [08-22|18:41:29.477] Starting metrics server addr=http://0.0.0.0:6060/debug/metrics
INFO [08-22|18:41:29.478] Maximum peer count ETH=50 LES=0 total=50
INFO [08-22|18:41:29.478] Smartcard socket not found, disabling err=“stat /run/pcscd/pcscd.comm: no such file or directory”
INFO [08-22|18:41:29.479] Set global gas cap cap=50,000,000
INFO [08-22|18:41:29.479] Allocated trie memory caches clean=614.00MiB dirty=1024.00MiB
INFO [08-22|18:41:29.479] Allocated cache and file handles database=/root/.ethereum/geth/chaindata cache=2.00GiB handles=524,288
INFO [08-22|18:41:29.735] Opened ancient database database=/root/.ethereum/geth/chaindata/ancient readonly=false
CRIT [08-22|18:41:29.738] Failed to store chain config err=“leveldb/table: corruption on data-block (pos=1500267): checksum mismatch, want=0x447e6e59 got=0x3906344c [file=176166.ldb]”
INFO [08-22|18:42:30.194] Starting Geth on Ethereum mainnet…
INFO [08-22|18:42:30.194] Bumping default cache on mainnet provided=1024 updated=4096
INFO [08-22|18:42:30.194] Enabling metrics collection
INFO [08-22|18:42:30.194] Enabling stand-alone metrics HTTP endpoint address=0.0.0.0:6060
INFO [08-22|18:42:30.194] Starting metrics server addr=http://0.0.0.0:6060/debug/metrics
INFO [08-22|18:42:30.196] Maximum peer count ETH=50 LES=0 total=50
INFO [08-22|18:42:30.196] Smartcard socket not found, disabling err=“stat /run/pcscd/pcscd.comm: no such file or directory”
INFO [08-22|18:42:30.196] Set global gas cap cap=50,000,000
INFO [08-22|18:42:30.196] Allocated trie memory caches clean=614.00MiB dirty=1024.00MiB
INFO [08-22|18:42:30.196] Allocated cache and file handles database=/root/.ethereum/geth/chaindata cache=2.00GiB handles=524,288
INFO [08-22|18:42:30.455] Opened ancient database database=/root/.ethereum/geth/chaindata/ancient readonly=false
CRIT [08-22|18:42:30.457] Failed to store chain config err=“leveldb/table: corruption on data-block (pos=1500267): checksum mismatch, want=0x447e6e59 got=0x3906344c [file=176166.ldb]”

So what am I doing wrong? or is maybe my m2 ssd drive going bad already? Not sure what my next step is, prysm is working fine attesting like it should, and using infura until i get my geth node sorted out.

Well I tried openetherium and was not able to sync at all. My volume filled up less then a gig before it stopped working. I am normally a windows user and this is my first experience with linux, in over my head it seems. Why does eth1 no longer work on my node that had it working flawlessly for 3 months? Also during this time having trouble with Geth my prysm package is working fine, attesting like normal.

I am starting to learn towards the 2tb nvme m2 drive being the problem. Is there a way to do a disk check on it?

Maybe ill try buying a new drive and add it to the validator or replace and start from scratch.

Hi there!

First of all sorry for the delay

Are you still experiencing issues?

What is your dappnode setup? did you installed
it from scratch or is it purchased by dappnode?

It might be for many reasons, did you have enough free disk space on your dappnode before the issue start happening? power leaks? hardware issues?

Anyway you can always check the disk detected by your dappnode in the UI at the dashboard

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.