Run a cluster with others
Charon is in an early alpha state and is not ready to be run on mainnet
To create a distributed validator cluster with a group of other node operators requires five key steps:
- Every operator prepares their software and gets their charon client's ENR
- One operator prepares the terms of the distributed validator key generation ceremony
- They select the network, the withdrawal address, the number of 32 ether distributed validators to create, and the ENRs of each operator taking part in the ceremony.
- In future, the DV launchpad will facilitate this process more seamlessly, with consent on the terms provided by all operators that participate.
- Every operator participates in the DKG ceremony, and once successful, a number of cluster artifacts are created, including:
- The private key shares for each distributed validator
- The deposit data file containing deposit details for each distributed validator
cluster-lock.jsonfile which contains the finalised terms of this cluster required by charon to operate.
- Every operator starts their node with
charon run, and uses their monitoring to determine the cluster health and connectivity
- Once the cluster is confirmed to be healthy, deposit data files created during this process are activated on the staking launchpad.
Getting started with Charon
Clone the charon-distributed-validator-node template repository from Github, and
cdinto the directory.
# Clone the repo
git clone https://github.com/ObolNetwork/charon-distributed-validator-node.git
# Change directory
Next create a private key for charon to use for its ENR
# Create an ENR private key
docker run --rm -v "$(pwd):/opt/charon" obolnetwork/charon:v0.9.0 create enr
This command will print your charon client's ENR to the console. It should look something like:
Created ENR private key: .charon/charon-enr-private-key
The ability to replace a deleted or compromised private key is limited at this point. Please make a secure backup of this private key if this distributed validator is important to you.
This record identifies your charon client no matter where it communicates from across the internet. It is required for the following step of creating a set of distributed validator private key shares amongst the cluster operators.
Please make sure to make a backup of the private key at .charon/charon-enr-private-key. Be careful not to commit it to git! If you lose this file you won't be able to take part in the DKG ceremony.
If you are taking part in an organised Obol testnet, submit the created ENR public address (the console output starting with and including
enr:-, not the contents of the private key file) to the appropriate typeform.
Performing a Distributed Validator Key Generation Ceremony
To create the private keys for a distributed validator securely, a Distributed Key Generation (DKG) process must take place.
After gathering each operators ENR and setting them in the
.envfile, one operator should prepare the ceremony with
charon create dkg
# First set the ENRs of all the operators participating in DKG ceremony in .env file as CHARON_OPERATOR_ENRS
# Create .charon/cluster-definition.json to participate in DKG ceremony
docker run --rm -v "$(pwd):/opt/charon" --env-file .env obolnetwork/charon:v0.9.0 create dkg
The operator that ran this command should distribute the resulting
cluster-definition.jsonfile to each operator.
At a pre-agreed time, all operators run the ceremony program with the
# Copy the cluster-definition.json file to .charon
cp cluster-definition.json .charon/
# Participate in DKG ceremony, this will create .charon/cluster-lock.json, .charon/deposit-data.json and .charon/validator_keys/
docker run --rm -v "$(pwd):/opt/charon" obolnetwork/charon:v0.9.0 dkg
Verifying cluster health
Once the key generation ceremony has been completed, the charon nodes have the data they need to come together to form a cluster.
First you must prepare the required environment variables, in particular you need to set the
CHARON_BEACON_NODE_ENDPOINTvariable to point at either a local or remote beacon node API endpoint.
# Copy the sample environment variables
cp .env.sample .env
For simplicities sake, this repo is configured to work with a remote Beacon node such as one from Infura.
Create an Eth2 project and copy the
httpsURL for the network you want to use (this repo expects
Replace the placeholder value of
CHARON_BEACON_NODE_ENDPOINTin your newly created
.envfile with this URL.
Start your distributed validator node with docker-compose
# Run a charon client, a vc client, and prom+grafana clients as containers
Use the pre-prepared grafana dashboard to verify the cluster health looks okay. You should see connections with all other operators in the cluster as healthy, and observed ping times under 1 second for all connections.
# Open Grafana
If Grafana doesn't load any data the first time you open it, check this method for fixing the issue.
Activating the distributed validator
Once the cluster is healthy and fully connected, it is time to deposit the required 32 (test) ether to activate the newly created Distributed Validator.
- Activate the validator on the testnet using the original staking launchpad site with the deposit data created at
- If you use Mac OS,
.charonthe default output folder, does not show up on the launchpad's "Upload Deposit Data" file picker. Rectify this by pressing
Command + Shift + .(full stop). This should display hidden folders, allowing you to select the deposit file.
- A more distributed validator friendly deposit interface is in the works for an upcoming release.
- If you use Mac OS,
- This process takes approximately 16 hours for the deposit to be registered on the beacon chain. Future upgrades to the protocol aims to reduce this time.
- Once the validator deposit is recognised on the beacon chain, the validator is assigned an index, and the wait for activation begins.
- Finally, once the validator is activated, it should be monitored for to ensure it is achieving an inclusion distance of near 0, to ensure optimal rewards. You should also tweet the link to your newly activated validator with the hashtag #RunDVT 🙃
Don't forget to be a good testnet steward and exit your validator when you are finished testing with it.