Solo
Toggle Dark/Light/Auto mode Toggle Dark/Light/Auto mode Toggle Dark/Light/Auto mode Back to homepage

Step by Step Guide

Advanced User Guide

For those who would like to have more control or need some customized setups, here are some step by step instructions of how to setup and deploy a solo network.

Setup Kubernetes cluster

Remote cluster

  • You may use remote kubernetes cluster. In this case, ensure kubernetes context is set up correctly.
kubectl config use-context <context-name>

Local cluster

  • You may use kind or microk8s to create a cluster. In this case, ensure your Docker engine has enough resources (e.g. Memory >=8Gb, CPU: >=4). Below we show how you can use kind to create a cluster

First, use the following command to set up the environment variables:

export SOLO_CLUSTER_NAME=solo
export SOLO_NAMESPACE=solo
export SOLO_CLUSTER_SETUP_NAMESPACE=solo-cluster

Then run the following command to set the kubectl context to the new cluster:

kind create cluster -n "${SOLO_CLUSTER_NAME}"

Example output

Creating cluster "solo" ...
 βœ“ Ensuring node image (kindest/node:v1.29.1) πŸ–Ό
 βœ“ Preparing nodes πŸ“¦ 
 βœ“ Writing configuration πŸ“œ
 βœ“ Starting control-plane πŸ•ΉοΈ
 βœ“ Installing CNI πŸ”Œ
 βœ“ Installing StorageClass πŸ’Ύ
Set kubectl context to "kind-solo"
You can now use your cluster with:

kubectl cluster-info --context kind-solo

Thanks for using kind! 😊

You may now view pods in your cluster using k9s -A as below:

 Context: kind-solo                                <0> all   <a>       Attach       <ctr… ____  __.________
 Cluster: kind-solo                                          <ctrl-d>  Delete       <l>  |    |/ _/   __   \______
 User:    kind-solo                                          <d>       Describe     <p>  |      < \____    /  ___/
 K9s Rev: v0.32.5                                            <e>       Edit         <shif|    |  \   /    /\___ \
 K8s Rev: v1.27.3                                            <?>       Help         <z>  |____|__ \ /____//____  >
 CPU:     n/a                                                <shift-j> Jump Owner   <s>          \/            \/
 MEM:     n/a
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€ Pods(all)[11] ─────────────────────────────────────────────────┐
β”‚ NAMESPACE↑          NAME                                        PF READY STATUS   RESTARTS IP          NODE     β”‚
β”‚ solo-setup     console-557956d575-4r5xm                    ●  1/1   Running         0 10.244.0.5  solo-con β”‚
β”‚ solo-setup     minio-operator-7d575c5f84-8shc9             ●  1/1   Running         0 10.244.0.6  solo-con β”‚
β”‚ kube-system         coredns-5d78c9869d-6cfbg                    ●  1/1   Running         0 10.244.0.4  solo-con β”‚
β”‚ kube-system         coredns-5d78c9869d-gxcjz                    ●  1/1   Running         0 10.244.0.3  solo-con β”‚
β”‚ kube-system         etcd-solo-control-plane                     ●  1/1   Running         0 172.18.0.2  solo-con β”‚
β”‚ kube-system         kindnet-k75z6                               ●  1/1   Running         0 172.18.0.2  solo-con β”‚
β”‚ kube-system         kube-apiserver-solo-control-plane           ●  1/1   Running         0 172.18.0.2  solo-con β”‚
β”‚ kube-system         kube-controller-manager-solo-control-plane  ●  1/1   Running         0 172.18.0.2  solo-con β”‚
β”‚ kube-system         kube-proxy-cct7t                            ●  1/1   Running         0 172.18.0.2  solo-con β”‚
β”‚ kube-system         kube-scheduler-solo-control-plane           ●  1/1   Running         0 172.18.0.2  solo-con β”‚
β”‚ local-path-storage  local-path-provisioner-6bc4bddd6b-gwdp6     ●  1/1   Running         0 10.244.0.2  solo-con β”‚
β”‚                                                                                                                 β”‚
β”‚                                                                                                                 β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Step by Step Instructions

  • Initialize solo directories:
# reset .solo directory
rm -rf ~/.solo

solo init
  • Example output

******************************* Solo *********************************************
Version			: 0.33.0
Kubernetes Context	: kind-solo
Kubernetes Cluster	: kind-solo
**********************************************************************************
βœ” Setup home directory and cache
βœ” Check dependency: helm [OS: linux, Release: 5.15.0-125-generic, Arch: x64]
βœ” Check dependencies
βœ” Setup chart manager

***************************************************************************************
Note: solo stores various artifacts (config, logs, keys etc.) in its home directory: /home/runner/.solo
If a full reset is needed, delete the directory or relevant sub-directories before running 'solo init'.
***************************************************************************************
βœ” Copy templates in '/home/runner/.solo/cache'
  • Generate pem formatted node keys
solo node keys --gossip-keys --tls-keys -i node1,node2,node3
  • Example output

******************************* Solo *********************************************
Version			: 0.33.0
Kubernetes Context	: kind-solo
Kubernetes Cluster	: kind-solo
**********************************************************************************
βœ” Initialize
βœ” Backup old files
βœ” Gossip key for node: node1
βœ” Gossip key for node: node2
βœ” Gossip key for node: node3
βœ” Generate gossip keys
βœ” Backup old files
βœ” TLS key for node: node3
βœ” TLS key for node: node2
βœ” TLS key for node: node1
βœ” Generate gRPC TLS Keys
βœ” Finalize

PEM key files are generated in ~/.solo/keys directory.

hedera-node1.crt    hedera-node3.crt    s-private-node1.pem s-public-node1.pem  unused-gossip-pem
hedera-node1.key    hedera-node3.key    s-private-node2.pem s-public-node2.pem  unused-tls
hedera-node2.crt    hedera-node4.crt    s-private-node3.pem s-public-node3.pem
hedera-node2.key    hedera-node4.key    s-private-node4.pem s-public-node4.pem
  • Setup cluster with shared components
solo cluster setup -s "${SOLO_CLUSTER_SETUP_NAMESPACE}"
  • Example output

******************************* Solo *********************************************
Version			: 0.33.0
Kubernetes Context	: kind-solo
Kubernetes Cluster	: kind-solo
**********************************************************************************
βœ” Initialize
βœ” Prepare chart values
βœ” Install 'solo-cluster-setup' chart

In a separate terminal, you may run k9s to view the pod status.

  • Deploy helm chart with Hedera network components

It may take a while (5~15 minutes depending on your internet speed) to download various docker images and get the pods started.

If it fails, ensure you have enough resources allocated for Docker engine and retry the command.

solo network deploy -i node1,node2,node3 -n "${SOLO_NAMESPACE}"
  • Example output

******************************* Solo *********************************************
Version			: 0.33.0
Kubernetes Context	: kind-solo
Kubernetes Cluster	: kind-solo
Kubernetes Namespace	: solo
**********************************************************************************
βœ” Acquire lease - lease acquired successfully, attempt: 1/10
βœ” Initialize
βœ” Load remote config - remote config not found
βœ” Check if cluster setup chart is installed
βœ” Copy Gossip keys to staging
βœ” Copy gRPC TLS keys to staging
βœ” Prepare staging directory
βœ” Copy Gossip keys
βœ” Node: node2
βœ” Copy TLS keys
βœ” Copy Gossip keys
βœ” Node: node3
βœ” Copy Gossip keys
βœ” Node: node1
βœ” Copy node keys to secrets
βœ” Install chart 'solo-deployment'
βœ” Check Node: node1
βœ” Check Node: node2
βœ” Check Node: node3
βœ” Check node pods are running
βœ” Check Envoy Proxy for: node1
βœ” Check Envoy Proxy for: node2
βœ” Check HAProxy for: node1
βœ” Check Envoy Proxy for: node3
βœ” Check HAProxy for: node2
βœ” Check HAProxy for: node3
βœ” Check proxy pods are running
βœ” Check MinIO
βœ” Check auxiliary pods are ready
  • Setup node with Hedera platform software.
solo node setup -i node1,node2,node3 -n "${SOLO_NAMESPACE}"
  • Example output

******************************* Solo *********************************************
Version			: 0.33.0
Kubernetes Context	: kind-solo
Kubernetes Cluster	: kind-solo
Kubernetes Namespace	: solo
**********************************************************************************
βœ” Acquire lease - lease acquired successfully, attempt: 1/10
βœ” Initialize
βœ” Load remote config - remote config not found
βœ” Check network pod: node1
βœ” Check network pod: node2
βœ” Check network pod: node3
βœ” Identify network pods
βœ” Update node: node2 [ platformVersion = v0.58.3 ]
βœ” Update node: node3 [ platformVersion = v0.58.3 ]
βœ” Update node: node1 [ platformVersion = v0.58.3 ]
βœ” Fetch platform software into network nodes
βœ” Copy configuration files
βœ” Copy configuration files
βœ” Copy configuration files
βœ” Set file permissions
βœ” Node: node1
βœ” Set file permissions
βœ” Node: node3
βœ” Set file permissions
βœ” Node: node2
βœ” Setup network nodes
  • Start the nodes
solo node start -i node1,node2,node3 -n "${SOLO_NAMESPACE}"
  • Example output

******************************* Solo *********************************************
Version			: 0.33.0
Kubernetes Context	: kind-solo
Kubernetes Cluster	: kind-solo
Kubernetes Namespace	: solo
**********************************************************************************
βœ” Acquire lease - lease acquired successfully, attempt: 1/10
βœ” Initialize
βœ” Load remote config - remote config not found
βœ” Check network pod: node3
βœ” Check network pod: node1
βœ” Check network pod: node2
βœ” Identify existing network nodes
βœ” Start node: node1
βœ” Start node: node3
βœ” Start node: node2
βœ” Starting nodes
βœ” Check network pod: node2  - status ACTIVE, attempt: 18/120
βœ” Check network pod: node1  - status ACTIVE, attempt: 18/120
βœ” Check network pod: node3  - status ACTIVE, attempt: 18/120
βœ” Check all nodes are ACTIVE
βœ” Check proxy for node: node1
βœ” Check proxy for node: node2
βœ” Check proxy for node: node3
βœ” Check node proxies are ACTIVE
βœ” Adding stake for node: node1
βœ” Adding stake for node: node2
βœ” Adding stake for node: node3
βœ” Add node stakes
  • Deploy mirror node
solo mirror-node deploy -n "${SOLO_NAMESPACE}"
  • Example output

******************************* Solo *********************************************
Version			: 0.33.0
Kubernetes Context	: kind-solo
Kubernetes Cluster	: kind-solo
Kubernetes Namespace	: solo
**********************************************************************************
βœ” Acquire lease - lease acquired successfully, attempt: 1/10
βœ” Initialize
βœ” Load remote config - remote config not found
βœ” Prepare address book
βœ” Deploy mirror-node
βœ” Deploy hedera-explorer
βœ” Enable mirror-node
βœ” Check Hedera Explorer
βœ” Check Postgres DB
βœ” Check REST API
βœ” Check GRPC
βœ” Check Importer
βœ” Check Monitor
βœ” Check pods are ready
βœ” Insert data in public.file_data
βœ” Seed DB data
  • Deploy a JSON RPC relay
solo relay deploy -i node1 -n "${SOLO_NAMESPACE}"
  • Example output

******************************* Solo *********************************************
Version			: 0.33.0
Kubernetes Context	: kind-solo
Kubernetes Cluster	: kind-solo
Kubernetes Namespace	: solo
**********************************************************************************
βœ” Acquire lease - lease acquired successfully, attempt: 1/10
βœ” Initialize
βœ” Load remote config - remote config not found
βœ” Prepare chart values
βœ” Deploy JSON RPC Relay
βœ” Check relay is ready

You may view the list of pods using k9s as below:

Context: kind-solo                                <0> all   <a>       Attach       <ctr… ____  __.________
 Cluster: kind-solo                                          <ctrl-d>  Delete       <l>  |    |/ _/   __   \______
 User:    kind-solo                                          <d>       Describe     <p>  |      < \____    /  ___/
 K9s Rev: v0.32.5                                            <e>       Edit         <shif|    |  \   /    /\___ \
 K8s Rev: v1.27.3                                            <?>       Help         <z>  |____|__ \ /____//____  >
 CPU:     n/a                                                <shift-j> Jump Owner   <s>          \/            \/
 MEM:     n/a
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€ Pods(all)[31] ─────────────────────────────────────────────────┐
β”‚ NAMESPACE↑          NAME                                                           PF READY STATUS   RESTARTS I β”‚
β”‚ kube-system         coredns-5d78c9869d-994t4                                       ●  1/1   Running         0 1 β”‚
β”‚ kube-system         coredns-5d78c9869d-vgt4q                                       ●  1/1   Running         0 1 β”‚
β”‚ kube-system         etcd-solo-control-plane                                        ●  1/1   Running         0 1 β”‚
β”‚ kube-system         kindnet-q26c9                                                  ●  1/1   Running         0 1 β”‚
β”‚ kube-system         kube-apiserver-solo-control-plane                              ●  1/1   Running         0 1 β”‚
β”‚ kube-system         kube-controller-manager-solo-control-plane                     ●  1/1   Running         0 1 β”‚
β”‚ kube-system         kube-proxy-9b27j                                               ●  1/1   Running         0 1 β”‚
β”‚ kube-system         kube-scheduler-solo-control-plane                              ●  1/1   Running         0 1 β”‚
β”‚ local-path-storage  local-path-provisioner-6bc4bddd6b-4mv8c                        ●  1/1   Running         0 1 β”‚
β”‚ solo                envoy-proxy-node1-65f8879dcc-rwg97                             ●  1/1   Running         0 1 β”‚
β”‚ solo                envoy-proxy-node2-667f848689-628cx                             ●  1/1   Running         0 1 β”‚
β”‚ solo                envoy-proxy-node3-6bb4b4cbdf-dmwtr                             ●  1/1   Running         0 1 β”‚
β”‚ solo                solo-deployment-grpc-75bb9c6c55-l7kvt                     ●  1/1   Running         0 1 β”‚
β”‚ solo                solo-deployment-hedera-explorer-6565ccb4cb-9dbw2          ●  1/1   Running         0 1 β”‚
β”‚ solo                solo-deployment-importer-dd74fd466-vs4mb                  ●  1/1   Running         0 1 β”‚
β”‚ solo                solo-deployment-monitor-54b8f57db9-fn5qq                  ●  1/1   Running         0 1 β”‚
β”‚ solo                solo-deployment-postgres-postgresql-0                     ●  1/1   Running         0 1 β”‚
β”‚ solo                solo-deployment-redis-node-0                              ●  2/2   Running         0 1 β”‚
β”‚ solo                solo-deployment-rest-6d48f8dbfc-plbp2                     ●  1/1   Running         0 1 β”‚
β”‚ solo                solo-deployment-restjava-5d6c4cb648-r597f                 ●  1/1   Running         0 1 β”‚
β”‚ solo                solo-deployment-web3-55fdfbc7f7-lzhfl                     ●  1/1   Running         0 1 β”‚
β”‚ solo                haproxy-node1-785b9b6f9b-676mr                                 ●  1/1   Running         1 1 β”‚
β”‚ solo                haproxy-node2-644b8c76d-v9mg6                                  ●  1/1   Running         1 1 β”‚
β”‚ solo                haproxy-node3-fbffdb64-272t2                                   ●  1/1   Running         1 1 β”‚
β”‚ solo                minio-pool-1-0                                                 ●  2/2   Running         1 1 β”‚
β”‚ solo                network-node1-0                                                ●  5/5   Running         2 1 β”‚
β”‚ solo                network-node2-0                                                ●  5/5   Running         2 1 β”‚
β”‚ solo                network-node3-0                                                ●  5/5   Running         2 1 β”‚
β”‚ solo                relay-node1-node2-node3-hedera-json-rpc-relay-ddd4c8d8b-hdlpb  ●  1/1   Running         0 1 β”‚
β”‚ solo-cluster        console-557956d575-c5qp7                                       ●  1/1   Running         0 1 β”‚
β”‚ solo-cluster        minio-operator-7d575c5f84-xdwwz                                ●  1/1   Running         0 1 β”‚
β”‚                                                                                                                 β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜