backup-operator.md

etcd backup operator

Overview

etcd backup operator backs up the data of a etcd cluster running on Kubernetes to a remote storage such as AWS S3.

Getting Started

Try out etcd backup operator by running it on Kubernetes and then create a EtcdBackup Custom Resource which contains the targeting etcd cluster and S3 backup config; the etcd backup operator automatically picks up the EtcdBackup Custom Resource, retrieves etcd snapshot, and then saves it to S3.

Note: The demo uses the default namespace.

Prerequisites:

• Setup RBAC and deploy an etcd operator. See Install Guide
• A running etcd cluster named example-etcd-cluster. See instructions to deploy it.

Deploy etcd backup operator

Create a deployment of etcd backup operator:

Note: etcd backup operator creates EtcdBackup CRD automatically

$ kubectl create -f example/etcd-backup-operator/deployment.yaml
$ kubectl get pod
NAME                                    READY     STATUS    RESTARTS   AGE
etcd-backup-operator-1102130733-hhgt7   1/1       Running   0          3s

Verify that the etcd-backup-operator creates EtcdBackup CRD:

$ kubectl get crd
NAME                                    KIND
etcdbackups.etcd.database.coreos.com    CustomResourceDefinition.v1beta1.apiextensions.k8s.io

Setup AWS Secret

Create a Kubernetes secret that contains aws config/credential; the secret will be used later to save etcd backup into S3.

1. Verify that the local aws config and credentials files exist:

   $ cat $AWS_DIR/credentials
   [default]
   aws_access_key_id = XXX
   aws_secret_access_key = XXX
   
   $ cat $AWS_DIR/config
   [default]
   region = <region>

2. Create secret aws:

   kubectl create secret generic aws --from-file=$AWS_DIR/credentials --from-file=$AWS_DIR/config
   

Create EtcdBackup CR

Create EtcdBackup CR:

Note: this example uses S3 Bucket "mybucket" and k8s secret "aws"

sed -e 's|<full-s3-path>|mybucket/etcd.backup|g' \
    -e 's|<aws-secret>|aws|g' \
    -e 's|<etcd-cluster-endpoints>|"http://example-etcd-cluster-client:2379"|g' \
    example/etcd-backup-operator/backup_cr.yaml \
    | kubectl create -f -

Verify status

Check the status section of the EtcdBackup CR:

$ kubectl get EtcdBackup example-etcd-cluster-backup -o yaml
apiVersion: etcd.database.coreos.com/v1beta2
kind: EtcdBackup
...
status:
  etcdRevision: 1
  etcdVersion: 3.2.13
  succeeded: true

This demonstrates etcd backup operator's basic one time backup functionality.

Cleanup

Delete the etcd-backup-operator deployment and the EtcdBackup CR.

Note: Deleting the EtcdBackup CR won't delete the backup in S3.

kubectl delete etcdbackup example-etcd-cluster-backup
kubectl delete -f example/etcd-backup-operator/deployment.yaml