# Run Ark on AWS To set up Ark on AWS, you: * Create your S3 bucket * Create an AWS IAM user for Ark * Configure the server * Create a Secret for your credentials If you do not have the `aws` CLI locally installed, follow the [user guide][5] to set it up. ## Create S3 bucket Heptio Ark requires an object storage bucket to store backups in, preferrably unique to a single Kubernetes cluster (see the [FAQ][20] for more details). Create an S3 bucket, replacing placeholders appropriately: ```bash aws s3api create-bucket \ --bucket \ --region \ --create-bucket-configuration LocationConstraint= ``` NOTE: us-east-1 does not support a `LocationConstraint`. If your region is `us-east-1`, omit the bucket configuration: ```bash aws s3api create-bucket \ --bucket \ --region us-east-1 ``` ## Create IAM user For more information, see [the AWS documentation on IAM users][14]. 1. Create the IAM user: ```bash aws iam create-user --user-name heptio-ark ``` > If you'll be using Ark to backup multiple clusters with multiple S3 buckets, it may be desirable to create a unique username per cluster rather than the default `heptio-ark`. 2. Attach policies to give `heptio-ark` the necessary permissions: ```bash BUCKET= cat > heptio-ark-policy.json <, "AccessKeyId": } } ``` 4. Create an Ark-specific credentials file (`credentials-ark`) in your local directory: ``` [default] aws_access_key_id= aws_secret_access_key= ``` where the access key id and secret are the values returned from the `create-access-key` request. ## Credentials and configuration In the Ark root directory, run the following to first set up namespaces, RBAC, and other scaffolding. To run in a custom namespace, make sure that you have edited the YAML files to specify the namespace. See [Run in custom namespace][0]. ```bash kubectl apply -f examples/common/00-prereqs.yaml ``` Create a Secret. In the directory of the credentials file you just created, run: ```bash kubectl create secret generic cloud-credentials \ --namespace \ --from-file cloud=credentials-ark ``` Specify the following values in the example files: * In `examples/aws/00-ark-config.yaml`: * Replace ``. See the [Config definition][6] for details. * In `examples/aws/05-ark-backupstoragelocation.yaml`: * Replace `` and `` (for S3 backup storage, region is optional and will be queried from the AWS S3 API if not provided). See the [BackupStorageLocation definition][21] for details. * (Optional) If you run the nginx example, in file `examples/nginx-app/with-pv.yaml`: * Replace `` with `gp2`. This is AWS's default `StorageClass` name. * (Optional) If you have multiple clusters and you want to support migration of resources between them, in file `examples/aws/10-deployment.yaml`: * Uncomment the environment variable `AWS_CLUSTER_NAME` and replace `` with the current cluster's name. When restoring backup, it will make Ark (and cluster it's running on) claim ownership of AWS volumes created from snapshots taken on different cluster. The best way to get the current cluster's name is to either check it with used deployment tool or to read it directly from the EC2 instances tags. The following listing shows how to get the cluster's nodes EC2 Tags. First, get the nodes external IDs (EC2 IDs): ```bash kubectl get nodes -o jsonpath='{.items[*].spec.externalID}' ``` Copy one of the returned IDs `` and use it with the `aws` CLI tool to search for one of the following: * The `kubernetes.io/cluster/` tag of the value `owned`. The `` is then your cluster's name: ```bash aws ec2 describe-tags --filters "Name=resource-id,Values=" "Name=value,Values=owned" ``` * If the first output returns nothing, then check for the legacy Tag `KubernetesCluster` of the value ``: ```bash aws ec2 describe-tags --filters "Name=resource-id,Values=" "Name=key,Values=KubernetesCluster" ``` ## Start the server In the root of your Ark directory, run: ```bash kubectl apply -f examples/aws/00-ark-config.yaml kubectl apply -f examples/aws/10-deployment.yaml ``` ## ALTERNATIVE: Setup permissions using kube2iam [Kube2iam](https://github.com/jtblin/kube2iam) is a Kubernetes application that allows managing AWS IAM permissions for pod via annotations rather than operating on API keys. > This path assumes you have `kube2iam` already running in your Kubernetes cluster. If that is not the case, please install it first, following the docs here: https://github.com/jtblin/kube2iam It can be set up for Ark by creating a role that will have required permissions, and later by adding the permissions annotation on the ark deployment to define which role it should use internally. 1. Create a Trust Policy document to allow the role being used for EC2 management & assume kube2iam role: ```bash cat > heptio-ark-trust-policy.json <:role/" }, "Action": "sts:AssumeRole" } ] } EOF ``` 2. Create the IAM role: ```bash aws iam create-role --role-name heptio-ark --assume-role-policy-document file://./heptio-ark-trust-policy.json ``` 3. Attach policies to give `heptio-ark` the necessary permissions: ```bash BUCKET= cat > heptio-ark-policy.json <:role/heptio-ark ... ``` 5. Run Ark deployment using the file `examples/aws/10-deployment-kube2iam.yaml`. [0]: namespace.md [5]: https://docs.aws.amazon.com/cli/latest/userguide/cli-chap-welcome.html [6]: config-definition.md#aws [14]: http://docs.aws.amazon.com/IAM/latest/UserGuide/introduction.html [20]: faq.md [21]: backupstoragelocation-definition.md#aws