***Note:** access to the Codefresh CLI is only needed once during the Runner installation. After that, the Runner will authenticate on it own using the details provided. You do NOT need to install the Codefresh CLI on the cluster that is running Codefresh pipelines.*

Then run the wizard with the following command

Then run the wizard with the following command:

You can use[this example](https://github.com/codefresh-io/venona/blob/release-1.0/venonactl/example/values-example.yaml) as a starting point for your values file.

If you want to see what manifests are used by the installation wizard you can supply the`--dry-run` parameter in the installation process.

codefresh attach runtime --agent-name $AGENT_NAME --agent-kube-namespace codefresh-agent --runtime-name $RUNTIME_NAME --runtime-kube-namespace codefresh-runtime-2 --restart-agent

Under`dockerDaemonScheduler.pvcs.dind` block specify`reuseVolumeSelector`:

{% highlight yaml %}

{% raw %}

pvcs:

dind:

volumeSize: 30Gi

reuseVolumeSelector: 'codefresh-app,io.codefresh.accountName,pipeline_id'

{% endraw %}

{% endhighlight %}

codefresh patch re -f runtime.yaml

You can add your own environment variables in the runtime environment, so that all pipeline steps have access to the same set of external files. A typical

example would be a shared secret that you want to pass everywhere.

You can add your own volume mounts in the runtime environment, so that all pipeline steps have access to the same set of external files. A typical

example of this scenario is when you want to make a set of SSL certificates available to all your pipelines. Rather than manually

You can configure your Codefresh Runner to use an internal registry as a mirror for any container images that are mentioned in your pipelines.

See below is a content of cluster.yaml file. We define separate node pools for dind, engine and other services(like runner, cluster-autoscaler etc).

- Copy the Bearer Token field (combines Access Key and Secret Key)

- Edit your kubeconfig and put the Bearer Token you copied in the`token` field of your user

If you've created your kubeconfig from the Rancher UI, then it will contain an API endpoint that is not reachable internally, from within the cluster. To work around this, we need to tell the runner to instead use Kubernetes' generic internal API endpoint. Also, if you didn't create a Codefresh user in step 2 and your kubeconfig contains your personal user account, then you should also add the`--skip-cluster-integration` option.

Regarding[Regional Persistent Disks](https://cloud.google.com/kubernetes-engine/docs/how-to/persistent-volumes/regional-pd), their support is not currently implemented in the Codefresh runner.

- Codefresh pipelines require disk space for:

-[Pipeline Shared Volume](https://codefresh.io/docs/docs/yaml-examples/examples/shared-volumes-between-builds/) (`/codefresh/volume`, implemented as[docker volume](https://docs.docker.com/storage/volumes/))

- Docker containers - running and stopped

- Docker images and cached layers

- To improve performance,`volume-provisioner` is able to provision previously used disk with docker images and pipeline volume from previously running builds. It improves performance by using docker cache and decreasing I/O rate.

- Least recently docker images and volumes should be cleaned to avoid out-of-space errors.

- There are several places where pipeline volume cleanup is required, so there are several kinds of cleaner.

-[IN-DIND cleaner](https://github.com/codefresh-io/dind/tree/master/cleaner) - deletes extra docker containers, volumes, images in**dind pod**

-[External volumes cleaner](https://github.com/codefresh-io/runtime-cluster-monitor/blob/master/chart/templates/dind-volume-cleanup.yaml) - deletes unused**external** PVs (EBS, GCE/Azure disks)

-[Local volumes cleaner](https://github.com/codefresh-io/dind-volume-utils/blob/master/local-volumes/lv-cleaner.sh) - deletes**local** volumes in case node disk space is close to the threshold

**Purpose:** Removes unneeded*docker containers, images, volumes* inside kubernetes volume mounted to the dind pod

**Where it runs:** Running inside each dind pod as script

**Triggered by:** SIGTERM and also during the run when disk usage (cleaner-agent ) > 90% (configurable)

**Configured by:** Environment Variables which can be set in Runtime Environment configuration

**Configuration/Logic:**[README.md](https://github.com/codefresh-io/dind/tree/master/cleaner#readme)

Override`dockerDaemonScheduler.envVars` on Runtime Environment if necessary (the following are**defaults**):

{% highlight yaml %}

{% raw %}

dockerDaemonScheduler:

envVars:

CLEAN_DOCKER: 'true'

CLEAN_PERIOD_BUILDS: '5'

IMAGE_RETAIN_PERIOD: '14400'

VOLUMES_RETAIN_PERIOD: '14400'

{% endraw %}

{% endhighlight %}

**Purpose:** Removes unused*kubernetes volumes and related backend volumes*

**Where it runs:** On Runtime Cluster as CronJob

(`kubectl get cronjobs -n codefresh -l app=dind-volume-cleanup`). Installed in case the Runner uses non-local volumes (`Storage.Backend != local`)

**Triggered by:** CronJob every 10min (configurable), part of[runtime-cluster-monitor](https://github.com/codefresh-io/runtime-cluster-monitor/blob/master/chart/templates/dind-volume-cleanup.yaml) and runner deployment

**Configuration:**

Set`codefresh.io/volume-retention` annotation on Runtime Environment:

{% highlight yaml %}

{% raw %}

dockerDaemonScheduler:

pvcs:

dind:

storageClassName: dind-ebs-volumes-runner-codefresh

reuseVolumeSelector: 'codefresh-app,io.codefresh.accountName,pipeline_id'

volumeSize: 32Gi

annotations:

codefresh.io/volume-retention: 7d

{% endraw %}

{% endhighlight %}

Override environment variables for`dind-volume-cleanup` cronjob if necessary:

-`RETENTION_DAYS` (defaults to 4)

-`MOUNT_MIN` (defaults to 3)

-`PROVISIONED_BY` (defaults to`codefresh.io/dind-volume-provisioner`)

About*optional*`-m` argument:

-`dind-volume-cleanup` to clean volumes that were last used more than`RETENTION_DAYS` ago

-`dind-volume-cleanup-m` to clean volumes that were used more than a day ago, but mounted less than`MOUNT_MIN` times

**Purpose:** Deletes local volumes in case node disk space is close to the threshold

**Where it runs:** On each node on runtime cluster as DaemonSet`dind-lv-monitor`. Installed in case the Runner use local volumes (`Storage.Backend == local`)

**Triggered by:** Starts clean if disk space usage or inodes usage is more than thresholds (configurable)

**Configuration:**

Override environment variables for`dind-lv-monitor` daemonset if necessary:

-`VOLUME_PARENT_DIR` - default`/var/lib/codefresh/dind-volumes`

-`KB_USAGE_THRESHOLD` - default 80 (percentage)

-`INODE_USAGE_THRESHOLD` - default 80