Dynamo K8s Example#

  1. Install Dynamo Cloud

Please followthis guideto install Dynamo cloud for your Kubernetes cluster.

  1. Deploy the TRT-LLM Deployment

Dynamo uses custom resource definitions (CRDs) to manage the lifecycle of thedeployments. You can use theDynamoDeploymentGraph yamlfiles to create aggregated, and disaggregated TRT-LLM deployments.

Please seeDeploying Dynamo Inference Graphs to Kubernetes using the DynamoCloud Platformfor more details.