CUDA Kernel Benchmarking Library

Build and run containers leveraging NVIDIA GPUs

Sample Dockerfiles for Docker Hub images

RAPIDS Accelerator JNI For Apache Spark

KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale

NVIDIA cuOpt is an open-source GPU-accelerated optimization engine delivering near real-time solutions for complex decision-making challenges.

CUDA Core Compute Libraries

NVIDIA DRA Driver for GPUs

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in performant way.

CloudAI Benchmark Framework