Ongoing research training transformer models at scale

GPU accelerated decision optimization

GPU Memory Reservation Library

CUDA Core Compute Libraries

JAX-Toolbox

NVSentinel is a cross-platform fault remediation service designed to rapidly remediate runtime node-level issues in GPU-accelerated computing environments

C++ and Python support for the CUDA Quantum programming model for heterogeneous quantum-classical workflows

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

The NVIDIA NeMo Agent toolkit is an open-source library for efficiently connecting and optimizing teams of AI agents.

RAPIDS Accelerator JNI For Apache Spark