Repository to enable research flows

A high-throughput and memory-efficient inference and serving engine for LLMs

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.

A framework for few-shot evaluation of language models.

TPU inference for vLLM, with unified JAX and PyTorch support.

Go ahead and axolotl questions

A high-throughput and memory-efficient inference and serving engine for LLMs