Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

• UpdatedMar 18, 2025
• Go

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

• UpdatedMar 17, 2025
• Python

Finetune Llama 3.3, DeepSeek-R1, Gemma 3 & Reasoning LLMs 2x faster with 70% less memory! 🦥

• UpdatedMar 18, 2025
• Python

🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

• UpdatedMar 17, 2025
• Go

Low-code framework for building custom LLMs, neural networks, and other AI models

• UpdatedMar 3, 2025
• Python

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

• UpdatedMar 17, 2025
• Python

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

• UpdatedMar 17, 2025
• Python

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

• UpdatedMar 17, 2025
• C++

Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

• UpdatedOct 24, 2024
• Python

AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.

• UpdatedMar 17, 2025
• TypeScript

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

• UpdatedJan 27, 2025
• Swift

Efficient Triton Kernels for LLM Training

• UpdatedMar 17, 2025
• Python

🧑‍🚀 全世界最好的LLM资料总结（数据处理、模型训练、模型部署、o1 模型、小语言模型、视觉语言模型） | Summary of the world's best LLM resources.

• UpdatedMar 15, 2025

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including OpenAI Agents SDK, CrewAI, Langchain, Autogen, AG2, and CamelAI

• UpdatedMar 17, 2025
• Python

An automated document analyzer for Paperless-ngx using OpenAI API, Ollama, Deepseek-r1, Azure and all OpenAI API compatible Services to automatically analyze and tag your documents.

• UpdatedMar 9, 2025
• JavaScript

Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community:https://discord.gg/TgHXuSJEk6

• UpdatedSep 23, 2024
• Python

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

• UpdatedJan 7, 2025
• Rust

A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.

• UpdatedOct 10, 2024
• Python

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK.

• UpdatedMar 16, 2025
• C++

Instant, controllable, local pre-trained AI models in Rust

• UpdatedMar 17, 2025
• Rust