mistral

🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

api kubernetes ai text-generation distributed tts image-generation llama mamba libp2p gemma mistral audio-generation llm stable-diffusion rwkv gpt4all musicgen rerank llama3

UpdatedMay 4, 2025
Go

ludwig-ai /ludwig

Star11.4k

Low-code framework for building custom LLMs, neural networks, and other AI models

learning data-science machine-learning natural-language-processing computer-vision deep-learning neural-network natural-language ml deep pytorch machinelearning llama deeplearning mistral fine-tuning data-centric llm llm-training llama2

UpdatedApr 28, 2025
Python

bentoml /OpenLLM

Star11.2k

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

llama mistral fine-tuning mlops bentoml vicuna llm model-inference llmops llm-serving llm-inference open-source-llm llama2 openllm llm-ops llama3-1 llama3-2 llama3-2-vision

UpdatedApr 28, 2025
Python

xorbitsai /inference

Star7.7k

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

machine-learning deployment inference pytorch artificial-intelligence llama whisper gemma mistral openai-api llm flan-t5 chatglm llamacpp vllm ggml wizardlm qwen llama3 glm4

UpdatedMay 3, 2025
Python

LostRuins /koboldcpp

Star7.2k

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

llama language-model gemma mistral koboldai llm llamacpp ggml koboldcpp gguf

UpdatedMay 3, 2025
C++

enricoros /big-AGI

Sponsor

Star6.4k

AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.

ui beam agi openai gpt mistral multimodal groq openai-api gpt-4 large-language-models stable-diffusion generative-ai chatgpt chatgpt-ui gpt-5 anthropic

UpdatedMay 4, 2025
TypeScript

yangjianxin1 /Firefly

Star6.4k

Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

llama gpt lora gemma alpaca zephyr mistral peft aquila baichuan llm chatglm qlora internlm llama2 qwen mixtral minicpm qwen2 llama3

UpdatedOct 24, 2024
Python

gluonfield /enchanted

Star5.3k

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

swift ios llama mistral llm large-language-model llama2 ollama ollama-app

UpdatedMar 19, 2025
Swift

linkedin /Liger-Kernel

Star5k

Efficient Triton Kernels for LLM Training

triton llama mistral finetuning llms llm-training llama3 phi3 gemma2 triton-kernels

UpdatedMay 3, 2025
Python

WangRongsheng /awesome-LLM-resourses

Star4.9k

🧑‍🚀 全世界最好的LLM资料总结（数据处理、模型训练、模型部署、o1 模型、MCP、小语言模型、视觉语言模型） | Summary of the world's best LLM resources.

course book openai awesome-list webui llama mistral rag large-language-models llm retrieval-augmented-generation qwen

UpdatedMay 4, 2025

AgentOps-AI /agentops

Star4.3k

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including OpenAI Agents SDK, CrewAI, Langchain, Autogen, AG2, and CamelAI

agent ai openai evaluation-metrics mistral cost-estimation autogen groq agentops llm langchain anthropic evals ollama crewai agents-sdk openai-agents

UpdatedMay 3, 2025
Python

clusterzx /paperless-ai

Sponsor

Star3.1k

An automated document analyzer for Paperless-ngx using OpenAI API, Ollama, Deepseek-r1, Azure and all OpenAI API compatible Services to automatically analyze and tag your documents.

automation ai llama gemma paperless mistral phi paperless-ng paperless-ngx ollama gemma2

UpdatedApr 29, 2025
JavaScript

SilasMarvin /lsp-ai

Star2.7k

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

ai ide self-hosted openai developer-tools llama auto-completion mistral lsp language-client llm llamacpp

UpdatedJan 7, 2025
Rust

stochasticai /xTuring

Star2.6k

Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community:https://discord.gg/TgHXuSJEk6

adapter deep-learning llama lora quantization language-model alpaca mistral fine-tuning peft finetuning mixed-precision gpt-2 gpt-j llm generative-ai gen-ai

UpdatedSep 23, 2024
Python

LearningCircuit /local-deep-research

Star2.3k

Local Deep Research is an AI-powered assistant that transforms complex questions into comprehensive, cited reports by conducting iterative analysis using any LLM across diverse knowledge sources including academic databases, scientific repositories, web content, and private document collections.

search search-engine research ai local wikipedia self-hosted pubmed brave research-tool llama arxiv gemma academia mistral searxng local-llm retrieval-augmented-generation deep-research

UpdatedMay 4, 2025
Python

darrenburns /elia

Sponsor

Star2.1k

A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.