llamacpp

Star

Here are 632 public repositories matching this topic...

Language:All

Filter by language

All632 Python252 TypeScript57 C++56 Jupyter Notebook43 JavaScript27 Rust24 Go23 Shell18 C#16 HTML11

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

janhq /jan

Star39.8k

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

open-source self-hosted gpt tauri llm chatgpt llamacpp localai

UpdatedDec 17, 2025
TypeScript

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

chat agent productivity research ai emacs self-hosted assistant image-generation obsidian stt semantic-search rag obsidian-md llm chatgpt whatsapp-ai llamacpp offline-llm llama3

UpdatedDec 8, 2025
Python

llmware-ai /llmware

Sponsor

Star14.5k

Unified framework for building enterprise RAG pipelines with small, specialized models

parsing agents onnx openvino llm llamacpp retrieval-augmented-generation generative-ai-tools small-specialized-models

UpdatedJul 24, 2025
Python

getumbrel /llama-gpt

Star11k

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

ai self-hosted openai llama gpt gpt-4 llm chatgpt llamacpp llama-cpp gpt4all localai llama2 llama-2 code-llama codellama

UpdatedApr 23, 2024
TypeScript

LostRuins /koboldcpp

Star9.1k

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

llama language-model gemma mistral koboldai llm llamacpp ggml koboldcpp gguf

UpdatedDec 17, 2025
C++

xorbitsai /inference

Star8.9k

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

machine-learning deployment inference pytorch artificial-intelligence llama whisper gemma mistral openai-api llm flan-t5 chatglm llamacpp vllm ggml wizardlm qwen llama3 glm4

UpdatedDec 17, 2025
Python

reorproject /reor

Star8.4k

Private & local AI personal knowledge management app for high entropy people.

markdown ai llama note-taking pkm rag local-first vector-database second-brain llamacpp lancedb ollama

UpdatedMay 13, 2025
JavaScript

serge-chat /serge

Star5.8k

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

python docker nginx web svelte llama alpaca tailwindcss fastapi sveltekit llamacpp

UpdatedNov 21, 2025
Svelte

gptme /gptme

Star4.1k

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web, vision.

agent cli chatbot openai code-generation agents ai-agents rag ai-assistant llm chatgpt anthropic llamacpp llm-agent openrouter llm-apps

UpdatedDec 17, 2025
Python

JohnSnowLabs /spark-nlp

Star4.1k

State of the Art Natural Language Processing

nlp natural-language-processing spark sentiment-analysis text-classification tensorflow machine-translation transformers language-detection pyspark named-entity-recognition question-answering lemmatizer spell-checker bert part-of-speech-tagger entity-extraction onnx llm llamacpp

UpdatedDec 17, 2025
Scala

cactus-compute /cactus

Star3.9k

Kernels & AI inference engine for mobile devices.

android ios mobile framework ai edge transformer smartphone llm llms llamacpp llm-inference

UpdatedDec 17, 2025
C++

RunanywhereAI /runanywhere-sdks

Star3.6k

Production ready toolkit to run AI locally

android kotlin swift ios privacy inference edge voice-assistant multimodal edge-ai on-device-ai voice-ai agent-framework llm foundational-models llamacpp ollama apple-intelligence

UpdatedDec 17, 2025
Kotlin

twinnydotdev /twinny

Star3.6k

The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but 100% free.

artificial-intelligence private free vscode-extension code-generation symmetry code-completion copilot code-chat llamacpp llama2 ollama codellama ollama-chat ollama-api

UpdatedAug 7, 2025
TypeScript

Michael-A-Kuykendall /shimmy

Sponsor

Star3.5k

⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.

rust machine-learning transformers api-server developer-tools llama command-line-tool lora inference-server rust-crate huggingface huggingface-transformers huggingface-models llamacpp llm-inference local-ai gguf ollama-api openai-compatible

UpdatedDec 17, 2025
Rust

SciSharp /LLamaSharp

Star3.5k

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

chatbot llama gpt multi-modal llm llava semantic-kernel llamacpp llama-cpp llama2 llama3

UpdatedDec 1, 2025
C#

Josh-XT /AGiXT

Sponsor

Star3.1k

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

python intelligence automation ai agi openai artificial llama llm llmops llamacpp chromadb agixt agent-llm

UpdatedDec 16, 2025
Python

SilasMarvin /lsp-ai

Star3.1k

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

ai ide self-hosted openai developer-tools llama auto-completion mistral lsp language-client llm llamacpp

UpdatedJan 7, 2025
Rust

janhq /cortex.cpp

Star2.8k

Local AI API Platform

onnx onnxruntime llamacpp gguf

UpdatedJul 4, 2025
C++

containers /ramalama

Star2.4k

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

ai containers cuda intel hip hacktoberfest inference-server podman llm llamacpp vllm