llama-cpp

Star

Here are 116 public repositories matching this topic...

Language:All

Filter by language

All116 Python46 Jupyter Notebook11 C++8 JavaScript8 TypeScript7 Dart4 C3 C#3 Go3 Rust3

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

getumbrel /llama-gpt

Star11k

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

ai self-hosted openai llama gpt gpt-4 llm chatgpt llamacpp llama-cpp gpt4all localai llama2 llama-2 code-llama codellama

UpdatedApr 23, 2024
TypeScript

SciSharp /LLamaSharp

Star3.1k

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

chatbot llama gpt multi-modal llm llava semantic-kernel llamacpp llama-cpp llama2 llama3

UpdatedApr 29, 2025
C#

Mobile-Artificial-Intelligence /maid

Sponsor

Star2k

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

android facebook chatbot openai llama flutter mistral mobile-ai large-language-models chatgpt llamacpp llama-cpp free-chatgpt local-ai llama2 ollama gguf openorca mobile-artificial-intelligence android-ai

UpdatedApr 29, 2025
Dart

withcatai /node-llama-cpp

Star1.4k

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

nodejs cmake ai metal json-schema gpu vulkan grammar cuda self-hosted bindings llama embedding cmake-js prebuilt-binaries llm llama-cpp catai function-calling gguf

UpdatedMar 28, 2025
TypeScript

gotzmann /llama.go

Star1.4k

llama.go is like llama.cpp in pure Golang!

llama gpt alpaca vicuna gpt3 gpt4 llm chatgpt dalai llama-cpp gpt4all

UpdatedSep 20, 2024
Go

undreamai /LLMUnity

Sponsor

Star1.1k

Create characters in Unity with LLMs!

chat gamedev ai unity chatbot game-development dialogue unity3d character npc llama unity2d conversational-ai rag llm generative-ai llama-cpp

UpdatedMar 28, 2025
C#

Lizonghang /prima.cpp

Star745

prima.cpp: Speeding up 70B-scale LLM inference on low-resource everyday home clusters

llama-cpp llm-inference on-device-llms distributed-ai distributed-inference

UpdatedApr 28, 2025
C++

the-crypt-keeper /can-ai-code

Star579

Self-evaluating interview for AI coders

ai transformers humaneval llm langchain llama-cpp ggml

UpdatedApr 24, 2025
Python

mybigday /llama.rn

Star494

React Native binding of llama.cpp

android ios react-native llama llm llama-cpp

UpdatedMar 24, 2025
C++

withcatai /catai

Star472

Run AI ✨ assistant locally! with simple API for Node.js 🚀

nodejs ai chatbot openai chatui vicuna ai-assistant llm chatgpt dalai llama-cpp vicuna-installation-guide localai wizardlm local-llm catai ggmlv3 gguf node-llama-cpp

UpdatedJun 21, 2024
TypeScript

mdrokz /rust-llama.cpp

Sponsor

Star381

LLama.cpp rust bindings

rust machine-learning cpp model ffi crates-io llama api-bindings llama-cpp

UpdatedJun 27, 2024
Rust

jlonge4 /local_llama

Star267

This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.

python offline artificial-intelligence machinelearning langchain llama-cpp llamaindex

UpdatedJul 12, 2024
Python

ptsochantaris /emeltal

Sponsor

Star163

Local ML voice chat using high-end models.

macos swift machine-learning natural-language-processing ai ml speech-recognition user-interface swiftui whisper-cpp llama-cpp

UpdatedApr 26, 2025
C++

phronmophobic /llama.clj

Sponsor

Star162

Run LLMs locally. A clojure wrapper for llama.cpp.

clojure llama llm llama-cpp

UpdatedMar 29, 2025
Clojure

gotzmann /booster

Star154

Booster - open accelerator for LLM models. Better inference and debugging for AI hackers

openai llama gpt llm chatgpt llamacpp llama-cpp vllm ggml exllama oobabooga ollama

UpdatedAug 15, 2024
C++

gpustack /gguf-parser-go

Star153

Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

go llama-cpp gguf stable-diffusion-cpp llama-box

UpdatedApr 29, 2025
Go

BrutalCoding /shady.ai

Sponsor

Star138

Making offline AI models accessible to all types of edge devices.

android windows macos linux dart ios web material-design cross-platform fastlane llvm flutter linux-desktop rwkv serverpod whisper-cpp llama-cpp gguf shady-ai llama-dart

UpdatedFeb 12, 2024
Dart

nuance1979 /llama-server

Star122

LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.

llama chatbot-ui llamacpp llama-cpp

UpdatedJun 10, 2023
Python

nrl-ai /CustomChar

Sponsor

Star110

Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.

cpp tts llama stt llm whisper-cpp llama-cpp ggml llama-v2

UpdatedDec 5, 2023
C++

lucasjinreal /Crane

Star102

A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.

rust mllm llama-cpp qwen2-vl spark-tts qwen3

UpdatedMar 26, 2025
Rust

Improve this page

Add a description, image, and links to thellama-cpp topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with thellama-cpp topic, visit your repo's landing page and select "manage topics."

Learn more

Movatterモバイル変換

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

llama-cpp

Here are 116 public repositories matching this topic...

getumbrel /llama-gpt

SciSharp /LLamaSharp

Mobile-Artificial-Intelligence /maid

withcatai /node-llama-cpp

gotzmann /llama.go

undreamai /LLMUnity

Lizonghang /prima.cpp

the-crypt-keeper /can-ai-code

mybigday /llama.rn

withcatai /catai

mdrokz /rust-llama.cpp

jlonge4 /local_llama

ptsochantaris /emeltal

phronmophobic /llama.clj

gotzmann /booster

gpustack /gguf-parser-go

BrutalCoding /shady.ai

nuance1979 /llama-server

nrl-ai /CustomChar

lucasjinreal /Crane

Improve this page

Add this topic to your repo