llama-cpp

Star

Here are 108 public repositories matching this topic...

Language:All

Filter by language

All108 Python41 Jupyter Notebook11 C++8 JavaScript7 TypeScript7 Dart4 C3 C#3 Go3 Dockerfile2

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

getumbrel /llama-gpt

Star10.9k

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

ai self-hosted openai llama gpt gpt-4 llm chatgpt llamacpp llama-cpp gpt4all localai llama2 llama-2 code-llama codellama

UpdatedApr 23, 2024
TypeScript

SciSharp /LLamaSharp

Star3k

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

chatbot llama gpt multi-modal llm llava semantic-kernel llamacpp llama-cpp llama2 llama3

UpdatedMar 15, 2025
C#

Mobile-Artificial-Intelligence /maid

Sponsor

Star1.8k

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

android facebook chatbot openai llama flutter mistral mobile-ai large-language-models chatgpt llamacpp llama-cpp free-chatgpt local-ai llama2 ollama gguf openorca mobile-artificial-intelligence android-ai

UpdatedMar 16, 2025
Dart

gotzmann /llama.go

Star1.3k

llama.go is like llama.cpp in pure Golang!

llama gpt alpaca vicuna gpt3 gpt4 llm chatgpt dalai llama-cpp gpt4all

UpdatedSep 20, 2024
Go

withcatai /node-llama-cpp

Star1.3k

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

nodejs cmake ai metal json-schema gpu vulkan grammar cuda self-hosted bindings llama embedding cmake-js prebuilt-binaries llm llama-cpp catai function-calling gguf

UpdatedFeb 21, 2025
TypeScript

undreamai /LLMUnity

Sponsor

Star985

Create characters in Unity with LLMs!

chat gamedev ai unity chatbot game-development dialogue unity3d character npc llama unity2d conversational-ai rag llm generative-ai llama-cpp

UpdatedFeb 21, 2025
C#

the-crypt-keeper /can-ai-code

Star571

Self-evaluating interview for AI coders

ai transformers humaneval llm langchain llama-cpp ggml

UpdatedFeb 21, 2025
Python

withcatai /catai

Star470

Run AI ✨ assistant locally! with simple API for Node.js 🚀

nodejs ai chatbot openai chatui vicuna ai-assistant llm chatgpt dalai llama-cpp vicuna-installation-guide localai wizardlm local-llm catai ggmlv3 gguf node-llama-cpp

UpdatedJun 21, 2024
TypeScript

mybigday /llama.rn

Star449

React Native binding of llama.cpp

android ios react-native llama llm llama-cpp

UpdatedMar 14, 2025
C++

mdrokz /rust-llama.cpp

Sponsor

Star376

LLama.cpp rust bindings

rust machine-learning cpp model ffi crates-io llama api-bindings llama-cpp

UpdatedJun 27, 2024
Rust

jlonge4 /local_llama

Star264

This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.

python offline artificial-intelligence machinelearning langchain llama-cpp llamaindex

UpdatedJul 12, 2024
Python

ptsochantaris /emeltal

Sponsor

Star161

Local ML voice chat using high-end models.

macos swift machine-learning natural-language-processing ai ml speech-recognition user-interface swiftui whisper-cpp llama-cpp

UpdatedMar 15, 2025
C++

phronmophobic /llama.clj

Sponsor

Star158

Run LLMs locally. A clojure wrapper for llama.cpp.

clojure llama llm llama-cpp

UpdatedFeb 7, 2025
Clojure

gotzmann /booster

Star154

Booster - open accelerator for LLM models. Better inference and debugging for AI hackers

openai llama gpt llm chatgpt llamacpp llama-cpp vllm ggml exllama oobabooga ollama

UpdatedAug 15, 2024
C++

BrutalCoding /shady.ai

Sponsor

Star136

Making offline AI models accessible to all types of edge devices.

android windows macos linux dart ios web material-design cross-platform fastlane llvm flutter linux-desktop rwkv serverpod whisper-cpp llama-cpp gguf shady-ai llama-dart

UpdatedFeb 12, 2024
Dart

gpustack /gguf-parser-go

Star128

Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

go llama-cpp gguf stable-diffusion-cpp llama-box

UpdatedMar 14, 2025
Go

nuance1979 /llama-server

Star120

LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.

llama chatbot-ui llamacpp llama-cpp

UpdatedJun 10, 2023
Python

nrl-ai /CustomChar

Sponsor

Star108

Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.

cpp tts llama stt llm whisper-cpp llama-cpp ggml llama-v2

UpdatedDec 5, 2023
C++

vtuber-plan /langport

Star94

Langport is a language model inference service

api openai llama language-model tabby llm fauxpilot chatgpt langchain chatgpt-api llama-cpp

UpdatedSep 9, 2024
Python

R3gm /InsightSolver-Colab

Star93

InsightSolver: Colab notebooks for exploring and solving operational issues using deep learning, machine learning, and related models.

machine-learning text-to-speech computer-vision deep-learning object-detection colorization aiops colab-notebook llm ai-ops stable-diffusion llama-cpp autogpt llama-2

UpdatedJun 12, 2024
Jupyter Notebook

Improve this page

Add a description, image, and links to thellama-cpp topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with thellama-cpp topic, visit your repo's landing page and select "manage topics."

Learn more

Movatterモバイル変換

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

llama-cpp

Here are 108 public repositories matching this topic...

getumbrel /llama-gpt

SciSharp /LLamaSharp

Mobile-Artificial-Intelligence /maid

gotzmann /llama.go

withcatai /node-llama-cpp

undreamai /LLMUnity

the-crypt-keeper /can-ai-code

withcatai /catai

mybigday /llama.rn

mdrokz /rust-llama.cpp

jlonge4 /local_llama

ptsochantaris /emeltal

phronmophobic /llama.clj

gotzmann /booster

BrutalCoding /shady.ai

gpustack /gguf-parser-go

nuance1979 /llama-server

nrl-ai /CustomChar

vtuber-plan /langport

R3gm /InsightSolver-Colab

Improve this page

Add this topic to your repo