llama-cpp-python

An open source, Gradio-based chatbot app that combines the best of retrieval augmented generation and prompt engineering into an intelligent assistant for modern professionals.

docker cassandra docker-compose python3 gradio llama2 llama-cpp-python

UpdatedAug 1, 2024
Python

ossirytk /llama-cpp-chat-memory

Star34

Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma

chatbot spacy ner llama-cpp langchain-python chromadb chainlit llama2 llama-cpp-python gguf

UpdatedOct 7, 2024
Python

Talnz007 /VulkanIlm

Star25

GPU-accelerated LLaMA inference wrapper for legacy Vulkan-capable systems a Pythonic way to run AI with knowledge (Ilm) on fire (Vulkan).

machine-learning vulkan python-wrapper fastai amd-gpu intel-gpu llama-cpp gpu-inference llm-inference localllm local-ai open-source-llm llama-cpp-python gguf legacy-gpus

UpdatedOct 14, 2025
Python

BorjaOteroFerreira /IALab-Suite

Star19

Tool for test diferents large language models without code.

api-rest chat-application flask-api inference-api large-language-models llm local-inference llamacpp llm-inference llama2 llama-cpp-python llama2-7b mixtral-8x7b

UpdatedOct 18, 2025
Python

controlecidadao /samantha_ia

Star16

Experimental interface environment for open source LLM, designed to democratize the use of AI. Powered by llama-cpp, llama-cpp-python and Gradio.

text-generation artificial-intelligence data-analysis feedback-loop windows-compatible ethical-ai large-language-models prompt-engineering llama-cpp local-ai llama-cpp-python open-source-ai prompt-chaining model-chaining gguf-models ai-interface democratizing-ai samantha-ai model-iteraction ai-experimentation

UpdatedOct 11, 2025
Python

svjack /CodeActAgent-Gradio

Star14

UnOfficial Gradio Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji.

python agent chatbot prompt coding code-generation llama agent-based-modeling gradio mistral gradio-interface llm llama-cpp llm-agent code-llms llama-cpp-python code-action mistral-7b mixtral code-act

UpdatedSep 30, 2024
Jupyter Notebook

A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more models from hf repos and more. It's super easy to use and comes prepacked with best preconfigured open source models: dolphin phi-2 2.7b, mistral 7b v0.2, mixtral 8x7b v0.1, solar 10.7b and zephyr 3b

database inference python3 llama model-database hugginface llm llama2 llama-cpp-python

UpdatedJan 13, 2024
Python

007prateekd /fin-edubot

Star12

A financial chatbot powered by an LLM and retrieval-augmented generation.

finance chatbot web-scraping finchat large-language-models llm llama-cpp llm-inference retrieval-augmented-generation llama-cpp-python

UpdatedOct 2, 2023
Jupyter Notebook

woheller69 /LLAMA_TK_CHAT

Star10

Simple chat interface for local AI using llama-cpp-python and llama-cpp-agent

gui llm-inference llama-cpp-python llama-cpp-agent

UpdatedJul 27, 2024
Python

TAO71-AI /I4.0

Star5

TAO71 I4.0 is an AI created by TAO71 in Python.

python linux api client ai server chatbot transformers python3 artificial-intelligence chatbots text2image image2text python311 diffusers gpt4all llama-cpp-python

UpdatedAug 21, 2025
Python

BetoAvila /the-silent-cartographer_youtube

Star5

YouTube API implementation with Meta's Llama 2 to analyze comments and sentiments

python docker numpy youtube-api pandas pytorch miniconda docker-secrets google-api-python-client youtube-comment-scraper youtube-comment-sentiment-analysis llms llamacpp llama-cpp llama2 llama2-docker llama-cpp-python llama2-7b

UpdatedDec 5, 2023
Python

rrrusst /solairia

Star5

SOLAIRIA is a free tool with minimal dependencies that lets you interact with text-generation AI LLMs of your choice privately by running on your own local hardware offline.

privacy ai offline text-generation private free llm genai llama-cpp-python