koboldcpp

Star

Here are 22 public repositories matching this topic...

Language:All

Filter by language

All22 Python13 C#3 C++2 Shell2 JavaScript1 Nix1

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

LostRuins /koboldcpp

Star6.9k

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

llama language-model gemma mistral koboldai llm llamacpp ggml koboldcpp gguf

UpdatedMar 19, 2025
C++

ComfyUI-IF_AI_tools is a set of custom nodes for ComfyUI that allows you to generate prompts using a local Large Language Model (LLM) via Ollama. This tool enables you to enhance your image generation workflow by leveraging the power of language models.

flux ocr transformers gemini supervision mistral xai textgeneration rag groq stable-diffusion anthropic llamacpp comfyui koboldcpp ollama lmstudio graphrag omost

UpdatedMar 9, 2025
Python

aseichter2007 /ClipboardConqueror

Star396

Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.

ai copilot llm koboldcpp

UpdatedJan 11, 2025
JavaScript

BBC-Esq /VectorDB-Plugin

Star326

Plugin that lets you ask questions about your documents including audio and video files.

python embeddings vision bark database-management embedding-models whisper gtts tiledb retrieval-chatbot rag vector-search embedding-vectors vector-database koboldai vector-data-management retrieval-augmented-generation koboldcpp whisperspeech whispers2t

UpdatedMar 20, 2025
Python

lee-b /kobold_assistant

Star154

Like ChatGPT's voice conversations with an AI, but entirely offline/private/trade-secret-friendly, using local AI models such as LLama 2 and Whisper

android linux text-to-speech mobile desktop voice-recognition llama speech-to-text voice-assistant ai-assistants ai-assistant koboldai llm text-generation-webui oobabooga local-ai koboldcpp

UpdatedAug 20, 2024
Python

jabberjabberjabber /ImageIndexer

Star124

Creates an index of images, queries a local LLM and adds tags to the image metadata

ai local tags image-processing keywords image-classification image-recognition dataset-generation exiftool exif-metadata multimodal large-language-models llamacpp koboldcpp

UpdatedMar 17, 2025
Python

Nexesenex /croco.cpp

Star100

Croco.Cpp is a 3rd party testground for KoboldCPP, a simple one-file way to run various GGML/GGUF models with KoboldAI's UI. (for Croco.Cpp, in Cuda mode mainly!)

llamacpp koboldcpp crocoricocpp

UpdatedMar 20, 2025
C++

latestissue /AltaeraAI

Sponsor

Star40

A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux

android ai termux mamba mistral phi vicuna koboldai rwkv llamacpp ggml rwkv4 koboldcpp gguf tinyllama rwkvcpp tinyvicuna tinydolphin

UpdatedJun 21, 2024
Shell

badgids /OpenKlyde

Star37

An AI Discord bot that connects to a koboldcpp instance by API calls. Have a more intelligent Clyde Bot of your own making!

python api ai discord discord-bot koboldai llm oobabooga koboldcpp

UpdatedOct 18, 2024
Python

acrion /ditana-assistant

Sponsor

Star10

Ditana Assistant: AI-powered CLI/GUI tool for intelligent assistance, leveraging LLMs with OS interaction capabilities and context augmentation, optionally via Wolfram|Alpha

windows macos linux wolfram-alpha-api cli-tool openai-api ai-assistant gui-application-python huggingface-datasets llms os-interaction koboldcpp context-augmentation ditana