local-llm

Local Deep Research achieves ~95% on SimpleQA benchmark (tested with GPT-4.1-mini) and includes benchmark tools to test on your own setup. Searches 10+ sources - arXiv, PubMed, GitHub, web, and your private documents.

search-engine research ai local wikipedia self-hosted pubmed brave research-tool llama arxiv gemma academia mistral searxng local-llm retrieval-augmented-generation deep-research local-deep-research

UpdatedJul 13, 2025
Python

papersgpt /papersgpt-for-zotero

Star1.8k

Chat Multiple PDFs in Zotero AI with Gemini, Grok 4, DeepSeek, GPT, ChatGPT, Claude, OpenRouter, Gemma 3, Qwen 3

chat pdf ai gemini zotero llama gemma mistral claude chatgpt local-llm deepseek deepseek-r1-distill-llama phi-4-mini qwen3 o4-mini gpt-4-1 deepseek-r1-0528 grok4

UpdatedJul 10, 2025
JavaScript

travisvn /openai-edge-tts

Star977

Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs

text-to-speech ai azure speech self-hosted tts openai gpt claude llm llms chatgpt elevenlabs edge-tts local-llm ollama ollama-webui llm-webui open-webui

UpdatedJul 1, 2025
Python

lxe /llavavision

Star490

A simple "Be My Eyes" web app with a llama.cpp/llava backend

machine-learning ai computer-vision artificial-intelligence webapp llama multimodal llm llamacpp local-llm

UpdatedNov 28, 2023
JavaScript

withcatai /catai

Star474

Run AI ✨ assistant locally! with simple API for Node.js 🚀

nodejs ai chatbot openai chatui vicuna ai-assistant llm chatgpt dalai llama-cpp vicuna-installation-guide localai wizardlm local-llm catai ggmlv3 gguf node-llama-cpp

UpdatedJun 21, 2024
TypeScript

runebookai /tome

Star324

a magical LLM desktop client that makes it easy for *anyone* to use LLMs and MCP

mcp gemini openai no-code llm llms localai local-llm ollama mcp-client llm-client mcp-clients qwen3

UpdatedJul 11, 2025
Svelte

resume-llm /resume-ai

Star303

A local, privacy-first résumé builder using LLMs and Markdown to generate ATS-ready DOCX files with Pandoc — no cloud, no tracking.

resume-builder local-llm ai-resume-builder

UpdatedJul 11, 2025
TypeScript

shreyaskarnik /DistiLlama

Sponsor

Star296

Chrome Extension to Summarize or Chat with Web Pages/Local Documents Using locally running LLMs. Keep all of your data and conversations private. 🔐

chrome-extension private readability summarization zephyr privacy-preserving-computing llms langchain local-llm retrieval-augmented-generation llama2 ollama mistral-7b

UpdatedSep 2, 2024
TypeScript

emirsahin1 /llm-axe

Star258

A simple, intuitive toolkit for quickly implementing LLM powered applications.

llm local-llm function-calling ollama llama3 pdf-llm

UpdatedJan 5, 2025
Python

vscode-reborn-ai /vscode-reborn-ai

Star249

Code with AI in VSCode, bring your own ai.

ai vscode-extension hacktoberfest local-llm openrouter gpt-4o gpt-o1

UpdatedMay 31, 2025
TypeScript

AstraBert /everything-ai

Sponsor

Star242

Your fully proficient, AI-powered and local chatbot assistant🤖

learning open-source ai docker-image text-summarization image-classification free-to-use qdrant stable-diffusion generative-ai chatgpt langchain local-llm cheshire-cat ai-studio jan-ai

UpdatedJun 18, 2024
Python

rockbite /localforge

Star214

Local coding agent with neat UI

javascript ai ai-framework ai-agents prompt-engineering langchain local-llm vibe-coding

UpdatedMay 18, 2025
JavaScript

travisvn /chatterbox-tts-api

Star157

Local, OpenAI-compatible text-to-speech (TTS) API using Chatterbox, enabling users to generate voice cloned speech anywhere the OpenAI API is used (e.g. Open WebUI, AnythingLLM, etc.)

python docker text-to-speech ai cuda speech self-hosted tts openai gpt chatterbox voice-cloning openai-api voice-clone chatgpt elevenlabs local-llm ollama open-webui

UpdatedJul 10, 2025
Python

deveix /react-native-apple-llm

Star156

React Native plugin for Apple Intelligence and Foundation Models

nlp react-native text-generation structured-output react-native-plugin zod foundation-models local-llm offline-ai react-native-ai apple-intelligence apple-foundation-models react-native-apple apple-llm react-native-llm apple-llm-integration react-native-apple-llm react-native-local-llm react-native-apple-intelligence

UpdatedJul 1, 2025
Swift

datacrystals /AIStoryWriter

Star151

LLM story writer with a focus on high-quality long output based on a user provided prompt.

python ai command-line-tool story-generator llm storywriting llms local-llm local-llama

UpdatedJul 12, 2025
Python

nath1295 /LLMFlex

Star150

A python package for developing AI applications with local LLMs.

vector-database prompt-engineering local-llm

UpdatedJan 4, 2025
Python

sfortis /openai_tts

Star140

Custom TTS component for Home Assistant. Utilizes the OpenAI speech engine or any compatible endpoint to deliver high-quality speech. Optionally offers chime and audio normalization features.

text-to-speech ai self-hosted tts speech-synthesis openai home-assistant ha chime homeassistant hacs llm local-llm