local-llm-integration

Star

Here are 29 public repositories matching this topic...

Language:All

Filter by language

All29 Python16 TypeScript5 JavaScript2 Dart1 Go1 Jupyter Notebook1 Kotlin1 Shell1 Vue1

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

fingerthief /recommendarr

Star967

An LLM driven recommendation system based on Radarr and Sonarr library or watch history information

vuejs trakt ai vue local sonarr self-hosted artificial-intelligence recommendation radarr tautulli jellyfin local-llm-integration

UpdatedApr 14, 2025
Vue

dineshsoudagar /local-llms-on-android

Star65

Run large language models like Qwen and LLaMA locally on Android for offline, private, real-time question answering and chat - powered by ONNX Runtime.

android chatbot android-app on-device-ai mobile-ai onnx-runtime huggingface-tokenizers local-llm qwen llama3 local-llm-integration offline-inference

UpdatedSep 9, 2025
Kotlin

🚀 A powerful Flutter-based AI chat application that lets you run LLMs directly on your mobile device or connect to local model servers. Features offline model execution, Ollama/LLMStudio integration, and a beautiful modern UI. Privacy-focused, cross-platform, and fully open source.

self-hosted flutter flutter-desktop flutter-mobile llm local-llm llm-inference ollama llm-framework ollama-ui ollama-interface ollama-gui ollama-app ollama-api local-llm-integration

UpdatedNov 19, 2025
Dart

LM4eu /goinfer

Star8

Local LLM proxy, DevOps friendly

inference inference-server inference-api openai-api llm openaiapi llamacpp llama-cpp local-llm localllm local-ai llm-proxy llama-api llama-server llm-router language-model-api local-lm local-llm-integration

UpdatedNov 25, 2025
Go

sanskar9999 /CodeEvolveLLM

Star8

A framework for using local LLMs (Qwen2.5-coder 7B) that are fine-tuned using RL to generate, debug, and optimize code solutions through iterative refinement.

ai rl code-generation llm code-interpreter qwen2-5 local-llm-integration

UpdatedMar 14, 2025
Python

tommathewXC /lidia

Star6

A fully customizable, super light-weight, cross-platform GenAI based Personal Assistant that can be run locally on your private hardware!

text-to-speech deep-neural-networks personal-assistant speech-to-text ocr-recognition huggingface llm vllm genai local-llm ollama ollama-python local-llm-integration local-genai

UpdatedMar 15, 2025
Python

lelandg /ImageAI

Star6

🖼️ Python Image and 🎥 Video Generator using LLM providers and models — built in Claude Code 💻 CLI, Codex CLI 📝, Gemini CLI 🌌, and others — FREE & Open-Source forever 🚀

image-generation gemini-api video-ge openai-api stable-diffusion stability-ai ollama local-llm-integration

UpdatedNov 28, 2025
Python

augustine-aj /RAG-Basics

Star5

🤖 An Intelligent Chatbot: Powered by the locally hosted Ollama 3.2 LLM 🧠 and ChromaDB 🗂️, this chatbot offers semantic search 🔍, session-aware responses 🗨️, and an interactive Streamlit interface 🎨 for seamless user interaction. 🚀

interactive-ui local-llm-integration chromadb-integration semantic-sear session-aware-responses dynamic-interaction

UpdatedDec 12, 2024
Python

dronefreak /local_rag_pipeline

Star3

An advanced, fully local, and GPU-accelerated RAG pipeline. Features a sophisticated LLM-based preprocessing engine, state-of-the-art Parent Document Retriever with RAG Fusion, and a modular, Hydra-configurable architecture. Built with LangChain, Ollama, and ChromaDB for 100% private, high-performance document Q&A.

python natural-language-processing hydra natural-language-understanding rag large-language-models llm langchain-python chromadb local-llm document-qa ollama llms-reasoning private-ai document-query-search llms-txt local-llm-integration document-question-answering retrieval-augmented-generation-rag rag-pip

UpdatedAug 11, 2025
Python

swordonfire /SuperBot

Star2

An AI-powered assistant to streamline knowledge management, member discovery, and content generation across Telegram and Twitter, while ensuring privacy with local LLM deployment.

twitter-bot telegram-bot ai-agents weaviate fastapi llm chromadb retrieval-augmented-generation local-llm-integration

UpdatedMar 24, 2025
Python

fvanevski /knowledge_agent

Star2

An autonomous AI agent for intelligently updating, maintaining, and curating a LightRAG knowledge base.

knowledge-graph knowledge-base knowledge-management ai-agents local-ai local-llm-integration local-ai-development lightrag local-ai-agents

UpdatedAug 28, 2025
Python

code2k13 /onnx_javascript_browser_inference

Star2

This repository has code to securely run SLM (Small language models) locally using nodejs (servers side) or inside browser .

wasm onnx onnxruntime onnx-models small-language-models local-llm-integration

UpdatedNov 25, 2025
JavaScript

ejativa /DedalosStudio-APIs-QASolutions

Star1

Local-first, AI-assisted API testing generator: turns OpenAPI/Swagger + Gherkin into ready-to-run Postman collections, a unified environment, and Markdown analysis — offline.

qa opensource devtools test-automation api-testing swagger-api sdet qa-automation local-first code-generation-techniques gherkin-language postman-collections ai-assisted llm openai-compatible-api local-llm-integration spec-driven-testing

UpdatedOct 5, 2025
TypeScript

DouglasMacKrell /namegnome

Star1

Python CLI/TUI for intelligent media file organization. Features atomic operations, rollback safety, and integrity checks, with a local LLM workflow for context-aware renaming and categorization from API-sourced metadata.

python cli metadata automation ai tui file-management tmdb-api tvdb-api llm local-llm local-llm-integration

UpdatedJul 6, 2025
Python

EzioDEVio /plantdeck_rag

Star1

PlantDeck is an offline herbal RAG that indexes your PDF books and monographs, extracts text/images with OCR, and answers questions with page-level citations using a local LLM via Ollama. Runs on your machine; no cloud. Field guide only; not medical advice.

docker computer-vision offline docker-compose embeddings plants tesseract-ocr poppler pdfminer pymupdf herbalism rag github-actions sentence-transformers ollama rag-chatbot local-llm-integration

UpdatedAug 11, 2025
Python

EcomineAI /JV-Archon

Star1

JV-Archon is my personal offline LLM ecosystem.

open-source machine-learning tools ai configs scripts mit-license automation-framework mistral modular-framework personal-workflow large-language-models llms local-llm local-ai ollama lmstudio local-llm-integration gpt-oss-20b

UpdatedNov 14, 2025
Shell

kmkamyk /ask-cli

Star1

**Ask CLI** is a command-line tool for interacting with a local LLM (Large Language Model) server. It allows you to send queries and receive concise command-line responses.

linux bash automation command-line command-line-tool cli-tool ask-cli openai-api llms openai-api-chatbot local-llm command-line-assistant local-llm-integration bash-assistant