open-source-llm
Here are 30 public repositories matching this topic...
Language:All
Sort:Most stars
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
- Updated
Feb 16, 2026 - Python
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
- Updated
Nov 6, 2023 - Python
LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.
- Updated
Oct 29, 2025 - Jupyter Notebook
LLM (Large Language Model) FineTuning
- Updated
Apr 1, 2025 - Jupyter Notebook
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
- Updated
Feb 16, 2026 - Go
LLMs and Machine Learning done easily
- Updated
Feb 11, 2026 - Python
A list of LLMs Tools & Projects
- Updated
Nov 15, 2025
This is a PHP library for Ollama. Ollama is an open-source project that serves as a powerful and user-friendly platform for running LLMs on your local machine. It acts as a bridge between the complexities of LLM technology and the desire for an accessible and customizable AI experience.
- Updated
Jun 12, 2025 - PHP
Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs
- Updated
Feb 20, 2026 - TypeScript
Samples on how to build industry solution leveraging generative AI capabilities on top of SAP BTP and integrated with SAP S/4HANA Cloud.
- Updated
Jan 27, 2026 - HTML
EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
- Updated
Oct 6, 2024 - Python
GPU-accelerated LLaMA inference wrapper for legacy Vulkan-capable systems a Pythonic way to run AI with knowledge (Ilm) on fire (Vulkan).
- Updated
Oct 14, 2025 - Python
Read your local files and answer your queries
- Updated
Sep 3, 2024 - Python
Multi-agent workflows with Llama3: A private on-device multi-agent framework
- Updated
Jun 5, 2024 - Python
This project contains the code and documentation for an autonomous AI agent that classifies, enriches, and scores inbound business leads. It is built with a FastAPI backend, a LangGraph agent workflow powered by a local Ollama LLM, and a Streamlit frontend for demonstration.
- Updated
Jun 25, 2025 - Python
In this project, we leverage Weaviate, a vector database, to power our retrieval-augmented generation (RAG) application. Weaviate enables efficient vector similarity search, which is crucial for building effective RAG systems. Additionally, we use local language model (LLM) and embedding models.
- Updated
Jun 3, 2024 - Jupyter Notebook
*the-stix-intern* a minimalistic framework for the automized extraction of CTI from unstructured texts
- Updated
May 15, 2025 - HTML
Gittxt is an AI-focused CLI and plugin tool for extracting, filtering, and packaging text from GitHub repos. Build LLM-compatible datasets, prep code for prompt engineering, and power AI workflows with structured .txt, .json, .md, or .zip outputs.
- Updated
Aug 25, 2025 - Python
AI-powered quiz generator that creates MCQs from lecture PDFs using open-source LLMs (Qwen2.5-3B-Instruct). Includes PDF parsing, text chunking, and automated question generation.
- Updated
Nov 25, 2025 - Python
LocalPrompt is an AI-powered tool designed to refine and optimize AI prompts, helping users run locally hosted AI models like Mistral-7B for privacy and efficiency. Ideal for developers seeking to run LLMs locally without external APIs.
- Updated
Feb 10, 2025 - Python
Improve this page
Add a description, image, and links to theopen-source-llm topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with theopen-source-llm topic, visit your repo's landing page and select "manage topics."