llm-ops

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

python workflow ai serverless chatbot spreadsheet svelte orchestration baas agents backend-as-a-service rag llm chatgpt retrieval-augmented-generation lancedb ai-agents-framework llm-ops llama3-1 intelligent-spreadsheet

UpdatedNov 28, 2025
Python

lastmile-ai /aiconfig

Star1.1k

AIConfig is a config-based framework to build generative AI applications.

ai developer-tools llm generative-ai llm-ops

UpdatedJun 4, 2024
Python

athina-ai /athina-evals

Star292

Python SDK for running evaluations on LLM generated responses

evaluation evaluation-metrics evaluation-framework llmops llm-eval llm-ops llm-evaluation llm-evaluation-toolkit

UpdatedJun 6, 2025
Python

astronomer /ask-astro

Star274

An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

airflow astronomer llm llm-ops

UpdatedJul 15, 2025
Python

chatchat-space /LangGraph-Chatchat

Star155

agent agents fastapi llm langchain langchain-python langchain-agent llm-ops langgraph langgraph-python langchain-agents

UpdatedMar 7, 2025
Python

friendliai /friendli-client

Star49

[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI

ai ml inference gpt inference-server mistral inference-engine serving mlops gpt3 llm stable-diffusion llms generative-ai llmops llm-serving llm-inference llama2 llm-ops

UpdatedJun 25, 2025
Python

demml /opsml

Sponsor

Star24

Quality Control for AI Artifact Management

rust open-source data-science machine-learning ai monitoring deep-learning python3 artificial-intelligence data-engineering governance model-deployment mlops ml-engineering ml-platform generative-ai llm-ops ml-platform-infra

UpdatedNov 27, 2025
Rust

YeonwooSung /MLOps

Sponsor

Star15

Miscellaneous codes and writings for MLOps

docker kubernetes aws ai spark ai-as-a-service multimodal spark-nlp rag mlops apache-iceberg bentoml ml-serving vector-database triton-inference-server data-intensive-applications llm vectordb llm-inference llm-ops

UpdatedNov 14, 2025
Jupyter Notebook

elotl /GenAI-infra-stack

Star11

Deployment of RAG + LLM model serving on multiple K8s cloud clusters

luna autoscaling genai llm-inference llm-ops genai-chatbot

UpdatedJun 1, 2025
Python

langgenius /dify-conversation

Star10

[🚧🚧🚧WIP🚧🚧 🚧]Rework of webapp-conversation

llm-ops

UpdatedJul 5, 2023
TypeScript

AndrMoura /streamlit-chatbot-analytics

Star7

Streamlit-based chatbot leveraging Ollama via LangChain and PostHog-LLM for advanced logging and monitoring

analytics chatbot chatbots chatbot-application streamlit llm langchain ollama llm-ops llama3 llm-observability

UpdatedMay 8, 2024
Python

prompt-foundry /typescript-sdk

Star6

The prompt engineering, prompt management, and prompt evaluation tool for TypeScript, JavaScript, and NodeJS.

typescript gpt open-ai gpt-3 gpt-4 llm prompt-engineering llmops prompt-testing prompt-manager prompt-management llm-eval llm-test llm-ops llm-evaluation prompt-evaluation

UpdatedNov 15, 2025
TypeScript

GlyphyAI /liteswarm

Star5

Lightweight Agent Framework for building AI apps with any LLM

multi-agent multi-agent-systems ai-agents agent-systems llm llm-ops llm-orchestration agent-ops

UpdatedJan 21, 2025
Python

matdev83 /llm-accounting

Star5

A Python package for tracking and analyzing LLM usage across different models and applications. It is primarily designed as a library for integration into development process of LLM-based agentic workflow tooling, providing robust tracking capabilities.

mlops mlops-workflow llms llm-ops llm-observability agentic-workflow agentic-ai agentic-ai-development