llm-ops

Your autonomous engineering team in a CLI. Point Zeroshot at an issue, walk away, and return to production-grade code. Supports Claude Code, OpenAI Codex, OpenCode, and Gemini CLI.

cli multi-agent gemini developer-tools codex autonomous-agents ai-agents claude github-automation coding-assistant ai-agent llm generative-ai llm-tools llm-ops agentic-workflow agent-orchestration vibecoding

UpdatedFeb 20, 2026
JavaScript

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

python workflow ai serverless chatbot spreadsheet svelte orchestration baas agents backend-as-a-service rag llm chatgpt retrieval-augmented-generation lancedb ai-agents-framework llm-ops llama3-1 intelligent-spreadsheet

UpdatedFeb 19, 2026
Python

lastmile-ai /aiconfig

Star1.1k

AIConfig is a config-based framework to build generative AI applications.

ai developer-tools llm generative-ai llm-ops

UpdatedFeb 10, 2026
Python

athina-ai /athina-evals

Star297

Python SDK for running evaluations on LLM generated responses

evaluation evaluation-metrics evaluation-framework llmops llm-eval llm-ops llm-evaluation llm-evaluation-toolkit

UpdatedJun 6, 2025
Python

astronomer /ask-astro

Star280

An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

airflow astronomer llm llm-ops

UpdatedJul 15, 2025
Python

chatchat-space /LangGraph-Chatchat

Star170

agent agents fastapi llm langchain langchain-python langchain-agent llm-ops langgraph langgraph-python langchain-agents

UpdatedMar 7, 2025
Python

ultracontext /ultracontext

Star132

The context API for AI agents

nodejs api typescript sdk ai versioning agents ai-agents context-api llm context-window llm-ops context-management context-engineering ultracontext

UpdatedFeb 19, 2026
JavaScript

Light-Heart-Labs /Lighthouse-AI

Star58

Operations toolkit and methodology for persistent LLM agents — watchdogs, memory reset, cost monitoring, tool proxy, Docker Compose stacks, and a cookbook of practical recipes. Framework-agnostic patterns from running 3 AI agents 24/7.

infrastructure devops docker-compose gpu self-hosted multi-agent autonomous-agents ai-agents llm vllm local-llm llm-ops openclaw persistent-agents

UpdatedFeb 17, 2026
Python

friendliai /friendli-client

Star49

[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI

ai ml inference gpt inference-server mistral inference-engine serving mlops gpt3 llm stable-diffusion llms generative-ai llmops llm-serving llm-inference llama2 llm-ops

UpdatedJun 25, 2025
Python

demml /opsml

Sponsor

Star28

Quality Control for AI Artifact Management

rust open-source data-science machine-learning ai monitoring deep-learning python3 artificial-intelligence data-engineering governance model-deployment mlops ml-engineering ml-platform generative-ai llm-ops ml-platform-infra

UpdatedFeb 20, 2026
Rust

whoisrade /agentic-field-manual

Star24

Production operations framework for AI-powered SaaS. The architectural patterns, failure modes, and operational playbooks that determine whether your AI systems scale profitably or fail expensively.

ai-safety production-ai mlops ai-engineering ai-observability llm prompt-engineering enterprise-ai llm-ops agentic-systems ai-audit ai-cost-optimization

UpdatedFeb 3, 2026

OthmanAdi /langsmith-fetch-skill

Sponsor

Star18

🔍 AI observability skill for Claude Code. Debug LangChain/LangGraph agents by fetching execution traces from LangSmith Studio directly in your terminal.

developer-tools observability ai-agents langchain langsmith llm-ops langsmith-tracing developer-tools-ai-agent claude-skills claude-skills-creator claude-skills-hub claude-skills-libary agent-debugging