llm-ops

Star

Here are 19 public repositories matching this topic...

Language:All

Filter by language

All19 Python13 TypeScript3 Jupyter Notebook2 JavaScript1

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

bentoml /OpenLLM

Star11k

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

llama mistral fine-tuning mlops bentoml vicuna llm model-inference llmops llm-serving llm-inference open-source-llm llama2 openllm llm-ops llama3-1 llama3-2 llama3-2-vision

UpdatedMar 18, 2025
Python

julep-ai /julep

Star4.9k

Serverless AI Workflows for Data & ML Teams

python ai developer-tools agents hacktoberfest devfest ai-agents ai-platform llm hacktoberfest2024 ai-agents-framework llm-ops aiagents ai-memory

UpdatedMar 17, 2025
Jupyter Notebook

truefoundry /cognita

Star3.9k

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

python agent application data machine-learning framework typescript ai deep-learning model-deployment fine-tuning rag mlops llm generative-ai llmops retrieval-augmented-generation llm-ops

UpdatedFeb 21, 2025
Python

Marker-Inc-Korea /AutoRAG

Star3.7k

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

python open-source qa benchmarking ops pipeline analysis optimization evaluation embeddings automl document-parser rag llm retrieval-augmented-generation llm-ops llm-evaluation rag-evaluation

UpdatedMar 3, 2025
Python

lastmile-ai /aiconfig

Star997

AIConfig is a config-based framework to build generative AI applications.

ai developer-tools llm generative-ai llm-ops

UpdatedJun 4, 2024
Python

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

python workflow ai serverless chatbot spreadsheet svelte orchestration baas agents backend-as-a-service rag llm chatgpt retrieval-augmented-generation lancedb ai-agents-framework llm-ops llama3-1 intelligent-spreadsheet

UpdatedMar 5, 2025
Python

athina-ai /athina-evals

Star271

Python SDK for running evaluations on LLM generated responses

evaluation evaluation-metrics evaluation-framework llmops llm-eval llm-ops llm-evaluation llm-evaluation-toolkit

UpdatedMar 17, 2025
Python

astronomer /ask-astro

Star217

An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

airflow astronomer llm llm-ops

UpdatedNov 25, 2024
Python

chatchat-space /LangGraph-Chatchat

Star89

agent agents fastapi llm langchain langchain-python langchain-agent llm-ops langgraph langgraph-python langchain-agents

UpdatedMar 7, 2025
Python

friendliai /friendli-client

Star42

Friendli: the fastest serving engine for generative AI

ai ml inference gpt inference-server mistral inference-engine serving mlops gpt3 llm stable-diffusion llms generative-ai llmops llm-serving llm-inference llama2 llm-ops

UpdatedJan 24, 2025
Python

YeonwooSung /MLOps

Sponsor

Star11

Miscellaneous codes and writings for MLOps

docker kubernetes aws ai spark ai-as-a-service multimodal spark-nlp rag mlops apache-iceberg bentoml ml-serving vector-database triton-inference-server data-intensive-applications llm vectordb llm-inference llm-ops

UpdatedMar 12, 2025
Jupyter Notebook

AndrMoura /streamlit-chatbot-analytics

Star6

Streamlit-based chatbot leveraging Ollama via LangChain and PostHog-LLM for advanced logging and monitoring

analytics chatbot chatbots chatbot-application streamlit llm langchain ollama llm-ops llama3 llm-observability

UpdatedMay 8, 2024
Python

prompt-foundry /typescript-sdk

Star5

The prompt engineering, prompt management, and prompt evaluation tool for TypeScript, JavaScript, and NodeJS.

typescript gpt open-ai gpt-3 gpt-4 llm prompt-engineering llmops prompt-testing prompt-manager prompt-management llm-eval llm-test llm-ops llm-evaluation prompt-evaluation

UpdatedSep 14, 2024
TypeScript

langgenius /dify-conversation

Star4

[🚧🚧🚧WIP🚧🚧 🚧]Rework of webapp-conversation

llm-ops

UpdatedJul 5, 2023
TypeScript

elotl /GenAI-infra-stack

Star4

Deployment of RAG + LLM model serving on multiple K8s cloud clusters

luna autoscaling genai llm-inference llm-ops genai-chatbot

UpdatedMar 18, 2025
Python

GlyphyAI /liteswarm

Star3

Lightweight Agent Framework for building AI apps with any LLM

multi-agent multi-agent-systems ai-agents agent-systems llm llm-ops llm-orchestration agent-ops

UpdatedJan 21, 2025
Python

flavienbwk /repochat-action

Sponsor

Star2

Deploy an AI-powered chatbot for your repo in under 2 minutes.

devops chatbot github-actions llm ai-ops llm-ops

UpdatedSep 13, 2024
JavaScript

tied-inc /eval-track

Sponsor

Star2

LLM-ML-Observability Toolkits and Serivces

ml observability llm llm-ops

UpdatedJan 11, 2025
TypeScript

willwoodward /woodwork-engine

Star1

An AI Agent IaC tool that aims to make developing and deploying AI Agents easier.

python ai python-package config-language mlops ai-agent llm ai-ops llm-ops ai-agent-framework

UpdatedFeb 27, 2025
Python

Improve this page

Add a description, image, and links to thellm-ops topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with thellm-ops topic, visit your repo's landing page and select "manage topics."

Learn more

Movatterモバイル変換

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

llm-ops

Here are 19 public repositories matching this topic...

bentoml /OpenLLM

julep-ai /julep

truefoundry /cognita

Marker-Inc-Korea /AutoRAG

lastmile-ai /aiconfig

EmbeddedLLM /JamAIBase

athina-ai /athina-evals

astronomer /ask-astro

chatchat-space /LangGraph-Chatchat

friendliai /friendli-client

YeonwooSung /MLOps

AndrMoura /streamlit-chatbot-analytics

prompt-foundry /typescript-sdk

langgenius /dify-conversation

elotl /GenAI-infra-stack

GlyphyAI /liteswarm

flavienbwk /repochat-action

tied-inc /eval-track

willwoodward /woodwork-engine

Improve this page

Add this topic to your repo