model-monitoring

Star

Here are 67 public repositories matching this topic...

Language:All

Filter by language

All67 Jupyter Notebook27 Python26 HTML2 Rust2 Java1 JavaScript1 PHP1 R1 TypeScript1

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

DataTalksClub /mlops-zoomcamp

Star13k

Free MLOps course from DataTalks.Club

machine-learning model-deployment mlops model-monitoring workflow-orchestration

UpdatedJul 2, 2025
Jupyter Notebook

evidentlyai /evidently

Star6.4k

Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

data-science machine-learning data-validation pandas-dataframe jupyter-notebook html-report hacktoberfest data-quality mlops model-monitoring data-drift llm generative-ai llmops

UpdatedJul 18, 2025
Jupyter Notebook

traceloop /openllmetry

Star6.1k

Open-source observability for your LLM application, based on OpenTelemetry

python open-source monitoring metrics ml datascience help-wanted observability good-first-issue artifical-intelligence model-monitoring opentelemetry open-telemetry opentelemetry-python llm good-first-issues generative-ai llmops

UpdatedJul 18, 2025
Python

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

python data-science machine-learning deep-learning data-validation pandas-dataframe jupyter-notebook ml pytorch html-report model-validation mlops model-monitoring data-drift

UpdatedJun 1, 2025
Python

NannyML /nannyml

Star2.1k

nannyml: post-deployment data science in python

visualization python data-science machine-learning monitoring deep-learning jupyter-notebook ml data-analysis machinelearning performance-monitoring performance-estimation mlops model-monitoring data-drift postdeploymentdatascience

UpdatedJul 12, 2025
Python

traceloop /openllmetry-js

Star341

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry

javascript open-source typescript monitoring metrics nextjs ml datascience observability model-monitoring opentelemetry opentelemetry-javascript generative-ai llmops

UpdatedJul 17, 2025
TypeScript

MAIF /eurybia

Star212

⚓ Eurybia monitors model drift over time and securizes model deployment with data validation

python machine-learning data-validation html-report drift domain-classifier production-machine-learning drift-detection model-monitoring data-drift model-drift datadrift-classifier

UpdatedOct 24, 2024
Jupyter Notebook

squaredev-io /whitebox

Star184

[Not Actively Maintained] Whitebox is an open source E2E ML monitoring platform with edge capabilities that plays nicely with kubernetes

python kubernetes machine-learning monitoring accuracy recall k8s confusion-matrix observability f1-score explainable-ai xai accuracy-score mlops mlflow accuracy-metrics explainability model-monitoring ml-monitoring modelops

UpdatedJul 11, 2023
Python

traceloop /hub

Star112

High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

rust open-source ml artificial-intelligence datascience observability model-monitoring opentelemetry llm generative-ai llmops

UpdatedJul 16, 2025
Rust

aws-samples /amazon-sagemaker-mlops-workshop

Star104

MLOps workshop with Amazon SageMaker

machine-learning sagemaker amazon-sagemaker sagemaker-deployment tensorflow2 model-monitoring sagemaker-processing sagemaker-studio mlops-workshop sagemaker-pipelines

UpdatedMar 25, 2025
Jupyter Notebook

evidentlyai /ml_observability_course

Star92

Free Open-source ML observability course for data scientists and ML engineers. Learn how to monitor and debug your ML models in production.

data-quality-checks data-quality production-machine-learning mlops model-monitoring machine-learning-operations model-performance data-drift ml-pipelines ml-monitoring ml-observability llmops

UpdatedDec 17, 2023
Jupyter Notebook

NimbleBoxAI /nbox

Star87

The official python package for NimbleBox. Exposes all APIs as CLIs and contains modules to make ML 🌸

data-science machine-learning model-management model-deployment model-serving ml-infrastructure mlops ml-service model-monitoring ml-platform practical-mlops mlops-workflow mlops-pipeline mlops-tool mlops-automation

UpdatedOct 2, 2023
Python

VectorInstitute /cyclops

Star85

A toolkit for evaluating and monitoring AI models in clinical settings

machine-learning deep-learning evaluation healthcare physionet mimic-iii electronic-health-record clinical-research eicu-crd clinical-data clinical-decision-support drift-detection model-monitoring data-drift omop-cdm mimic-iv electronic-medical-record

UpdatedJul 15, 2025
Python

awesome-mlops /awesome-ml-monitoring

Star81

A curated list of awesome open source tools and commercial products for monitoring data quality, monitoring model performance, and profiling data 🚀

data-science machine-learning deep-learning datascience dataops data-management data-cleaning model-management concept-drift data-quality aiops machine-learning-platform data-monitoring mlops model-monitoring model-performance data-drift model-explainability model-drift

UpdatedMay 7, 2024

aporia-ai /inferencedb

Star81

🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)

machine-learning kafka s3 model-serving mlops model-monitoring

UpdatedJun 10, 2022
Python

rstudio /vetiver-python

Star68

Version, share, deploy, and monitor models.

python model-versioning mlops model-monitoring model-deploy

UpdatedMar 21, 2025
Python

Arize-ai /client_python

Star55

A python library to send data to Arize AI!

performance-monitoring data-quality-monitoring model-monitoring ml-monitoring model-explainability ai-monitoring drift-monitoring ml-observability ai-observability model-performance-management ai-roi

UpdatedJul 17, 2025
Python

jomariya23156 /full-stack-on-prem-cv-mlops

Star46

"1 config, 1 command from Jupyter Notebook to serve Millions of users", Full-stack On-Premises MLOps system for Computer Vision from Data versioning to Model monitoring and drift detection.