interpretability

Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.

machine-learning computer-vision deep-learning grad-cam pytorch image-classification object-detection visualizations interpretability class-activation-maps interpretable-deep-learning interpretable-ai explainable-ai explainable-ml xai score-cam vision-transformers

UpdatedApr 7, 2025
Python

interpretml /interpret

Star6.5k

Fit interpretable models. Explain blackbox machine learning.

machine-learning ai scikit-learn artificial-intelligence transparency blackbox bias differential-privacy gradient-boosting interpretability interpretable-ai interpretable-ml explainable-ai explainable-ml xai interpretable-machine-learning iml explainability interpretml

UpdatedApr 25, 2025
C++

pytorch /captum

Star5.2k

Model interpretability and understanding for PyTorch

interpretability feature-importance interpretable-ai interpretable-ml feature-attribution

UpdatedMay 2, 2025
Python

tensorflow /lucid

Star4.7k

A collection of infrastructure and tools for research in neural network interpretability.

visualization machine-learning tensorflow jupyter-notebook colab interpretability

UpdatedFeb 6, 2023
Jupyter Notebook

jphall663 /awesome-machine-learning-interpretability

Star3.8k

A curated list of awesome responsible machine learning resources.

python data-science machine-learning awesome r awesome-list transparency fairness ai-safety privacy-enhancing-technologies interpretability interpretable-ai interpretable-ml explainable-ml xai interpretable-machine-learning privacy-preserving-machine-learning machine-learning-interpretability secure-ml reliable-ai

UpdatedApr 17, 2025

stellargraph /stellargraph

Star3k

StellarGraph - Machine Learning on Graphs

python data-science machine-learning deep-learning graphs machine-learning-algorithms networkx graph-data graph-analysis graph-machine-learning link-prediction graph-convolutional-networks gcn saliency-map interpretability geometric-deep-learning graph-neural-networks heterogeneous-networks stellargraph-library

UpdatedApr 10, 2024
Python

MAIF /shapash

Star2.9k

🔅 Shapash: User-friendly Explainability and Interpretability to Develop Reliable and Transparent Machine Learning Models

python machine-learning transparency lime interpretability ethical-artificial-intelligence explainable-ml shap explainability

UpdatedApr 25, 2025
Jupyter Notebook

SeldonIO /alibi

Star2.5k

Algorithms for explaining machine learning models

machine-learning interpretability counterfactual explanations xai

UpdatedApr 4, 2025
Python

frgfm /torch-cam

Sponsor

Star2.2k

Class activation maps for your PyTorch models (CAM, Grad-CAM, Grad-CAM++, Smooth Grad-CAM++, Score-CAM, SS-CAM, IS-CAM, XGrad-CAM, Layer-CAM)

python deep-learning grad-cam cnn pytorch saliency-map interpretability smoothgrad interpretable-deep-learning gradcam activation-maps class-activation-map gradcam-plus-plus score-cam

UpdatedMay 2, 2025
Python

chaoyanghe /Awesome-Federated-Learning

Star2k

FedML - The Research and Production Integrated Federated Learning Library:https://fedml.ai

machine-learning privacy computer-vision semi-supervised-learning transfer-learning wireless-communication distributed-optimization interpretability neural-architecture-search federated-learning continual-learning vertical-federated-learning non-iid decentralized-federated-learning hierarchical-federated-learning adversarial-attack-and-defense communication-efficiency straggler-problem computation-efficiency incentive-mechanism

UpdatedSep 3, 2022

google-deepmind /penzai

Star1.8k

A JAX research toolkit for building, editing, and visualizing neural networks.

visualization neural-networks interpretability fine-tuning jax

UpdatedApr 26, 2025
Python

ramprs /grad-cam

Star1.6k

[ICCV 2017] Torch code for Grad-CAM

deep-learning heatmap grad-cam convolutional-neural-networks interpretability iccv17 visual-explanation

UpdatedSep 17, 2022
Lua

microsoft /responsible-ai-toolbox

Star1.5k

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.