Repository files navigation

This repository contains code and scripts for the following paper:

Concept Bottleneck Models

Pang Wei Koh*, Thao Nguyen*, Yew Siang Tang*, Stephen Mussmann, Emma Pierson, Been Kim, and Percy Liang

ICML 2020

The experiments use the following datasets:

• NIH Osteoarthritis Initiative (OAI)
• Caltech-UCSD Birds 200 (CUB)

To download the TravelingBirds dataset, which we use to test robustness to background shifts, please download theCUB_fixed folder from thisCodaLab bundle by clicking on the download button. If you use this dataset, please also cite the original CUB and Places datasets.

The NIH Osteoarthritis Initiative (OAI) dataset requires an application for data access, so we are unable to provide the raw data here. To access that data, please first obtain data access permission from theOsteoarthritis Initiative, and then refer to thisGithub repository for data processing code. If you use it, please cite the Pierson et al. paper corresponding to that repository as well.

Here, we focus on scripts replicating our results on CUB, which is public. We provide an executable, Dockerized version of those experiments onCodaLab.

We seek to learn models that we can interact with using high-level concepts:would the model predict severe arthritis if it thinks there is a bone spur in the x-ray?State-of-the-art models today do not typically support the manipulation of concepts like "the existence of bone spurs",as they are trained end-to-end to go directly from raw input (e.g., pixels) to output (e.g., arthritis severity).We revisit the classic idea of first predicting concepts that are provided at training time,and then using these concepts to predict the label.By construction, we can intervene on theseconcept bottleneck modelsby editing their predicted concept values and propagating these changes to the final prediction.On x-ray grading and bird identification, concept bottleneck models achieve competitive accuracy with standard end-to-end models,while enabling interpretation in terms of high-level clinical concepts ("bone spurs") or bird attributes ("wing color").These models also allow for richer human-model interaction: accuracy improves significantly if we can correct model mistakes on concepts at test time.

We used the same environment as Codalab's default gpu setting, please runpip install -r requirements.txt. Main packages are:

• matplotlib 3.1.1
• numpy 1.17.1
• pandas 0.25.1
• Pillow 6.2.2
• scipy 1.3.1
• scikit-learn 0.21.3
• torch 1.1.0
• torchvision 0.4.0

Note that we updated Pillow and removed tensorflow-gpu and tensorboard from requirements.txt.

You can pull the Docker image directly from Docker Hub.

docker pull codalab/default-gpu

Standard task training for CUB can be ran using thescripts/experiments.sh and Codalab scripts can be ran usingscripts/codalab_experiments.sh. More information about how to perform data processing and other evaluations can be found in the README inCUB/.