See#1442

We had a change which broke the Read The Docs (RTD) build.

We should have a way to mimic the RTD build in our CI so that in the future we don't accidentally break the RTD builds. I'm not sure how to do that but hopefully someone else knows.