cv2.projectPoints takes very long because it always calculates and returns a jacobian matrix, which is huge for millions of points. It would be nice to just skip the calculation to only get the projected points