The autodeploy feature deploys the newly trained model only if thef1 score is higher than the model that is currently deployed. However, there can be cases where we aren't able to compute thef1 score, such as when the test set only contains positive labels (results in divide by zero). This can happen if the training data is sorted by labels in Postgres andtest_sampling => 'first', or if its just a horribly unbalanced training set and some bad luck withtest_sampling => 'random'.

In either case, there's legitimate reasons that the f1 score does not exist. So, rather than crash we can do two things;

1. not supersede the currently deployed -- if we cant compute the metrics, I think its safe to assume its not better than the currently deployed model
2. give user a meaningful warning log so they can troubleshoot