Repository files navigation

Code for in-loop evaluation tasks used by the OLMo training team.

pip install ai2-olmo-eval

1. Update the version insrc/olmo_eval/version.py.

2. Run the release script:

   ./src/scripts/release.sh

   This will commit the changes to the CHANGELOG andversion.py files and then create a new tag in gitwhich will trigger a workflow on GitHub Actions that handles the rest.

If for some reason the GitHub Actions release workflow failed with an error that needs to be fixed, you'll have to delete the tag on GitHub. Once you've pushed a fix you can simply repeat the steps above.