- Notifications
You must be signed in to change notification settings - Fork9
Kylel/olmo2 anneals code#139
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.
Already on GitHub?Sign in to your account
Open
kyleclo wants to merge25 commits intomainChoose a base branch
base:main
Could not load branches
Branch not found:{{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline, and old review comments may become outdated.
Uh oh!
There was an error while loading.Please reload this page.
Open
Changes from1 commit
Commits
Show all changes
25 commits Select commitHold shift + click to select a range
a24a47d fim-stackedu anneal config
undfined9e1b471 Match seqlen
undfined8f984eb Typo
undfined37b5d03 Typo again
undfinedbce4402 Reduce workers when counting, old seqlen
undfinedf9863c8 4096
undfined01492fd Adds hq filtered fim ablation
undfined1d17369 Merge branch 'main' of github.com:allenai/olmo-cookbook into undfined…
undfined1559882 olmo 2 on olmo 3 data
kyleclo83f4331 oop
kylecloe4dc168 baseline olmo 2 patching code
kyleclo5ff03c0 rename
kyleclof074a28 rename
kylecloe32a8a8 rename
kyleclo58f2979 add dolminos baseline
kyleclo0cca818 50b run to compare w 50b dolminos
kyleclo7f4a130 50b anneal for olmo 2 on new data
kyleclo7ebe743 oops ratios should sum to 1.0
kyleclo86d80be 100b run
kyleclo3365483 fix 100b runs
kyleclo661ac7f increase microbatch
kylecloac0e003 back to 8192
kyleclod6e5b51 restore trainer state from save folder
epwalshfa4e8b0 also make ckpting less chatty (see https://github.com/allenai/olmo-co…
kyleclof83559f remove optional cancel_check_interval
kylecloFile filter
Filter by extension
Conversations
Failed to load comments.
Loading
Uh oh!
There was an error while loading.Please reload this page.
Jump to
Jump to file
Failed to load files.
Loading
Uh oh!
There was an error while loading.Please reload this page.
Diff view
Diff view
oop
- Loading branch information
Uh oh!
There was an error while loading.Please reload this page.
commit83f43310c0eb1141e36b2d3e337eb0a94effbb2f
There are no files selected for viewing
36 changes: 0 additions & 36 deletions...ookbook/recipes/spring2code/mid-training/baseline-olmo2_7b-928646-anneal-100B-dolma2.yaml
This file was deleted.
Oops, something went wrong.
Uh oh!
There was an error while loading.Please reload this page.
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.