Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Start agent traces#414

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Draft
aymeric-roucher wants to merge88 commits intomain
base:main
Choose a base branch
Loading
fromagent-traces
Draft
Changes from1 commit
Commits
Show all changes
88 commits
Select commitHold shift + click to select a range
352008b
Start agent traces
aymeric-roucherFeb 24, 2025
6c231d2
Working local version with o1
aymeric-roucherFeb 25, 2025
69b2651
Update api addr
aymeric-roucherFeb 26, 2025
ad948c2
Increase concurrent requests
aymeric-roucherFeb 26, 2025
a00f0ee
Update sbatch params
aymeric-roucherFeb 26, 2025
143fcfa
Add conda activation
aymeric-roucherFeb 26, 2025
0af9e75
Use local model
aymeric-roucherFeb 26, 2025
6cffffe
128 concurrent
aymeric-roucherFeb 26, 2025
cf13c2b
Log
aymeric-roucherFeb 26, 2025
cffa362
Add conda init
aymeric-roucherFeb 26, 2025
e35800c
Fix slurm script
aymeric-roucherFeb 26, 2025
b47a4be
Add await
aymeric-roucherFeb 26, 2025
0cd0999
Try fixing async func
aymeric-roucherFeb 26, 2025
dd15ad8
Add stop sequences
aymeric-roucherFeb 26, 2025
d2588cd
Add port
aymeric-roucherFeb 27, 2025
b738e58
Make synchronous
aymeric-roucherFeb 28, 2025
f78b865
Small adapts to script
aymeric-roucherFeb 28, 2025
cb2a2c2
More detailed error logging
aymeric-roucherFeb 28, 2025
9a2d16f
Even more detailed request error logging
aymeric-roucherFeb 28, 2025
2a1ff76
Reduce context length
aymeric-roucherFeb 28, 2025
a97eb27
Add token counting
aymeric-roucherFeb 28, 2025
d8cb19b
Fix message roles an add token counting
aymeric-roucherFeb 28, 2025
e42b1cd
Add dummy completion
aymeric-roucherFeb 28, 2025
83a679f
Test
aymeric-roucherFeb 28, 2025
d87e3f3
Running with gpt-4o
aymeric-roucherFeb 28, 2025
8e70ca4
Update timeouts
aymeric-roucherFeb 28, 2025
2876d52
Adjust
aymeric-roucherFeb 28, 2025
cf52433
Flatten messages
aymeric-roucherFeb 28, 2025
a07cd54
Prompt more around testing the function
aymeric-roucherFeb 28, 2025
ddc1cdd
Improve explanations in prompt
aymeric-roucherFeb 28, 2025
4c2fce6
Also store final outputs
aymeric-roucherMar 13, 2025
4a20ba4
Try Qwen Coder 32B
aymeric-roucherApr 2, 2025
6961c36
Remove some dependencies to work on mac
aymeric-roucherApr 3, 2025
2b1bc05
Merge branch 'main' into agent-traces
aymeric-roucherApr 3, 2025
38efcfc
Working trace generation with auto verification by running test cases
aymeric-roucherApr 3, 2025
b7522e3
Add training scripts for agents
aymeric-roucherApr 3, 2025
2ddf70e
Change job name
aymeric-roucherApr 3, 2025
49083cc
Intervert sft training configs
aymeric-roucherApr 3, 2025
de2b792
Point to proper config file
aymeric-roucherApr 3, 2025
5647c26
Add distributed type
aymeric-roucherApr 3, 2025
8a7951c
Revert to zero3 config
aymeric-roucherApr 3, 2025
d28d07b
Remove deepspeed config
aymeric-roucherApr 4, 2025
cae3c7c
Update train slurm
aymeric-roucherApr 4, 2025
2a08444
Switch to new venv
aymeric-roucherApr 8, 2025
1eaf1d1
Move script to proper file
aymeric-roucherApr 8, 2025
2043be9
Change job name
aymeric-roucherApr 8, 2025
2030e16
Increase epochs
aymeric-roucherApr 8, 2025
08a449c
Update dataset name
aymeric-roucherApr 9, 2025
60472f6
Increase epochs
aymeric-roucherApr 9, 2025
9347590
adding qwen 3b training setup
Apr 15, 2025
a66a5e6
Merge branch 'main' into agent-traces
aymeric-roucherJun 23, 2025
a9b5411
Add aguvis download script
aymeric-roucherJun 23, 2025
80f7ce8
Improve collection script
aymeric-roucherJun 23, 2025
984d631
Add Readme for agents
aymeric-roucherJun 23, 2025
a675552
Fix env variables
aymeric-roucherJun 23, 2025
fbd987c
Remove weka
aymeric-roucherJun 23, 2025
3aee6ef
Modify train slurm
aymeric-roucherJun 23, 2025
7cb592c
Remove parsing
aymeric-roucherJun 23, 2025
b7a700e
Revert training script to the good old time when it worked
aymeric-roucherJun 23, 2025
3b77977
Revert to new shitty script
aymeric-roucherJun 23, 2025
81c64ac
Change weka path
aymeric-roucherJun 23, 2025
eb39096
Try edit
aymeric-roucherJun 23, 2025
0ee52fc
Fix env
aymeric-roucherJun 23, 2025
c4d4126
Working SFT for text model
aymeric-roucherJun 24, 2025
3c3e954
Start adapting script for VLM training
aymeric-roucherJun 24, 2025
a452f2f
Impreove data collection script
aymeric-roucherJun 25, 2025
5fa7e51
Deactivate multinodes
aymeric-roucherJun 26, 2025
933ea92
Merge branch 'agent-traces' of github.com:huggingface/open-r1 into ag…
aymeric-roucherJun 26, 2025
a658db9
Fix sft collate function for vlms
aymeric-roucherJun 26, 2025
24ea112
Fix collate fn in sft.py
aymeric-roucherJun 26, 2025
db30467
Working VLM training 🥳
aymeric-roucherJun 26, 2025
5eadb06
Add single-GPU training script
aymeric-roucherJun 26, 2025
b316210
Add second dataset in mix
aymeric-roucherJun 26, 2025
2ba1c65
Add aguvis conversion script
aymeric-roucherJul 1, 2025
f6b8f7c
Conversion script
aymeric-roucherJul 1, 2025
22b84cf
Merge branch 'agent-traces' of github.com:huggingface/open-r1 into ag…
aymeric-roucherJul 1, 2025
035f134
Integrate aguvis conversion to smolagents
aymeric-roucherJul 1, 2025
f692c10
Try catch wrap for processing
aymeric-roucherJul 1, 2025
b0d794c
override existing split
aymeric-roucherJul 1, 2025
31cf3a2
Nit script args
aymeric-roucherJul 1, 2025
029dc60
Update train instructions
aymeric-roucherJul 3, 2025
880a585
Merge branch 'agent-traces' of github.com:huggingface/open-r1 into ag…
aymeric-roucherJul 3, 2025
1b50860
Remove merge artifact
aymeric-roucherJul 3, 2025
868d4a4
Small fixes in recipe
aymeric-roucherJul 9, 2025
4c83688
Modify aguvis conversion script
aymeric-roucherJul 9, 2025
6a63f2f
Unify conversion in only one script
aymeric-roucherJul 9, 2025
e8a4c2b
Update imports
aymeric-roucherJul 9, 2025
18fea48
Fix script
aymeric-roucherJul 10, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
PrevPrevious commit
NextNext commit
Try edit
  • Loading branch information
@aymeric-roucher
aymeric-roucher committedJun 23, 2025
commiteb39096a66dd5d08dca1da778ffb34d9137b52e0
7 changes: 6 additions & 1 deletionslurm/train.slurm
View file
Open in desktop
Original file line numberDiff line numberDiff line change
Expand Up@@ -38,7 +38,7 @@ echo "START TIME: $(date)"

# Refresh Weka on cache
echo "Refreshing Weka filesystem..."
find -L /fsx/aymeric/ -type f | xargs -d '\n' -r -n512 -P64 weka fs tier fetch
#find -L /fsx/aymeric/ -type f | xargs -d '\n' -r -n512 -P64 weka fs tier fetch

# Default values
MODEL=""
Expand DownExpand Up@@ -89,6 +89,11 @@ while [[ $# -gt 0 ]]; do
esac
done

export HF_DATASETS_CACHE="/fsx/aymeric/.cache/datasets"
export TRANSFORMERS_CACHE="/fsx/aymeric/.cache/transformers"
HF_DATASETS_CACHE="/fsx/aymeric/.cache/datasets"
TRANSFORMERS_CACHE="/fsx/aymeric/.cache/transformers"

# Validate required arguments
if [[ -z "$MODEL" || -z "$TASK" || -z "$CONFIG_SUFFIX" || -z "$ACCELERATOR" ]]; then
echo "Error: Missing required arguments"
Expand Down
Loading

[8]ページ先頭

©2009-2025 Movatter.jp