MFTCoder v0.3.0: Support more open source models, support Self-Paced Loss, support FSDP

Compare

Choose a tag to compare

chencyudel released this 19 Jan 11:16

· 54 commits to main since this release

This commit was created on GitHub.com and signed with GitHub’sverified signature.

GPG key ID:B5690EEEBB952194

Verified

Mainly forMFTCoder-accelerate.
It now supports more open source models like Mistral, Mixtral(MoE), DeepSeek-coder, chatglm3.
It supports FSDP as an option.
It also supports Self-paced Loss as a solution for convergence balance in Multitask Fine-tuning.

Assets2

Movatterモバイル変換