Commit2cd7712

committed

readme

1 parent6de58d3 commit2cd7712Copy full SHA for 2cd7712

File tree

-1

lines changed

-1

lines changed

Lines changed: 5 additions & 1 deletion

Original file line number	Diff line number	Diff line change
`@@ -7,7 +7,11 @@`
`7`	`7`	`[[中文]](README_cn.md)[English]`
`8`	`8`
`9`	`9`	`##1. Updates`
`10`		`-🔥 MFTCoder-accelerate supports latest implementation of CoBa Loss (selfpaced Loss) for better Convergence Balance.`
	`10`	`+🔥 MFTCoder-accelerate now supports DPO/ORPO training through xxpo module.`
	`11`	`+`
	`12`	`+🔥 MFTCoder-accelerate now supports continue training through mpt module along with offline_tokenization module.`
	`13`	`+`
	`14`	`+🔥 MFTCoder-accelerate supports MFT with latest implementation of CoBa Loss (selfpaced Loss) for better Convergence Balance.`
`11`	`15`
`12`	`16`	`🔥 MFTCoder-accelerate now support these modes: QLoRA/LoRA + DeepSpeed ZeRO2， QLoRA + DeepSpeed ZeRO3, Full-parameter + DeepSpeed ZeRO3, QLoRA + FSDP, Full-parameter + FSDP.`
`13`	`17`

Lines changed: 4 additions & 0 deletions

Original file line number	Diff line number	Diff line change
`@@ -7,6 +7,10 @@`
`7`	`7`	`[中文][[English]](README.md)`
`8`	`8`
`9`	`9`	`##1. 更新`
	`10`	`+🔥 MFTCoder-accelerate 增加了xxpo模块，支持dpo训练。`
	`11`	`+`
	`12`	`+🔥 MFTCoder-accelerate 增加了mpt模块，借助offline_tokenization模块，支持全量参数加训。`
	`13`	`+`
`10`	`14`	`🔥 MFTCoder-accelerate 增加了CoBa Loss的最新实现（原selfpaced Loss）, 让收敛均衡更进一步。`
`11`	`15`
`12`	`16`	`🔥 MFTCoder-accelerate 最新支持的训练模式包括: QLoRA/LoRA + DeepSpeed ZeRO2， QLoRA + DeepSpeed ZeRO3, 全量 + DeepSpeed ZeRO3, QLoRA + FSDP, 全量 + FSDP。`

Comments

(0)