#
zero3
Here is 1 public repository matching this topic...
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
pytorchmulti-modalgemmapipeline-parallelismtransformers-modelstensor-parallelismllavallm-traininginternlmflash-attentionzero3llm-frameworksequence-parallelisminternlm2ring-attentiondeepspeed-ulyssesllama3910b
- Updated
Mar 14, 2025 - Python
Improve this page
Add a description, image, and links to thezero3 topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with thezero3 topic, visit your repo's landing page and select "manage topics."