megatron

Here are 10 public repositories matching this topic...

Language:All

Filter by language

modelscope /ms-swift

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 500+ LLMs (Qwen3, Qwen3-MoE, Llama4, InternLM3, GLM4, Mistral, Yi1.5, DeepSeek-R1, ...) and 200+ MLLMs (Qwen2.5-VL, Qwen2.5-Omni, Qwen2-Audio, Ovis2, InternVL3, Llava, MiniCPM-V-2.6, GLM4v, Xcomposer2.5, DeepSeek-VL2, Phi4, GOT-OCR2, ...).

deploy llama lora embedding omni liger peft multimodal sft megatron rft llm internvl qwen2-vl deepseek-r1 grpo open-r1 qwen3 llama4 qwen3-moe

UpdatedApr 28, 2025
Python

eyaadh /megadlbot_oss

Star184

Megatron was a telegram file management bot that helped a lot of users, specially movie channel managers to upload their files to telegram by just providing a link to it. The project initially started as roanuedhuru_bot which lately retired and came back as Megatron which was a side project of the famous Maldivian Telegram community -@baivaru u…

bot mongodb telegram ffmpeg pymongo youtube-dl aiohttp ffprobe aiofiles pyrogram megatron google-python-api seedr megadlbot tgcrypto

UpdatedJun 27, 2021
Python

xrsrke /pipegoose

Star82

Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*

transformers moe data-parallelism distributed-optimizers model-parallelism megatron mixture-of-experts pipeline-parallelism huggingface-transformers megatron-lm tensor-parallelism large-scale-language-modeling 3d-parallelism zero-1 sequence-parallelism

UpdatedDec 14, 2023
Python

MoFHeka /LLaMA-Megatron

Star28

A LLaMA1/LLaMA12 Megatron implement.

pytorch llama megatron megatron-lm llm llm-training llama2

UpdatedDec 13, 2023
Python

Sh-Jil /megadlbot

Star3

bot mongodb telegram ffmpeg youtube-dl ffprobe pyrogram megatron google-python-api seedr megadlbot tgcrypto

UpdatedApr 21, 2021
Python

liangyuwang /Tiny-Megatron

Star3

Tiny-Megatron, a minimalistic re-implementation of the Megatron library

deep-learning distributed-computing gpt megatron large-language-models

UpdatedAug 6, 2024
Python

future-wd /course-hugo-bootstrap-introduction

Star1

A course which takes you through the entire process of setting up a Hugo project with Bootstrap. It also teaches you the basics of bootstrap to get you up and running.

css html bootstrap pagination hero tutorial hugo copyright footer megatron