PinnedLoading

1. transformers-in-supercomputerstransformers-in-supercomputersPublic

   Transformers training in a supercomputer with the 🤗 Stack and Slurm

   Python 14

2. MN5-Distributed-PyTorchMN5-Distributed-PyTorchPublic

   Entry point for developing distributed applications with PyTorch, Slurm and Singularity on MareNostrum5 Supercomputer

   Shell 1

3. Megatron-LMMegatron-LMPublic

   Forked fromNVIDIA/Megatron-LM

   Debugging Megatron. 3D Parallelism, models, training and more!

   Python 2

4. nanotronnanotronPublic

   Forked fromswiss-ai/nanotron

   Minimalistic large language model 3D-parallelism training

   Python