model-parallel

Here are 7 public repositories matching this topic...

Language:All

Filter by language

cavalleria /cavaface

face recognition training project(pytorch)

network pytorch apex face-recognition loss mixup arcface amsoftmax cosface dataparallel efficientnet randaugment ghostnet resnest model-parallel circleloss arcnegface attention-irse resnet-irse curricularface

UpdatedNov 12, 2021
Python

Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.

fine-tuning pipeline-parallelism pretraining model-parallel deepspeed mllm multimodal-large-language-models qwen video-large-language-models video-language-model

UpdatedMar 10, 2025
Jupyter Notebook

PaddlePaddle /PLSC

Star152

Paddle Large Scale Classification Tools，supports ArcFace, CosFace, PartialFC, Data Parallel + Model Parallel. Model includes ResNet, ViT, Swin, DeiT, CaiT, FaceViT, MoCo, MAE, ConvMAE, CAE.

face-recognition resnet vit data-parallel large-scale paddle mae paddlepaddle distributed-training arcface cosface model-parallel deit swin-transformer cait hight-speed partial-fc facevit moco-v3 convmae

UpdatedJun 6, 2023
Python

bindog /pytorch-model-parallel

Star84

A memory balanced and communication efficient FullyConnected layer with CrossEntropyLoss model parallel implementation in PyTorch

pytorch half-precision re-id distributed-training model-parallel

UpdatedJun 11, 2020
Python

4paradigm /OpenEmbedding

Star32

OpenEmbedding is an open source framework for Tensorflow distributed training acceleration.

tensorflow tensorflow-training parameter-server distributed-training model-parallel embedding-layers

UpdatedApr 13, 2023
C++

knagrecha /hydra

Star20

Execution framework for multi-task model parallelism. Enables the training of arbitrarily large models with a single GPU, with linear speedups for multi-gpu multi-task execution.

machine-learning deep-learning gpu distributed-computing pytorch machine-learning-library task-parallel systems-engineering large-scale-machine-learning model-parallel