Movatterモバイル変換

Skip to content

#

data-parallelism

Here are 54 public repositories matching this topic...

Language:All

Filter by language

All54 Python23 Jupyter Notebook7 C6 C++6 Rust3 C#1 Cuda1 Erlang1 Java1 Julia1

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

ColossalAI

hpcaitech /ColossalAI

Making large AI models cheaper, faster and more accessible

ai deep-learning hpc distributed-computing inference big-model large-scale data-parallelism model-parallelism pipeline-parallelism foundation-models heterogeneous-training

UpdatedMar 27, 2025
Python

deepspeedai /DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

machine-learning compression deep-learning gpu inference pytorch zero data-parallelism model-parallelism mixture-of-experts pipeline-parallelism billion-parameters trillion-parameters

UpdatedMar 27, 2025
Python

cerndb /dist-keras

Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.

data-science machine-learning apache-spark deep-learning hadoop tensorflow keras optimization-algorithms data-parallelism distributed-optimizers

UpdatedJul 25, 2018
Python

mratsim /weave

A state-of-the-art multithreading runtime: message-passing based, fast, scalable, ultra-low overhead

runtime scheduler openmp multithreading parallelism task-scheduler message-passing threadpool data-parallelism fork-join work-stealing task-parallelism

UpdatedJun 29, 2024
Nim

PaddlePaddle /PaddleFleetX

飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。

benchmark cloud lightning elastic unsupervised-learning large-scale data-parallelism paddlepaddle model-parallelism distributed-algorithm self-supervised-learning pipeline-parallelism pretraining fleet-api paddlecloud

UpdatedMay 24, 2024
Python

Oneflow-Inc /libai

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training

nlp deep-learning transformer large-scale data-parallelism model-parallelism distributed-training self-supervised-learning oneflow pipeline-parallelism vision-transformer

UpdatedMar 21, 2025
Python

alibaba /EasyParallelLibrary

Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.

deep-learning gpu memory-efficient data-parallelism model-parallelism distributed-training pipeline-parallelism

UpdatedMar 31, 2023
Python

dkeras

dkeras-project /dkeras

Distributed Keras Engine, Make Keras faster with only one line of code.

python distributed-systems machine-learning deep-neural-networks deep-learning neural-network tensorflow parallel-computing keras distributed ray keras-models keras-classification-models keras-neural-networks tensorflow-models keras-tensorflow data-parallelism distributed-deep-learning distributed-keras-engine plaidml

UpdatedOct 3, 2019
Python

wenwei202 /terngrad

Ternary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)

deep-neural-networks deep-learning sgd quantization data-parallelism distributed-training

UpdatedNov 19, 2018
Python

orkhon

vertexclique /orkhon

Orkhon: ML Inference Framework and Server Runtime

machine-learning async tensorflow multiprocessing python3 inference-server data-parallelism

UpdatedFeb 1, 2021
Rust

xrsrke /pipegoose

Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*

transformers moe data-parallelism distributed-optimizers model-parallelism megatron mixture-of-experts pipeline-parallelism huggingface-transformers megatron-lm tensor-parallelism large-scale-language-modeling 3d-parallelism zero-1 sequence-parallelism

UpdatedDec 14, 2023
Python

hkproj /pytorch-transformer-distributed

Distributed training (multi-node) of a Transformer model

machine-learning tutorial deep-learning pytorch data-parallelism model-parallelism distributed-training gradient-accumulation distributed-data-parallel collective-communication

UpdatedApr 10, 2024
Python

kuixu /keras_multi_gpu

Multi-GPU training for Keras

keras multi-gpu data-parallelism

UpdatedJun 23, 2017
Python

NERSC /sc23-dl-tutorial

SC23 Deep Learning at Scale Tutorial Material

deep-learning data-parallelism model-parallelism vision-transformers ai-for-science

UpdatedSep 16, 2024
Python

NERSC /dl-at-scale-training

Deep Learning at Scale Training Event at NERSC

deep-learning hpc data-parallelism performance-optimization model-parallelism

UpdatedMar 3, 2025
Python

ryantd /veloce

WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.

sparsity deep-learning distributed-computing pytorch distributed ray data-parallelism parameter-server heterogeneity model-parallelism

UpdatedAug 4, 2022
Python

tcoppex /cpu-gbfilter

♨️ Optimized Gaussian blur filter on CPU.

openmp image-processing blur data-parallelism multithreaded gaussian-blur bmp-image cache-efficiency

UpdatedDec 12, 2017
C++

daekeun-ml /sm-distributed-training-step-by-step

This repository provides hands-on labs on PyTorch-based Distributed Training and SageMaker Distributed Training. It is written to make it easy for beginners to get started, and guides you through step-by-step modifications to the code based on the most basic BERT use cases.

data-parallelism distributed-training sagemaker pytorch-ddp

UpdatedJul 18, 2023
Jupyter Notebook

yangyang14641 /Parallel-Matrix-Multiplication-FOX-Algorithm

☕Implement of Parallel Matrix Multiplication Methods Using FOX Algorithm on Peking University's High-performance Computing System

openmp mpi intel matrix-multiplication high-performance-computing parallel-algorithm algorithm-analysis data-parallelism supercomputing fox-algorithm

UpdatedJan 28, 2019
C

AlibabaPAI /FlashModels

Fast and easy distributed model training examples.

deep-learning pytorch zero data-parallelism model-parallelism distributed-training xla tensor-parallelism llm fsdp sequence-parallelism

UpdatedNov 26, 2024
Python

Improve this page

Add a description, image, and links to thedata-parallelism topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with thedata-parallelism topic, visit your repo's landing page and select "manage topics."

[8]ページ先頭

©2009-2025 Movatter.jp