distributed-data-parallel

Code for Active Learning at The ImageNet Scale. This repository implements many popular active learning algorithms and allows training with torch's DDP.

active-learning pytorch-implementation distributed-data-parallel

UpdatedNov 29, 2021
Python

TigerJeffX /Transformers-in-pytorch

Star25

transformer imagenet neural-machine-translation cifar10 pytorch-implementation multi30k mixed-precision-training distributed-data-parallel vision-transformer

UpdatedDec 31, 2022
Python

tyui592 /Real_Time_Helmet_Detection

Star11

Helmet Detector based on the CenterNet.

pytorch object-detection pytorch-implementation helmet-detection centernet automatic-mixed-precision distributed-data-parallel

UpdatedJan 30, 2022
Python

A simple API to launch Python functions to run on multiple ranked processes, mpify is designed to enable interactive multiprocessing experiments in Jupyter/IPython, such as distributed data parallel training over multiple GPUs.

python multiprocessing parallel pytorch multiprocess context-manager distributed-data-parallel

UpdatedSep 29, 2020
Python

ahmdtaha /distributed_sigmoid_loss

Star10

Unofficial implementation for Sigmoid Loss for Language Image Pre-Training

python3 pytorch unsupervised-learning vision-and-language multimodal-deep-learning self-supervised-learning vision-language contrastive-learning distributed-data-parallel vision-transformer vision-language-pretraining

UpdatedSep 26, 2023
Python

garg-aayush /pytorch-pl-hydra-templates

Star6

Different template codes for Deep Learning with PyTorch.

deep-learning pytorch vgg imagenet tensorboard resnet alexnet cifar-10 cnn-classification pytorch-lightning distributed-data-parallel

UpdatedMay 11, 2022
Python

nwangfw /nerf_ddp

Star6

pytorch nerf distributed-training neural-radiance-fields distributed-data-parallel

UpdatedOct 19, 2022
Jupyter Notebook

zjykzj /pytorch-distributed

Star4

demo for pytorch-distributed

amp pytorch distributed mixed-precision-training distributed-data-parallel distributeddataparallel hybrid-precision-training

UpdatedFeb 9, 2022
Python

zjykzj /YOLOv5

Star3

A Tiny Version of the Original ultralytics/yolov5

python opencv pytorch yolo mosaic onnx yolov3 mixed-precision-training yolov5 distributed-data-parallel

UpdatedMay 5, 2025
Python

ofanan /accessStrategies

Star3

This is a simulator for access strategies for distributed caching. The simulator considers a user who is equipped by several caches, and receives from them periodical updates about the cached content. The problem and algorithms implemented here are detailed in the paper: I. Cohen, G. Einziger, R. Friedman, and G. Scalosub, “Access Strategies for…

distributed-database indicator bloomfilter cache-simulation distributed-data-parallel

UpdatedOct 7, 2024
Python

zjykzj /YOLOv1

Star1

[CVPR 2016]You Only Look Once: Unified, Real-Time Object Detection

python pytorch apex yolo imagenet nvidia-docker pascal-voc yolov1 mixed-precision nvidia-apex distributed-data-parallel yolov1-loss

UpdatedJul 9, 2023
Python

zjykzj /YOLOv3

Star0

YOLOv3: An Incremental Improvement

python pytorch apex coco nvidia-docker pascal-voc yolov2 fpn yolov3 darknet53 yolov5 distributed-data-parallel yolov3-loss

UpdatedSep 7, 2024
Python

PouriaRouzrokh /PyTorch_Template_Project

Sponsor

Star0

This repository is intended to be a template for starting new projects with PyTorch, in which deep learning models are trained and evaluated on medical imaging data.

python template computer-vision deep-learning pytorch distributed-data-parallel

UpdatedJul 7, 2022
Jupyter Notebook

RamonKaspar /Large-Scale-AI-Engineering-Project

Star0

Final project of the course "Large Scale AI Engineering" at ETH Zürich, FS2025. Implementation and benchmarking of pretokenization and Distributed Data Parallel (DDP) for efficient LLM training on the CSCS Alps supercomputer.

transformers tokenization hpc-cluster distributed-data-parallel cscs llm pretokenization padding-free