Machine Learning Engineering Open Book

• UpdatedMar 9, 2025
• Python

Slurm: A Highly Scalable Workload Manager

• UpdatedMar 14, 2025
• C

A DSL for data-driven computational pipelines

• UpdatedMar 16, 2025
• Groovy

Python 3.8+ toolbox for submitting jobs to Slurm

• UpdatedSep 18, 2024
• Python

A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.

• UpdatedMar 15, 2025
• Python

Python Interface to Slurm

• UpdatedFeb 2, 2025
• Cython

Open source web interface for Slurm HPC clusters

• UpdatedMar 17, 2025
• Python

Best practices & guides on how to write distributed pytorch training code

• UpdatedFeb 24, 2025
• Python

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

• UpdatedMar 17, 2025
• Python

A Slurm cluster using docker-compose

• UpdatedSep 27, 2024
• Dockerfile

Lightweight fast function pipeline (DAG) creation in pure Python for scientific workflows 🕸️🧪

• UpdatedMar 14, 2025
• Python

Create clusters of VMs on the cloud and configure them with Ansible.

• UpdatedSep 11, 2023
• Python

A scheduler for GPU/CPU tasks

• UpdatedMar 6, 2024
• C

Simplify HPC and Batch workloads on Azure

• UpdatedMar 20, 2023
• Python

A Cross-Platform, Multi-Cloud High-Performance Computing Platform

• UpdatedJan 27, 2025
• C

Prometheus exporter for performance metrics from Slurm.

• UpdatedJun 20, 2024
• Go

An open-source toolkit for deploying and managing high performance clusters for HPC, AI, and data analytics workloads.

• UpdatedMar 17, 2025
• YAML

Run Slurm in Kubernetes

• UpdatedMar 14, 2025
• Go

SEML: Slurm Experiment Management Library

• UpdatedNov 7, 2024
• Python

Tools for computation on batch systems

• UpdatedJan 9, 2024
• R