Machine Learning Engineering Open Book
A DSL for data-driven computational pipelines
Slurm: A Highly Scalable Workload Manager
A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
A Slurm cluster using docker-compose
Best practices & guides on how to write distributed pytorch training code
Simplify HPC and Batch workloads on Azure
A scheduler for GPU/CPU tasks
Prometheus exporter for performance metrics from Slurm.
An open-source toolkit for deploying and managing high performance clusters for HPC, AI, and data analytics workloads.
Lightweight fast function pipeline (DAG) creation in pure Python for scientific workflows 🕸️🧪
Tools for computation on batch systems
SEML: Slurm Experiment Management Library
Add a description, image, and links to the slurm topic page so that developers can more easily learn about it.
To associate your repository with the slurm topic, visit your repo's landing page and select "manage topics."