slurm

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

python kubernetes components machine-learning airflow deep-learning slurm pipelines pytorch ray aws-batch distributed-training

Updated Sep 14, 2022
Python

mllg / batchtools

Star

Tools for computation on batch systems

cran r hpc docker-swarm parallel-computing slurm sge torque lsf openlava high-performance-computing reproducibility hpc-clusters batchjobs batchexperiments

Updated Dec 14, 2021
R

dellhpc / omnia

Star

An open-source toolkit for deploying and managing high performance clusters for HPC, AI, and data analytics workloads.

kubernetes ansible hpc slurm ansible-playbooks hpc-clusters dell-emc k8s-cluster slurm-cluster dellemc

Updated Sep 6, 2022
YAML

vpenso / prometheus-slurm-exporter

Star

Prometheus exporter for performance metrics from Slurm.

slurm prometheus-exporter

Updated Sep 9, 2022
Go

mschubert / clustermq

Star

R package to send function calls as jobs on LSF, SGE, Slurm, PBS/Torque, or each via SSH

ssh cluster slurm sge lsf high-performance-computing r-package

Updated Aug 9, 2022
R

gdikov / hypertunity

Star

A toolset for black-box hyperparameter optimisation.

slurm hyperparameter-optimization tensorboard bayesian-optimization gpyopt

Updated Jan 26, 2020
Python

TUM-DAML / seml

Star

SEML: Slurm Experiment Management Library

utility slurm hyperparameter-optimization slurm-workload-manager experiment-tracking

Updated Sep 9, 2022
Python

ohsu-comp-bio / funnel

Star

Funnel is a toolkit for distributed task execution via a simple, standard API.

docker kubernetes google-cloud slurm gridengine ga4gh aws-batch pbs-torque

Updated Aug 23, 2022
Go

sylabs / wlm-operator

Star

Singularity implementation of k8s operator for interacting with SLURM.

kubernetes hpc slurm singularity k8s kubernetes-operator

Updated Dec 29, 2020
Go

SciDAS / slurm-in-docker

Star

Slurm in Docker - Exploring Slurm using CentOS 7 based Docker images

docker hpc cluster centos slurm centos7 openmpi lmod rpm-packages

Updated Oct 24, 2019
Shell

HenrikBengtsson / future.batchtools

Star

🚀 R package future.batchtools: A Future API for Parallel and Distributed Processing using batchtools

package r hpc job-scheduler parallel distributed-computing slurm sge torque pbs

Updated Aug 27, 2022
R

justanhduc / task-spooler

Star

A scheduler for GPU/CPU tasks

c linux debian cpp makefile job-scheduler slurm-job slurm slurm-job-scheduler gpu-support task-spooler

Updated Aug 24, 2022
C

giovtorres / docker-centos7-slurm

Star

Slurm Docker Container on CentOS 7

docker hpc centos slurm centos7

Updated Jun 2, 2022
Python

Improve this page

Add a description, image, and links to the slurm topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the slurm topic, visit your repo's landing page and select "manage topics."

Learn more