Managing Computing Resources with Slurm for Multiple Courses Usage

In this work, we present a scalable and fair resource management solution to support multiple courses. We replace the previous direct-access system with Slurm, a widely used workload manager, to improve fairness, utilization, and manageability. The deployment is automated using IaC tools, including PXE and Ansible, enabling us to provision a fully functional Slurm cluster from operating system in minutes. To support diverse software requirements across courses, we integrate package managers such as Guix and Conda, ensuring consistent and reproducible runtime environments. We further employ Slurm’s QOS features to enforce per-user resource limits and multifactor scheduling policy. Our system has been deployed in the Spring 2025 semester to support the Parallel Programming course, with 49 active users and approximately 92,000 job submissions. Despite the high demand, our analysis shows that fewer than $\mathbf{1 0}$ nodes were sufficient to handle the workload, demonstrating the effectiveness of proposed architecture.

Authors

Institutions

Publication Details

Published
2025-09-22
DOI
https://doi.org/10.23919/apnoms67058.2025.11181353
Primary Topic
Distributed and Parallel Computing Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Managing Computing Resources with Slurm for Multiple Courses Usage

Meng‐Hsun Tsai, Huan-Chang Hung, Biing‐Shiun Huang, Pei-Hsun Kuan
Distributed and Parallel Computing Systems
article

Managing Computing Resources with Slurm for Multiple Courses Usage

Meng‐Hsun Tsai, Huan-Chang Hung, Biing‐Shiun Huang, Pei-Hsun Kuan
article en

Abstract

In this work, we present a scalable and fair resource management solution to support multiple courses. We replace the previous direct-access system with Slurm, a widely used workload manager, to improve fairness, utilization, and manageability. The deployment is automated using IaC tools, including PXE and Ansible, enabling us to provision a fully functional Slurm cluster from operating system in minutes. To support diverse software requirements across courses, we integrate package managers such as Guix and Conda, ensuring consistent and reproducible runtime environments. We further employ Slurm’s QOS features to enforce per-user resource limits and multifactor scheduling policy. Our system has been deployed in the Spring 2025 semester to support the Parallel Programming course, with 49 active users and approximately 92,000 job submissions. Despite the high demand, our analysis shows that fewer than $\mathbf{1 0}$ nodes were sufficient to handle the workload, demonstrating the effectiveness of proposed architecture.

National Yang Ming Chiao Tung University (TW)
Openalex Percentile: Top 67%
Distributed and Parallel Computing Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.