HPC Scheduling Method Based on Debug and Background Job Classes Division

HPC users usually share supercomputer resources by submitting their jobs to the queue. The job management system scheduler forms job schedule for the supercomputer nodes. There are three widespread scheduling principles: assigning jobs fixed parameters such as number of nodes or cores and execution time, the priority non-preemptive ‘‘fair share’’ scheduling, and using one of backfilling strategies. The article presents the scheduling method based on these principles. The special feature of the proposed method is the division of the input job workflow into the debug, regular, and background jobs. The method is implemented as a part of the SUPPZ system for parallel job management, which has been used for more than 20 years in HPC systems at the Joint supercomputer center of the RAS (JSCC RAS) and the Keldysh Institute of Applied Mathematics of the RAS. The article contains the results of the JSCC RAS supercomputers statistics analysis of the proposed scheduling method effectiveness.

Authors

Institutions

Publication Details

Journal
Lobachevskii Journal of Mathematics
Published
2024-10-01
DOI
https://doi.org/10.1134/s1995080224606118
Primary Topic
Distributed and Parallel Computing Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

HPC Scheduling Method Based on Debug and Background Job Classes Division

А. В. Баранов
Lobachevskii Journal of Mathematics
Distributed and Parallel Computing Systems
article

HPC Scheduling Method Based on Debug and Background Job Classes Division

А. В. Баранов
article en

Abstract

HPC users usually share supercomputer resources by submitting their jobs to the queue. The job management system scheduler forms job schedule for the supercomputer nodes. There are three widespread scheduling principles: assigning jobs fixed parameters such as number of nodes or cores and execution time, the priority non-preemptive ‘‘fair share’’ scheduling, and using one of backfilling strategies. The article presents the scheduling method based on these principles. The special feature of the proposed method is the division of the input job workflow into the debug, regular, and background jobs. The method is implemented as a part of the SUPPZ system for parallel job management, which has been used for more than 20 years in HPC systems at the Joint supercomputer center of the RAS (JSCC RAS) and the Keldysh Institute of Applied Mathematics of the RAS. The article contains the results of the JSCC RAS supercomputers statistics analysis of the proposed scheduling method effectiveness.

Lobachevskii Journal of MathematicsVol. 45(10)
Research Institute for System Studies (RU)
Decent work and economic growth
Openalex Percentile: Top 67%
Distributed and Parallel Computing Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.