Flux Emulator: First Insights into Optimizing Scheduling for Exascale HPC

El Capitan, currently the world's largest supercomputer at 1.742 Ex-aflop/s, introduces challenges in scheduling due to its scale and innovative rabbit nodes, which traditional schedulers cannot efficiently handle. Flux, a resource and job management system, handles dynamic resource allocation tailored for exascale systems through its graph-based scheduler, Fluxion. This work introduces the Flux Emulator, a tool designed to test scheduling policies in Fluxion without impacting production systems. The emulator plugs into the real components of Flux and Fluxion to mimic job execution, emulate resource usage, and collect information on how the job behaves. Preliminary tests show negligible overhead introduced by the emulator and demonstrate its effectiveness in evaluating scheduli ng policies, like conservative backfilling, in a fraction of the time required with a real system.

Authors

Institutions

Publication Details

Published
2025-07-20
DOI
https://doi.org/10.1145/3731545.3735121
Primary Topic
Distributed and Parallel Computing Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Flux Emulator: First Insights into Optimizing Scheduling for Exascale HPC

Dewi Yokelson, Stephanie Brink, Olga Pearce, Daniel Milroy et al.
Distributed and Parallel Computing Systems
article

Flux Emulator: First Insights into Optimizing Scheduling for Exascale HPC

Dewi Yokelson, Stephanie Brink, Olga Pearce, Daniel Milroy, Michela Taufer, Tapasya Patki, Tom Scogland, Ian Lumsden, W. Jay Ashworth
article en

Abstract

El Capitan, currently the world's largest supercomputer at 1.742 Ex-aflop/s, introduces challenges in scheduling due to its scale and innovative rabbit nodes, which traditional schedulers cannot efficiently handle. Flux, a resource and job management system, handles dynamic resource allocation tailored for exascale systems through its graph-based scheduler, Fluxion. This work introduces the Flux Emulator, a tool designed to test scheduling policies in Fluxion without impacting production systems. The emulator plugs into the real components of Flux and Fluxion to mimic job execution, emulate resource usage, and collect information on how the job behaves. Preliminary tests show negligible overhead introduced by the emulator and demonstrate its effectiveness in evaluating scheduli ng policies, like conservative backfilling, in a fraction of the time required with a real system.

Lawrence Livermore National Laboratory (US), Knoxville College (US), University of Tennessee at Knoxville (US)
Openalex Percentile: Top 72%
Distributed and Parallel Computing Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Flux Emulator: First Insights into Optimizing Scheduling for Exascale HPC — Dewi Yokelson, Stephanie Brink, et al. · (2025) | TGRS Research Map | TGRS