AIMS: An Adaptive Intelligent Multi-Objective Scheduler Powered by Digital Twins

High-performance computing (HPC) systems face challenges in jointly optimizing energy efficiency, reliability, and job throughput across heterogeneous architectures. Traditional schedulers rely on fixed heuristics that struggle under dynamic conditions and conflicting objectives. We present AIMS (Adaptive Intelligent Multi-objective Scheduler), a framework that combines uncertainty-aware deep reinforcement learning with digital twin technology for autonomous HPC scheduling. AIMS features a five-layer architecture with four predictive digital twins: fault prediction via LSTM-attention, energy forecasting using a CNN-LSTM hybrid, ensemble performance modeling, and physics-informed thermal analysis. These models supply state information to a Dueling DQN with epistemic uncertainty quantification, enabling adaptive decision-making. Policy gradient-based weight evolution drives multi-objective optimization toward Pareto-efficient scheduling. Tested on 389,620 production job records from Aurora, Polaris, Mira, and Cooley systems, AIMS outperforms ten baselines, including Slurm and PBS Pro, achieving 12.1% higher energy efficiency, 8.7% improved reliability, and 15.3% greater throughput. Under fault conditions, its uncertainty-aware design yields a performance gain of 12.8% versus 5.2% in stable settings. Scalability tests confirm real-time operation at exascale (up to 262K nodes) with sub-50ms decision latency. AIMS offers a robust and scalable solution for next-generation HPC scheduling where traditional methods fall short.

Authors

Institutions

Publication Details

Published
2025-09-15
DOI
https://doi.org/10.1109/hpec67600.2025.11196586
Primary Topic
Scheduling and Optimization Algorithms
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AIMS: An Adaptive Intelligent Multi-Objective Scheduler Powered by Digital Twins

Kyrian Adimora, Hongyang Sun
Scheduling and Optimization Algorithms
article

AIMS: An Adaptive Intelligent Multi-Objective Scheduler Powered by Digital Twins

Kyrian Adimora, Hongyang Sun
article en

Abstract

High-performance computing (HPC) systems face challenges in jointly optimizing energy efficiency, reliability, and job throughput across heterogeneous architectures. Traditional schedulers rely on fixed heuristics that struggle under dynamic conditions and conflicting objectives. We present AIMS (Adaptive Intelligent Multi-objective Scheduler), a framework that combines uncertainty-aware deep reinforcement learning with digital twin technology for autonomous HPC scheduling. AIMS features a five-layer architecture with four predictive digital twins: fault prediction via LSTM-attention, energy forecasting using a CNN-LSTM hybrid, ensemble performance modeling, and physics-informed thermal analysis. These models supply state information to a Dueling DQN with epistemic uncertainty quantification, enabling adaptive decision-making. Policy gradient-based weight evolution drives multi-objective optimization toward Pareto-efficient scheduling. Tested on 389,620 production job records from Aurora, Polaris, Mira, and Cooley systems, AIMS outperforms ten baselines, including Slurm and PBS Pro, achieving 12.1% higher energy efficiency, 8.7% improved reliability, and 15.3% greater throughput. Under fault conditions, its uncertainty-aware design yields a performance gain of 12.8% versus 5.2% in stable settings. Scalability tests confirm real-time operation at exascale (up to 262K nodes) with sub-50ms decision latency. AIMS offers a robust and scalable solution for next-generation HPC scheduling where traditional methods fall short.

University of Kansas (US)
Openalex Percentile: Top 58%
Scheduling and Optimization Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.