AIMS: An Adaptive Intelligent Multi-Objective Scheduler Powered by Digital Twins
High-performance computing (HPC) systems face challenges in jointly optimizing energy efficiency, reliability, and job throughput across heterogeneous architectures. Traditional schedulers rely on fixed heuristics that struggle under dynamic conditions and conflicting objectives. We present AIMS (Adaptive Intelligent Multi-objective Scheduler), a framework that combines uncertainty-aware deep reinforcement learning with digital twin technology for autonomous HPC scheduling. AIMS features a five-layer architecture with four predictive digital twins: fault prediction via LSTM-attention, energy forecasting using a CNN-LSTM hybrid, ensemble performance modeling, and physics-informed thermal analysis. These models supply state information to a Dueling DQN with epistemic uncertainty quantification, enabling adaptive decision-making. Policy gradient-based weight evolution drives multi-objective optimization toward Pareto-efficient scheduling. Tested on 389,620 production job records from Aurora, Polaris, Mira, and Cooley systems, AIMS outperforms ten baselines, including Slurm and PBS Pro, achieving 12.1% higher energy efficiency, 8.7% improved reliability, and 15.3% greater throughput. Under fault conditions, its uncertainty-aware design yields a performance gain of 12.8% versus 5.2% in stable settings. Scalability tests confirm real-time operation at exascale (up to 262K nodes) with sub-50ms decision latency. AIMS offers a robust and scalable solution for next-generation HPC scheduling where traditional methods fall short.
Authors
- Kyrian Adimora
- Hongyang Sun (ORCID: https://orcid.org/0000-0002-4379-4467)
Institutions
- University of Kansas (US)
Publication Details
- Published
- 2025-09-15
- DOI
- https://doi.org/10.1109/hpec67600.2025.11196586
- Primary Topic
- Scheduling and Optimization Algorithms
- Type
- article
- Field-Weighted Citation Impact
- 0.00