Assuming the best: Towards a reliable protocol for resource usage prediction for high-performance computing based on machine learning

• Novel approach for sounder assessment of resource usage prediction in HPC systems. • Comprehensive protocol comprising from data collection to ML models evaluation. • Statistical comparison of tree-based models on a bioinformatics case study. • Multi-targeted evaluation: time, memory, disk, and energy consumption. In High-Performance Computing (HPC) systems, multiple processes simultaneously consume resources such as CPU time, memory, and electrical power, among others. Accurately predicting the resource consumption of a process based on its execution parameters enables more efficient resource allocation, ultimately improving the overall performance of the HPC system. While many studies have explored this topic, fewer explicitly examine the underlying assumptions of their approaches. This work contributes to filling that gap by proposing, experimenting with, and discussing a protocol to approach this problem, covering from the collection of processes footprint data to the experimental evaluation of Machine Learning models based on such data. The reported results of the assessment of this protocol in a case study of the RAxML bioinformatics application on a real supercomputer highlight not only its effectiveness ( R 2 values greater than 0.9 were achieved in most tests) but also the reasonableness of the assumptions considered.

Authors

Publication Details

Journal
Future Generation Computer Systems
Published
2025-08-09
DOI
https://doi.org/10.1016/j.future.2025.108070
Citations
3
Primary Topic
Distributed and Parallel Computing Systems
Type
article
Field-Weighted Citation Impact
4.46
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Assuming the best: Towards a reliable protocol for resource usage prediction for high-performance computing based on machine learning

Hiago Mayk G. de A. Rocha, Micaella Coelho, Kary Ocaña, Carla Osthoff et al.
3 citations
Future Generation Computer Systems
Distributed and Parallel Computing Systems
4.46
article

Assuming the best: Towards a reliable protocol for resource usage prediction for high-performance computing based on machine learning

Hiago Mayk G. de A. Rocha, Micaella Coelho, Kary Ocaña, Carla Osthoff, Douglas O. Cardoso, Alexandre H.L. Porto
article en
3 citations

Abstract

• Novel approach for sounder assessment of resource usage prediction in HPC systems. • Comprehensive protocol comprising from data collection to ML models evaluation. • Statistical comparison of tree-based models on a bioinformatics case study. • Multi-targeted evaluation: time, memory, disk, and energy consumption. In High-Performance Computing (HPC) systems, multiple processes simultaneously consume resources such as CPU time, memory, and electrical power, among others. Accurately predicting the resource consumption of a process based on its execution parameters enables more efficient resource allocation, ultimately improving the overall performance of the HPC system. While many studies have explored this topic, fewer explicitly examine the underlying assumptions of their approaches. This work contributes to filling that gap by proposing, experimenting with, and discussing a protocol to approach this problem, covering from the collection of processes footprint data to the experimental evaluation of Machine Learning models based on such data. The reported results of the assessment of this protocol in a case study of the RAxML bioinformatics application on a real supercomputer highlight not only its effectiveness ( R 2 values greater than 0.9 were achieved in most tests) but also the reasonableness of the assumptions considered.

Future Generation Computer SystemsVol. 175
Openalex Percentile: Top 5%
Distributed and Parallel Computing Systems
4.46
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Assuming the best: Towards a reliable protocol for resource usage prediction for high-performance computing based on machine learning — Hiago Mayk G. de A. Rocha, Micaella Coelho, et al. · Future Generation Computer Systems (2025) | TGRS Research Map | TGRS