A 360° Survey on Reconfigurability of HPC Storage Systems for Efficient I/O

High-performance computing (HPC) storage and I/O software stacks have been challenging to configure due to multiple software layers, interdependencies among those layers, and the number of parameters to tune within each layer. The storage stack has become increasingly complex with the ever-growing sets of new software and hardware. In addition, there is a shift in HPC applications from modeling and simulations (mod-sim) to AI training and inference. While several efforts focused on tuning I/O parameters of write-heavy simulation workloads, configuring I/O for random and read-heavy AI applications has still been in progress. Although the HPC storage stack could be reconfigured to meet these diverse write and read requirements, finding optimal I/O configurations for even a single application is a challenging task. This survey proposes a taxonomy of HPC storage and I/O system configurations and reconfigurability for bringing a consensus to the I/O parameters that are tunable by clients (i.e., users and applications). In this paper, we survey I/O tuning and optimization, harnessing the HPC I/O system configuration knowledge from the past decade. This paper can serve as a primary source of information for HPC I/O researchers and developers to design and optimize novel tuning strategies that improve storage and I/O system reconfigurability and performance.

Authors

Institutions

Publication Details

Journal
ACM Computing Surveys
Published
2026-11-14
DOI
https://doi.org/10.1145/3863974
Primary Topic
Advanced Data Storage Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A 360° Survey on Reconfigurability of HPC Storage Systems for Efficient I/O

Jean Luca Bez, Amir Salimiparsa, Suren Byna, Noah Lewis
ACM Computing Surveys
Advanced Data Storage Technologies
article

A 360° Survey on Reconfigurability of HPC Storage Systems for Efficient I/O

Jean Luca Bez, Amir Salimiparsa, Suren Byna, Noah Lewis
article en

Abstract

High-performance computing (HPC) storage and I/O software stacks have been challenging to configure due to multiple software layers, interdependencies among those layers, and the number of parameters to tune within each layer. The storage stack has become increasingly complex with the ever-growing sets of new software and hardware. In addition, there is a shift in HPC applications from modeling and simulations (mod-sim) to AI training and inference. While several efforts focused on tuning I/O parameters of write-heavy simulation workloads, configuring I/O for random and read-heavy AI applications has still been in progress. Although the HPC storage stack could be reconfigured to meet these diverse write and read requirements, finding optimal I/O configurations for even a single application is a challenging task. This survey proposes a taxonomy of HPC storage and I/O system configurations and reconfigurability for bringing a consensus to the I/O parameters that are tunable by clients (i.e., users and applications). In this paper, we survey I/O tuning and optimization, harnessing the HPC I/O system configuration knowledge from the past decade. This paper can serve as a primary source of information for HPC I/O researchers and developers to design and optimize novel tuning strategies that improve storage and I/O system reconfigurability and performance.

ACM Computing Surveys
Universidade Federal do Rio Grande do Sul (BR), Lawrence Berkeley National Laboratory (US), Illinois Institute of Technology (US), NEC (United States) (US), The Ohio State University (US)
Advanced Data Storage Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon