A 360° Survey on Reconfigurability of HPC Storage Systems for Efficient I/O
High-performance computing (HPC) storage and I/O software stacks have been challenging to configure due to multiple software layers, interdependencies among those layers, and the number of parameters to tune within each layer. The storage stack has become increasingly complex with the ever-growing sets of new software and hardware. In addition, there is a shift in HPC applications from modeling and simulations (mod-sim) to AI training and inference. While several efforts focused on tuning I/O parameters of write-heavy simulation workloads, configuring I/O for random and read-heavy AI applications has still been in progress. Although the HPC storage stack could be reconfigured to meet these diverse write and read requirements, finding optimal I/O configurations for even a single application is a challenging task. This survey proposes a taxonomy of HPC storage and I/O system configurations and reconfigurability for bringing a consensus to the I/O parameters that are tunable by clients (i.e., users and applications). In this paper, we survey I/O tuning and optimization, harnessing the HPC I/O system configuration knowledge from the past decade. This paper can serve as a primary source of information for HPC I/O researchers and developers to design and optimize novel tuning strategies that improve storage and I/O system reconfigurability and performance.
Authors
- Jean Luca Bez (ORCID: https://orcid.org/0000-0002-3915-1135)
- Amir Salimiparsa
- Suren Byna (ORCID: https://orcid.org/0000-0003-3048-3448)
- Noah Lewis (ORCID: https://orcid.org/0009-0005-1732-7776)
Institutions
- Universidade Federal do Rio Grande do Sul (BR)
- Lawrence Berkeley National Laboratory (US)
- Illinois Institute of Technology (US)
- NEC (United States) (US)
- The Ohio State University (US)
Publication Details
- Journal
- ACM Computing Surveys
- Published
- 2026-11-14
- DOI
- https://doi.org/10.1145/3863974
- Primary Topic
- Advanced Data Storage Technologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00