Factors Impacting I/O Time Proportion in AI Workloads
The decision to optimize I/O in scientific applications often depends on the proportion of I/O time within an application's runtime. For AI workloads, such as machine learning (ML), we observe that different configurations with the same data size can lead to varying I/O impacts. In this work, we analyze common tunable parameters—batch size, number of samples, and number of files—typically adjusted when adapting ML models to new datasets or use cases. Using the XGBoost model, we predict the I/O percentage for ResNet50 and UNet3D workloads and identify feature combinations that influence I/O behavior. Our results provide practical guidance for optimizing I/O performance in AI workloads.
Authors
- Julian Kunkel (ORCID: https://orcid.org/0000-0002-6915-1179)
- Radita Liem (ORCID: https://orcid.org/0000-0002-2506-1841)
- Zoya Masih
Institutions
- Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (DE)
- University of Göttingen (DE)
- RWTH Aachen University (DE)
Publication Details
- Published
- 2025-07-20
- DOI
- https://doi.org/10.1145/3731545.3736815
- Primary Topic
- Industrial Vision Systems and Defect Detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00