Compressor-Aware Feature Analysis and Learning-Based Performance Prediction for Scientific Data Compression
High-fidelity scientific instruments and simulations are producing data at unprecedented volumes and rates, imposing substantial pressure on storage, transmission, and analysis. In order to alleviate the challenges brought to highperformance computing I/O and storage, compression techniques have been introduced in various scenarios, but understanding compression performance remains challenging due to the complex interactions among data characteristics and compressor-internal behaviors. In this paper, we analyze the internal behaviors of SZ, a representative prediction-based error-bounded lossy compressor, and identify representative compressor-related features for performance prediction. We then develop learningbased models to predict compression ratio and throughput, and further design a simplified prediction model using representative features. We compare the proposed method with existing sample-based and white-box prediction methods. The results show that compressor-internal features are important for performance prediction, but the best prediction method is scenario-dependent.
Authors
- Zhenlu Qin (ORCID: https://orcid.org/0000-0002-0408-9853)
- Jinzhen Wang (ORCID: https://orcid.org/0000-0001-6317-2940)
- Lei Wu
- Qirui Tian
Institutions
- University of North Carolina at Charlotte (US)
- New Jersey Institute of Technology (US)
- Auburn University at Montgomery (US)
Publication Details
- Journal
- Journal of Artificial Intelligence for Automation
- Published
- 2026-09-21
- DOI
- https://doi.org/10.53941/jaia.2026.100013
- Primary Topic
- Advanced Data Storage Technologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00