Compressor-Aware Feature Analysis and Learning-Based Performance Prediction for Scientific Data Compression

High-fidelity scientific instruments and simulations are producing data at unprecedented volumes and rates, imposing substantial pressure on storage, transmission, and analysis. In order to alleviate the challenges brought to highperformance computing I/O and storage, compression techniques have been introduced in various scenarios, but understanding compression performance remains challenging due to the complex interactions among data characteristics and compressor-internal behaviors. In this paper, we analyze the internal behaviors of SZ, a representative prediction-based error-bounded lossy compressor, and identify representative compressor-related features for performance prediction. We then develop learningbased models to predict compression ratio and throughput, and further design a simplified prediction model using representative features. We compare the proposed method with existing sample-based and white-box prediction methods. The results show that compressor-internal features are important for performance prediction, but the best prediction method is scenario-dependent.

Authors

Institutions

Publication Details

Journal
Journal of Artificial Intelligence for Automation
Published
2026-09-21
DOI
https://doi.org/10.53941/jaia.2026.100013
Primary Topic
Advanced Data Storage Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Compressor-Aware Feature Analysis and Learning-Based Performance Prediction for Scientific Data Compression

Zhenlu Qin, Jinzhen Wang, Lei Wu, Qirui Tian
Journal of Artificial Intelligence for Automation
Advanced Data Storage Technologies
article

Compressor-Aware Feature Analysis and Learning-Based Performance Prediction for Scientific Data Compression

Zhenlu Qin, Jinzhen Wang, Lei Wu, Qirui Tian
article en

Abstract

High-fidelity scientific instruments and simulations are producing data at unprecedented volumes and rates, imposing substantial pressure on storage, transmission, and analysis. In order to alleviate the challenges brought to highperformance computing I/O and storage, compression techniques have been introduced in various scenarios, but understanding compression performance remains challenging due to the complex interactions among data characteristics and compressor-internal behaviors. In this paper, we analyze the internal behaviors of SZ, a representative prediction-based error-bounded lossy compressor, and identify representative compressor-related features for performance prediction. We then develop learningbased models to predict compression ratio and throughput, and further design a simplified prediction model using representative features. We compare the proposed method with existing sample-based and white-box prediction methods. The results show that compressor-internal features are important for performance prediction, but the best prediction method is scenario-dependent.

Journal of Artificial Intelligence for AutomationVol. 1(2)
University of North Carolina at Charlotte (US), New Jersey Institute of Technology (US), Auburn University at Montgomery (US)
Openalex Percentile: Top 9%
Advanced Data Storage Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Compressor-Aware Feature Analysis and Learning-Based Performance Prediction for Scientific Data Compression — Zhenlu Qin, Jinzhen Wang, et al. · Journal of Artificial Intelligence for Automation (2026) | TGRS Research Map | TGRS