Collaborative Data Completing for Robust SSD Failure Prediction
Solid-state drives (SSDs) are integral to modern data centers due to their superior performance and efficiency. However, ensuring their reliability under large-scale deployment remains challenging, with failures exhibiting widespread and diverse patterns across drive models and failure types. Factors such as mislabeling, missing data, and class imbalance significantly hinder accurate predictions and can obscure failure-relevant signals. While advanced machine learning models, such as GANs and CNN-LSTM architectures, have shown promise, they often struggle to address these data quality issues effectively. We propose an integrated data preprocessing framework for SSD failure prediction that combines feature screening, fault-aware imputation, and model-wise class balancing. The framework is designed to address heterogeneous failure types, structured missingness, and severe class imbalance under a leakage-free evaluation protocol. The integrated effect of the three preprocessing steps achieves significant improvement on the prediction performance. Testing on a dataset of 700,000 NVMe SSDs from Alibaba, our approach improves recall from 51% to 73% and precision from 59% to 88% under a leakage-free train and test split, outperforming representative state-of-the-art pipelines. These results demonstrate the effectiveness of tailoring preprocessing methods to the unique challenges of SSD failure prediction, enhancing reliability in real-world operations.
Authors
- Shuyue Zhou (ORCID: https://orcid.org/0000-0002-2355-3738)
- Qiao Li (ORCID: https://orcid.org/0000-0002-4579-4268)
- Ruiming Lu (ORCID: https://orcid.org/0000-0002-4236-289X)
- Yiming Zhang (ORCID: https://orcid.org/0000-0001-6450-8485)
- Yuze Jiang (ORCID: https://orcid.org/0009-0002-5602-3677)
- Zhirong Shen (ORCID: https://orcid.org/0000-0003-2673-5868)
Institutions
- Shanghai Jiao Tong University (CN)
- Xiamen University (CN)
- Fudan University (CN)
- Mohamed bin Zayed University of Artificial Intelligence (AE)
Publication Details
- Journal
- ACM Transactions on Architecture and Code Optimization
- Published
- 2026-05-28
- DOI
- https://doi.org/10.1145/3816697
- Primary Topic
- Advanced Data Storage Technologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00