Harmonizing Repair and Maintenance in LRC-Coded Storage
Modern storage systems not only introduce data redundancy for fault tolerance, but also conduct regular main- tenance operations on storage nodes for system robustness. Erasure coding provides storage-efficient redundancy and has been widely deployed in production, yet it also incurs substantial bandwidth and I/O overhead due to the repair of storage failures. In particular, maintenance operations make storage nodes temporarily unavailable and lead to data unavailability, thereby incurring repair overhead for erasure-coded storage. In this paper, we study Locally Repairable Codes (LRCs), a class of practical repair-efficient erasure codes, and show that there exists an inherent performance trade-off between the repair and maintenance operations of LRCs in data center settings, such that the repair performance in regular (i.e., no-maintenance) and maintenance modes cannot be simultaneously optimized. To this end, we design a configurable data placement scheme that operates along the trade-off subject to fault-tolerance constraints. We prototype our data placement scheme atop Hadoop HDFS and show how it balances the performance trade-off of repair and maintenance operations in real network environments.
Authors
- Si Wu (ORCID: https://orcid.org/0000-0001-7743-8236)
- Patrick P. C. Lee (ORCID: https://orcid.org/0000-0002-4501-4364)
- Keyun Cheng (ORCID: https://orcid.org/0000-0002-8301-9633)
- Xiaolu Li (ORCID: https://orcid.org/0000-0002-3582-0792)
Institutions
- University of Science and Technology of China (CN)
- Chinese University of Hong Kong (HK)
- Huazhong University of Science and Technology (CN)
Publication Details
- Published
- 2024-09-30
- DOI
- https://doi.org/10.1109/srds64841.2024.00012
- Citations
- 1
- Primary Topic
- Infrastructure Maintenance and Monitoring
- Type
- article
- Field-Weighted Citation Impact
- 0.26