An Optimized Method for Batch Recovery Based on Erasure Coding in Heterogeneous Network

With the rapid development of IoT technology, sensors are widely used for monitoring environmental parameters. The data collected by sensors needs to be stored, and distributed storage systems provide an excellent platform to handle this vast amount of data. To enhance data reliability and reduce storage costs, erasure coding technology can be employed within distributed storage systems. However, the process of recovering lost or damaged data inevitably generates significant cross-rack traffic. In recent years, various batch recovery methods have been designed to improve data recovery speed and reduce cross-rack recovery traffic, but they have limitations in different aspects, such as less consideration for heterogeneous cross-rack bandwidth and insufficient handling of recovery link scheduling. This paper proposes the HBRepair recovery framework, aimed at improving data recovery speed by balancing the recovery load and reducing cross-rack recovery traffic. Firstly, HBRepair strategically selects helper blocks and nodes for storing recovery blocks to find the optimal batch recovery plan. Then, it selectively and rationally schedules recovery links to saturate idle bandwidth resources and avoid network congestion. Experimental results show that by optimizing the use of cross-rack bandwidth, HBRepair can reduce cross-rack recovery time by up to 26.74%, effectively addressing the shortcomings of existing methods.

Authors

Institutions

Publication Details

Journal
Sensors
Published
2025-01-09
DOI
https://doi.org/10.3390/s25020346
Citations
3
Primary Topic
Advanced Data Storage Technologies
Type
article
Field-Weighted Citation Impact
4.46

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Optimized Method for Batch Recovery Based on Erasure Coding in Heterogeneous Network

Yingai Tian, Bo Wang, Ying Song, Jialin Liu
3 citations
Sensors
Advanced Data Storage Technologies
4.46
article

An Optimized Method for Batch Recovery Based on Erasure Coding in Heterogeneous Network

Yingai Tian, Bo Wang, Ying Song, Jialin Liu
article en
3 citations

Abstract

With the rapid development of IoT technology, sensors are widely used for monitoring environmental parameters. The data collected by sensors needs to be stored, and distributed storage systems provide an excellent platform to handle this vast amount of data. To enhance data reliability and reduce storage costs, erasure coding technology can be employed within distributed storage systems. However, the process of recovering lost or damaged data inevitably generates significant cross-rack traffic. In recent years, various batch recovery methods have been designed to improve data recovery speed and reduce cross-rack recovery traffic, but they have limitations in different aspects, such as less consideration for heterogeneous cross-rack bandwidth and insufficient handling of recovery link scheduling. This paper proposes the HBRepair recovery framework, aimed at improving data recovery speed by balancing the recovery load and reducing cross-rack recovery traffic. Firstly, HBRepair strategically selects helper blocks and nodes for storing recovery blocks to find the optimal batch recovery plan. Then, it selectively and rationally schedules recovery links to saturate idle bandwidth resources and avoid network congestion. Experimental results show that by optimizing the use of cross-rack bandwidth, HBRepair can reduce cross-rack recovery time by up to 26.74%, effectively addressing the shortcomings of existing methods.

SensorsVol. 25(2)
Zhengzhou University of Light Industry (CN), Beijing Information Science & Technology University (CN)
National Natural Science Foundation of China, Chinese Academy of Sciences
Openalex Percentile: Top 7%
Advanced Data Storage Technologies
4.46
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

An Optimized Method for Batch Recovery Based on Erasure Coding in Heterogeneous Network — Yingai Tian, Bo Wang, et al. · Sensors (2025) | TGRS Research Map | TGRS