Addressing Fluctuating Stragglers in Distributed Matrix Multiplication via Fountain Codes
In distributed matrix multiplication, stragglers present a significant challenge. Coding techniques are often employed to mitigate this issue; however, their effectiveness is typically limited to handling a fixed number of stragglers. To address the issue of a fluctuating number of stragglers, we propose a novel approach that leverages a variant of Luby transform (LT) codes for distributed matrix multiplication, augmented with a feedback mechanism. This enables the system to tolerate a variable number of stragglers, potentially reducing the redundant computation to complete the task compared with existing coding methods dealing with a fixed number of strangers. Furthermore, we comprehensively analyze the computational complexity associated with the proposed algorithm.
Authors
- Linqi Song (ORCID: https://orcid.org/0000-0003-2756-4984)
- Jianping Wang (ORCID: https://orcid.org/0000-0002-9318-1482)
- Siyuan Wang (ORCID: https://orcid.org/0000-0002-4971-0236)
Institutions
- City University of Hong Kong (HK)
Publication Details
- Published
- 2024-11-24
- DOI
- https://doi.org/10.1109/itw61385.2024.10806990
- Primary Topic
- Error Correcting Code Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China