Over-the-Air Federated Edge Learning with Error-Feedback One-Bit Quantization and Power Control
Over-the-air federated edge learning (Air-FEEL) is a communication-efficient framework for distributed machine learning using training data distributed at edge devices. This framework enables all edge devices to transmit model updates simultaneously over the entire available bandwidth, allowing for over-the-air aggregation. The existing one-bit digital over-the-air aggregation scheme features one-bit gradient quantization at edge devices and majority voting-based decoding at edge server, and therefore offers enhanced communication efficiency. However, the low-resolution one-bit gradient quantization slows down the model convergence and leads to performance degradation, while the aggregation errors caused by channel fading in Air-FEEL further impair the performance. To address these issues, we propose the error-feedback one-bit broadband digital aggregation (EFOBDA) with an optimized power control policy. To this end, we first derive the impact of aggregation errors on the convergence of FEEL with EFOBDA. Then, we further introduce a power control policy by maximizing the convergence rate under instantaneous power constraints. The analytical results and optimized power control policy are validated by the experiments, which show that the proposed scheme achieves significantly faster convergence and higher test accuracy in image classification tasks compared with the vanilla one-bit quantization scheme without error feedback or optimized power control policy.
Authors
- Guangxu Zhu (ORCID: https://orcid.org/0000-0001-9532-9201)
- Dongzhu Liu (ORCID: https://orcid.org/0000-0001-7820-9531)
- Richeng Jin (ORCID: https://orcid.org/0000-0002-1480-585X)
- Yuding Liu
- Qingjiang Shi (ORCID: https://orcid.org/0000-0002-5000-6369)
Institutions
- Shenzhen Research Institute of Big Data (CN)
- Zhejiang University (CN)
- University of Glasgow (GB)
Publication Details
- Published
- 2024-12-13
- DOI
- https://doi.org/10.1109/iccc62609.2024.10942260
- Citations
- 1
- Primary Topic
- Privacy-Preserving Technologies in Data
- Type
- article
- Field-Weighted Citation Impact
- 0.35