Communication-and-Energy Efficient Over-the-Air Federated Learning

Communication and energy efficiencies are two crucial objectives in the pursuit of edge intelligence in 6G networks, and become increasingly important given the prevalence of large model training. Existing designs typically focus on either communication efficiency or energy efficiency due to the fact that improving one objective generally comes at the expense of the other. Over-the-air federated learning (OTA-FL) has recently emerged as a promising approach to enhance both efficiencies through an integrated communication and computation design. Nevertheless, most previous studies on OTA-FL only consider scenarios where the dataset for the entire FL procedure is collected and available prior to training. In real-world applications, devices continuously collect new data in an online manner. This underscores the significance of sample collection through sensing in a practical FL pipeline. We propose to integrate sensing with communication and computation into a joint design to further boost the communication-and-energy efficiencies of OTA-FL. Specifically, we consider a training latency and energy consumption minimization problem with performance guarantees. To this end, we first derive an average training error (ATE) metric to quantify convergence performance. Then, a joint sensing, communication and computation resource allocation strategy is developed based on a deep reinforcement learning (DRL) algorithm that nests convex optimization with a deep Q-network. Extensive experiments are conducted to validate our theoretical analysis, and demonstrate the effectiveness of the proposed design for communication-and-energy efficient FL.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Wireless Communications
Published
2024-11-25
DOI
https://doi.org/10.1109/twc.2024.3501297
Citations
9
Primary Topic
Privacy-Preserving Technologies in Data
Type
article
Field-Weighted Citation Impact
3.13
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Communication-and-Energy Efficient Over-the-Air Federated Learning

Guangxu Zhu, Yonina C. Eldar, Shuguang Cui, Qimei Chen et al.
9 citations
IEEE Transactions on Wireless Communications
Privacy-Preserving Technologies in Data
3.13
article

Communication-and-Energy Efficient Over-the-Air Federated Learning

Guangxu Zhu, Yonina C. Eldar, Shuguang Cui, Qimei Chen, Yipeng Liang, Hao Jiang
article en
9 citations

Abstract

Communication and energy efficiencies are two crucial objectives in the pursuit of edge intelligence in 6G networks, and become increasingly important given the prevalence of large model training. Existing designs typically focus on either communication efficiency or energy efficiency due to the fact that improving one objective generally comes at the expense of the other. Over-the-air federated learning (OTA-FL) has recently emerged as a promising approach to enhance both efficiencies through an integrated communication and computation design. Nevertheless, most previous studies on OTA-FL only consider scenarios where the dataset for the entire FL procedure is collected and available prior to training. In real-world applications, devices continuously collect new data in an online manner. This underscores the significance of sample collection through sensing in a practical FL pipeline. We propose to integrate sensing with communication and computation into a joint design to further boost the communication-and-energy efficiencies of OTA-FL. Specifically, we consider a training latency and energy consumption minimization problem with performance guarantees. To this end, we first derive an average training error (ATE) metric to quantify convergence performance. Then, a joint sensing, communication and computation resource allocation strategy is developed based on a deep reinforcement learning (DRL) algorithm that nests convex optimization with a deep Q-network. Extensive experiments are conducted to validate our theoretical analysis, and demonstrate the effectiveness of the proposed design for communication-and-energy efficient FL.

IEEE Transactions on Wireless CommunicationsVol. 24(1)
Shenzhen Institute of Information Technology (CN), Wuhan University (CN), Shenzhen Research Institute of Big Data (CN), Chinese University of Hong Kong, Shenzhen (CN), Weizmann Institute of Science (IL)
Affordable and clean energy
Openalex Percentile: Top 7%
Privacy-Preserving Technologies in Data
3.13
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.