Efficient Federated Learning via Adaptive Model Pruning for Internet of Vehicles With a Constrained Latency

In the Internet of Vehicles (IoV), data privacy concerns have prompted the adoption of Federated Learning (FL). Efficiency improvements in FL remain a focal area of research, with recent studies exploring model pruning to lessen both computation and communication overhead. However, in the IoV, model pruning presents unique challenges and remains underexplored. Pruning strategy design is critical as it directly impacts each vehicle's learning latency and capacity to participate in FL. Furthermore, FL performance and model pruning are intricately connected. Additionally, the fluctuating number and mobility states of vehicles per round complicate determining the optimal pruning ratio, closely intertwining pruning with vehicle selection. This study introduces Vehicular Federated Learning with Adaptive Model Pruning (VFed-AMP) to tackle these challenges by integrating adaptive pruning with dynamic vehicle selection and resource allocation. We analyze the impact of pruning ratios on learning latency and convergence rate. Then, guided by these findings, a joint optimization problem is formulated to maximize the convergence rate concerning optimal vehicle selection, bandwidth allocation, and pruning ratios. Finally, a low-complexity algorithm for joint adaptive pruning and vehicle scheduling is proposed to address this problem. Through theoretical analysis and system design, VFed-AMP enhances FL efficiency and scalability in the IoV, offering insights into optimizing FL performance through strategic model adjustments. Numerical results on various datasets show VFed-AMP achieves superior training accuracy (e.g., at least 13.4% improvement for BelgiumTS) and significantly reduces training time (e.g., at least up to <inline-formula><tex-math notation="LaTeX">$1.8\times$</tex-math></inline-formula> for CIFAR-10) compared to traditional FL methods.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Sustainable Computing
Published
2024-08-12
DOI
https://doi.org/10.1109/tsusc.2024.3441658
Citations
17
Primary Topic
Privacy-Preserving Technologies in Data
Type
article
Field-Weighted Citation Impact
5.91
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Efficient Federated Learning via Adaptive Model Pruning for Internet of Vehicles With a Constrained Latency

Yantao Yu, Xiaoping Xue, Mohammad S. Obaidat, Xing Chang et al.
17 citations
IEEE Transactions on Sustainable Computing
Privacy-Preserving Technologies in Data
5.91
article

Efficient Federated Learning via Adaptive Model Pruning for Internet of Vehicles With a Constrained Latency

Yantao Yu, Xiaoping Xue, Mohammad S. Obaidat, Xing Chang, Jingxiao Ma, Xuewen Wu
article en
17 citations

Abstract

In the Internet of Vehicles (IoV), data privacy concerns have prompted the adoption of Federated Learning (FL). Efficiency improvements in FL remain a focal area of research, with recent studies exploring model pruning to lessen both computation and communication overhead. However, in the IoV, model pruning presents unique challenges and remains underexplored. Pruning strategy design is critical as it directly impacts each vehicle's learning latency and capacity to participate in FL. Furthermore, FL performance and model pruning are intricately connected. Additionally, the fluctuating number and mobility states of vehicles per round complicate determining the optimal pruning ratio, closely intertwining pruning with vehicle selection. This study introduces Vehicular Federated Learning with Adaptive Model Pruning (VFed-AMP) to tackle these challenges by integrating adaptive pruning with dynamic vehicle selection and resource allocation. We analyze the impact of pruning ratios on learning latency and convergence rate. Then, guided by these findings, a joint optimization problem is formulated to maximize the convergence rate concerning optimal vehicle selection, bandwidth allocation, and pruning ratios. Finally, a low-complexity algorithm for joint adaptive pruning and vehicle scheduling is proposed to address this problem. Through theoretical analysis and system design, VFed-AMP enhances FL efficiency and scalability in the IoV, offering insights into optimizing FL performance through strategic model adjustments. Numerical results on various datasets show VFed-AMP achieves superior training accuracy (e.g., at least 13.4% improvement for BelgiumTS) and significantly reduces training time (e.g., at least up to <inline-formula><tex-math notation="LaTeX">$1.8\times$</tex-math></inline-formula> for CIFAR-10) compared to traditional FL methods.

IEEE Transactions on Sustainable ComputingVol. 10(2)
University of Jordan (JO), Tongji University (CN)
Openalex Percentile: Top 3%
Privacy-Preserving Technologies in Data
5.91
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.