Enhancing federated learning with dynamic weight adjustment based on particle swarm optimization

Federated learning (FL) stands as a promising distributed machine learning approach today, allowing model training on local clients without data sharing. However, varied contributions among clients often impact the global model’s performance, while FL confronts challenges like communication overhead, data heterogeneity, and privacy concerns. In this paper, we introduce a novel federated learning server aggregation algorithm: the Federated Learning Algorithm with Optimized Weight Aggregation via Particle Swarm Optimization Algorithm (AdpFedPSO). This approach dynamically adjusts client model contribution weights based on their performance and stability, aiming to enhance global model accuracy, convergence speed, and make model aggregation smarter and more adaptable. Through experimental validation on real datasets, we find that AdpFedPSO enhances accuracy by about 15% on the 0.6-Dirichlet MNIST dataset, 7.3% on the FashionMNIST dataset, and 13.4% on the CIFAR-10 dataset compared to the traditional FL aggregation method, FedAvg. These results indicate that AdpFedPSO not only enhances the accuracy of the global model but also expedites the model’s convergence speed. Additionally, it demonstrates resilience across various levels of client numbers, participation rates, and client heterogeneity, providing valuable reference and guidance for the further development of FL technology. Moreover, the concept of employing the particle swarm optimization algorithm for FL model aggregation also offers new insights and directions for future research.

Authors

Institutions

Publication Details

Journal
Discover Computing
Published
2024-10-28
DOI
https://doi.org/10.1007/s10791-024-09478-x
Citations
10
Primary Topic
Privacy-Preserving Technologies in Data
Type
article
Field-Weighted Citation Impact
3.47

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing federated learning with dynamic weight adjustment based on particle swarm optimization

Zhenyu Xu, Jun Mao, Donglin Zhu, Yinggang Li et al.
10 citations
Discover Computing
Privacy-Preserving Technologies in Data
3.47
article

Enhancing federated learning with dynamic weight adjustment based on particle swarm optimization

Zhenyu Xu, Jun Mao, Donglin Zhu, Yinggang Li, Changjun Zhou, Chengtian Ouyang
article en
10 citations

Abstract

Federated learning (FL) stands as a promising distributed machine learning approach today, allowing model training on local clients without data sharing. However, varied contributions among clients often impact the global model’s performance, while FL confronts challenges like communication overhead, data heterogeneity, and privacy concerns. In this paper, we introduce a novel federated learning server aggregation algorithm: the Federated Learning Algorithm with Optimized Weight Aggregation via Particle Swarm Optimization Algorithm (AdpFedPSO). This approach dynamically adjusts client model contribution weights based on their performance and stability, aiming to enhance global model accuracy, convergence speed, and make model aggregation smarter and more adaptable. Through experimental validation on real datasets, we find that AdpFedPSO enhances accuracy by about 15% on the 0.6-Dirichlet MNIST dataset, 7.3% on the FashionMNIST dataset, and 13.4% on the CIFAR-10 dataset compared to the traditional FL aggregation method, FedAvg. These results indicate that AdpFedPSO not only enhances the accuracy of the global model but also expedites the model’s convergence speed. Additionally, it demonstrates resilience across various levels of client numbers, participation rates, and client heterogeneity, providing valuable reference and guidance for the further development of FL technology. Moreover, the concept of employing the particle swarm optimization algorithm for FL model aggregation also offers new insights and directions for future research.

Discover ComputingVol. 27(1)
Zhejiang Normal University (CN), Jiangxi University of Science and Technology (CN), Ocean University of China (CN)
National Natural Science Foundation of China, Basic Public Welfare Research Program of Zhejiang Province
Openalex Percentile: Top 6%
Privacy-Preserving Technologies in Data
3.47
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.