A Decentralized Federated Learning Model Based on Global Channel Selection
With the increasing challenges of data privacy protection and computational resource constraints, Decentralized Federated Learning has gained widespread attention as an emerging distributed learning framework. However, frequent communication and model updates in decentralized environments significantly increase the communication overhead of the system. To address this problem, this paper proposes a decentralized federated learning scheme with a global channel selection algorithm. In this scheme, nodes dynamically decide which channels should be shared by locally training and evaluating the importance of model channels and aggregating global channel scores through a voting mechanism of neighboring nodes. During the aggregation process, we pass only the parameters of the important channels to reduce the communication burden, and introduce a Learn-to-Rank regularization strategy in the channel selection optimization to further improve the accuracy and performance of the sparse model. Experimental results show that the proposed scheme is effective in reducing communication overhead and maintaining high model performance across multiple datasets and model architectures, especially in resource-constrained distributed environments, demonstrating strong adaptability and scalability. The approach provides new ideas and effective technical support for the application of decentralized federated learning in large-scale, heterogeneous environments.
Authors
- Jia Zhao (ORCID: https://orcid.org/0000-0002-6917-4709)
- Yang Cao (ORCID: https://orcid.org/0000-0003-4549-5038)
- Yongli Yang (ORCID: https://orcid.org/0000-0001-8260-3611)
- Shiqiang Zhang (ORCID: https://orcid.org/0000-0001-5473-8009)
- Yipeng Cai
- Jin-quan Cheng
Institutions
- Beijing Wuzi University (CN)
Publication Details
- Published
- 2024-12-13
- DOI
- https://doi.org/10.1109/icftic64248.2024.10912898
- Primary Topic
- Privacy-Preserving Technologies in Data
- Type
- article
- Field-Weighted Citation Impact
- 0.00