Exploiting Complex Network-Based Clustering for Personalization-Enhanced Hierarchical Federated Edge Learning
Federated Learning (FL) has been extensively applied in urban environmental prediction tasks of mobile edge computing by training a global machine learning model without data sharing. However, the training of FL faces the challenges such as the poor generalization capability of a single global model over heterogeneous data and hefty communication overhead caused by the frequent model exchange between massive edge servers and remote cloud servers. To address such issues, we propose HPFL-CN, a novel communication-efficient Hierarchical Personalized Federated edge Learning framework with Complex Network clustering. HPFL-CN introduces Privacy-preserving Feature Clustering (PFC) to extract privacy-preserving low-dimensional feature representations of each edge server via mapping the environmental data to different complex network domains for clustering similar edge servers accurately. Based on the clustering results of PFC, an <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">edge-mediator-cloud</i> hierarchical architecture is proposed to realize personalization at the cluster level by Effective Hierarchical Scheduling (EHS). Furthermore, to adapt to dynamic scenarios of new edge servers joining and streaming data generation, we further extend HPFL-CN to Adaptive personalized federated learning with dynamic grouping (Ada-HPFL-CN), which can flexibly re-group edge servers and adjust mixed model weights and the model aggregation frequency adaptively. Our extensive experiments on real-world datasets demonstrate the efficacy of our framework, which outperforms state-of-the-art FL methods regarding personalization and communication efficiency performance.
Authors
- Tony Q. S. Quek (ORCID: https://orcid.org/0000-0002-4037-3149)
- Hengshan Yue (ORCID: https://orcid.org/0000-0003-2189-8385)
- Zhewen Xu (ORCID: https://orcid.org/0000-0001-8309-6084)
- Zijian Li (ORCID: https://orcid.org/0000-0003-3901-6790)
- Zihan Chen (ORCID: https://orcid.org/0000-0003-0814-3391)
- Shang Gao (ORCID: https://orcid.org/0000-0002-1595-3176)
- Xiaohui Wei (ORCID: https://orcid.org/0000-0001-5597-3625)
Institutions
- Singapore University of Technology and Design (SG)
- Jilin University (CN)
- Jilin Province Science and Technology Department (CN)
- Dalian Maritime University (CN)
Publication Details
- Journal
- IEEE Transactions on Mobile Computing
- Published
- 2024-08-23
- DOI
- https://doi.org/10.1109/tmc.2024.3449129
- Citations
- 11
- Primary Topic
- Privacy-Preserving Technologies in Data
- Type
- article
- Field-Weighted Citation Impact
- 3.82
Funders
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Fundamental Research Funds for the Central Universities