A Comparative Study of Clustering Distance Metrics for Personalized Federated Learning in Human Activity Recognition
In Federated Learning (FL), Non-Independent and Identically Distributed (Non-IID) data across different clients presents a significant challenge for a global model to effectively generalize to all clients, thus affecting fairness across the system. To address this, the Clustered Personalized Federated Learning (CPFL) framework groups clients with similar data distributions and trains models that are tailored to the characteristics within each cluster. In this study, we experimentally evaluate the performance of four distance metrics - Cosine distance, Euclidean distance, Manhattan distance, and Mahalanobis distance - across varying numbers numbers of clusters within the CPFL framework, focusing on their impact on model accuracy and fairness across client models. Our results demonstrate that Euclidean distance not only improves model accuracy but also significantly reduces performance disparities between clients, exhibiting the lowest variance and enhancing fairness. In contrast, the other distance metrics introduce larger variance in certain scenarios, leading to greater differences in client model performance. This study provides empirical support for the use of distance metrics in CPFL, showing that selecting appropriate clustering methods can enhance both overall performance and fairness across client model.
Authors
- Chenggang Lu (ORCID: https://orcid.org/0009-0003-9040-5078)
- Hongnian Yu (ORCID: https://orcid.org/0000-0003-2894-2086)
- Xiaoxu Wen (ORCID: https://orcid.org/0000-0002-0557-6661)
- Ruixiang Hu
- Yingrui Geng (ORCID: https://orcid.org/0000-0002-3327-6471)
- Qiangsong Zhao
- Yan Wang (ORCID: https://orcid.org/0000-0001-9070-6653)
Institutions
- Zhongyuan University of Technology (CN)
- Ritsumeikan University (JP)
- Edinburgh Napier University (GB)
Publication Details
- Published
- 2024-11-26
- DOI
- https://doi.org/10.1109/icamechs63130.2024.10818732
- Citations
- 1
- Primary Topic
- Privacy-Preserving Technologies in Data
- Type
- article
- Field-Weighted Citation Impact
- 0.35
Funders
- Research and Development