A Comparative Study of Clustering Distance Metrics for Personalized Federated Learning in Human Activity Recognition

In Federated Learning (FL), Non-Independent and Identically Distributed (Non-IID) data across different clients presents a significant challenge for a global model to effectively generalize to all clients, thus affecting fairness across the system. To address this, the Clustered Personalized Federated Learning (CPFL) framework groups clients with similar data distributions and trains models that are tailored to the characteristics within each cluster. In this study, we experimentally evaluate the performance of four distance metrics - Cosine distance, Euclidean distance, Manhattan distance, and Mahalanobis distance - across varying numbers numbers of clusters within the CPFL framework, focusing on their impact on model accuracy and fairness across client models. Our results demonstrate that Euclidean distance not only improves model accuracy but also significantly reduces performance disparities between clients, exhibiting the lowest variance and enhancing fairness. In contrast, the other distance metrics introduce larger variance in certain scenarios, leading to greater differences in client model performance. This study provides empirical support for the use of distance metrics in CPFL, showing that selecting appropriate clustering methods can enhance both overall performance and fairness across client model.

Authors

Institutions

Publication Details

Published
2024-11-26
DOI
https://doi.org/10.1109/icamechs63130.2024.10818732
Citations
1
Primary Topic
Privacy-Preserving Technologies in Data
Type
article
Field-Weighted Citation Impact
0.35

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Comparative Study of Clustering Distance Metrics for Personalized Federated Learning in Human Activity Recognition

Chenggang Lu, Hongnian Yu, Xiaoxu Wen, Ruixiang Hu et al.
1 citations
Privacy-Preserving Technologies in Data
0.35
article

A Comparative Study of Clustering Distance Metrics for Personalized Federated Learning in Human Activity Recognition

Chenggang Lu, Hongnian Yu, Xiaoxu Wen, Ruixiang Hu, Yingrui Geng, Qiangsong Zhao, Yan Wang
article en
1 citations

Abstract

In Federated Learning (FL), Non-Independent and Identically Distributed (Non-IID) data across different clients presents a significant challenge for a global model to effectively generalize to all clients, thus affecting fairness across the system. To address this, the Clustered Personalized Federated Learning (CPFL) framework groups clients with similar data distributions and trains models that are tailored to the characteristics within each cluster. In this study, we experimentally evaluate the performance of four distance metrics - Cosine distance, Euclidean distance, Manhattan distance, and Mahalanobis distance - across varying numbers numbers of clusters within the CPFL framework, focusing on their impact on model accuracy and fairness across client models. Our results demonstrate that Euclidean distance not only improves model accuracy but also significantly reduces performance disparities between clients, exhibiting the lowest variance and enhancing fairness. In contrast, the other distance metrics introduce larger variance in certain scenarios, leading to greater differences in client model performance. This study provides empirical support for the use of distance metrics in CPFL, showing that selecting appropriate clustering methods can enhance both overall performance and fairness across client model.

Zhongyuan University of Technology (CN), Ritsumeikan University (JP), Edinburgh Napier University (GB)
Research and Development
Openalex Percentile: Top 30%
Privacy-Preserving Technologies in Data
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.