Personalized federation algorithm based on model similarity and data importance

As an emerging distributed machine learning approach, federated learning has gradually become an effective method for addressing the issue of data silos. However, traditional federated learning algorithms often fail to achieve ideal personalization effects when dealing with data distribution of different clients, thus affecting the overall performance of the model. To solve this problem, this paper proposes a personalized federated learning algorithm FedSIA based on model similarity and data importance. FedSIA calculates the cosine similarity between client models, constructs a similarity matrix, and evaluates the importance of clients by combining data volume and data quality, thereby redistributing weights in the model aggregation stage. This paper also introduces L2 regularization in the client model update process to ensure the balance between personalized models and historical models. Experimental results show that FedSIA performs well on MNIST and CIFAR-10 datasets, especially in data heterogeneous scenarios, where FedSIA achieves higher accuracy, outperforming traditional federated learning algorithms and other classic personalization methods.

Authors

Institutions

Publication Details

Published
2024-11-01
DOI
https://doi.org/10.1109/iccbd-ai65562.2024.00084
Primary Topic
Recommender Systems and Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Personalized federation algorithm based on model similarity and data importance

Gang Gan, Wanmei Tang -
Recommender Systems and Techniques
article

Personalized federation algorithm based on model similarity and data importance

Gang Gan, Wanmei Tang -
article en

Abstract

As an emerging distributed machine learning approach, federated learning has gradually become an effective method for addressing the issue of data silos. However, traditional federated learning algorithms often fail to achieve ideal personalization effects when dealing with data distribution of different clients, thus affecting the overall performance of the model. To solve this problem, this paper proposes a personalized federated learning algorithm FedSIA based on model similarity and data importance. FedSIA calculates the cosine similarity between client models, constructs a similarity matrix, and evaluates the importance of clients by combining data volume and data quality, thereby redistributing weights in the model aggregation stage. This paper also introduces L2 regularization in the client model update process to ensure the balance between personalized models and historical models. Experimental results show that FedSIA performs well on MNIST and CIFAR-10 datasets, especially in data heterogeneous scenarios, where FedSIA achieves higher accuracy, outperforming traditional federated learning algorithms and other classic personalization methods.

Chengdu University of Information Technology (CN)
Openalex Percentile: Top 54%
Recommender Systems and Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Personalized federation algorithm based on model similarity and data importance — Gang Gan, Wanmei Tang - · (2024) | TGRS Research Map | TGRS