FedSiam-DA: Dual-Aggregated Federated Learning via Siamese Network for Non-IID Data

Federated learning (FL) is an effective mobile edge computing framework that enables multiple participants to collaboratively train intelligent models, without requiring large amounts of data transmission while protecting privacy. However, FL encounters challenges due to non-independent and identically distributed (non-IID) data from different participants. The existing methods, whether focusing on local training or global aggregation, often suffer from insufficient unilateral optimization. Achieving effective local-global collaborative optimization, particularly in the absence of additional reference models or datasets, is both crucial and challenging. To address this, we propose a novel approach: <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">D</b>ual-<bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">A</b>ggregated <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Fed</b>erated learning based on a triple <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Siam</b>ese network (<bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">FedSiam-DA</b>). This method enhances the FL algorithm on both client and server sides. On the client side, we establish a triple Siamese network incorporating a stop-gradient scheme, which leverages a contrastive learning strategy to control the update directions of local models. On the server side, we introduce a dual aggregation mechanism with dynamic weights for local updates, improving the global model’s ability to assimilate personalized knowledge from local models. Extensive experiments on multiple benchmark datasets demonstrate that FedSiam-DA significantly improves model performance under non-IID data conditions compared to existing methods.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Mobile Computing
Published
2024-10-03
DOI
https://doi.org/10.1109/tmc.2024.3472898
Citations
8
Primary Topic
Privacy-Preserving Technologies in Data
Type
article
Field-Weighted Citation Impact
2.78
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

FedSiam-DA: Dual-Aggregated Federated Learning via Siamese Network for Non-IID Data

Lisheng Fan, Shibo He, Xin Wang, Feng Li et al.
8 citations
IEEE Transactions on Mobile Computing
Privacy-Preserving Technologies in Data
2.78
article

FedSiam-DA: Dual-Aggregated Federated Learning via Siamese Network for Non-IID Data

Lisheng Fan, Shibo He, Xin Wang, Feng Li, Xiao-Ming Wu, Yanhan Wang, Yang Ming
article en
8 citations

Abstract

Federated learning (FL) is an effective mobile edge computing framework that enables multiple participants to collaboratively train intelligent models, without requiring large amounts of data transmission while protecting privacy. However, FL encounters challenges due to non-independent and identically distributed (non-IID) data from different participants. The existing methods, whether focusing on local training or global aggregation, often suffer from insufficient unilateral optimization. Achieving effective local-global collaborative optimization, particularly in the absence of additional reference models or datasets, is both crucial and challenging. To address this, we propose a novel approach: <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">D</b>ual-<bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">A</b>ggregated <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Fed</b>erated learning based on a triple <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Siam</b>ese network (<bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">FedSiam-DA</b>). This method enhances the FL algorithm on both client and server sides. On the client side, we establish a triple Siamese network incorporating a stop-gradient scheme, which leverages a contrastive learning strategy to control the update directions of local models. On the server side, we introduce a dual aggregation mechanism with dynamic weights for local updates, improving the global model’s ability to assimilate personalized knowledge from local models. Extensive experiments on multiple benchmark datasets demonstrate that FedSiam-DA significantly improves model performance under non-IID data conditions compared to existing methods.

IEEE Transactions on Mobile ComputingVol. 24(2)
Qilu University of Technology (CN), Guangzhou University (CN), Shandong Academy of Sciences (CN), Zhejiang University (CN), Shandong University of Science and Technology (CN)
Openalex Percentile: Top 8%
Privacy-Preserving Technologies in Data
2.78
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.