FedAWA: Aggregation Weight Adjustment in Federated Domain Generalization

Domain Generalization (DG) in the setting of federated learning (i.e. Federated Domain Generalization, FDG) is gaining increasing attention. FDG aims to learn a global model generalizing well to clients with unseen domains in a privacy-preserving manner. Existing works mainly focus on how to learn invariant features or transmit data distributions in a privacy-preserving manner, the correctness of aggregation weights has not been extensively discussed. In this paper, we discuss the rationality of aggregation weights and propose a novel method in FDG, namely FedAWA. We replace traditional weighted aggregation based on data volume with arithmetic mean. Then we propose confidence adjustment to adjust aggregation weights to ensure the rationality of aggregation weights due to the uncertainty of local model training. Moreover, we propose fairness adjustment to adjust local training epochs to prevent local models from contributing excessively or insufficiently to the global model. Our method can serve as a plug-and-play plugina. Experiments on several benchmarks have shown the effectiveness of our method, our method enhances the generalization improvement of federated learning algorithms.

Authors

Institutions

Publication Details

Published
2024-09-27
DOI
https://doi.org/10.1109/icip51287.2024.10647638
Citations
4
Primary Topic
Privacy-Preserving Technologies in Data
Type
article
Field-Weighted Citation Impact
1.39
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

FedAWA: Aggregation Weight Adjustment in Federated Domain Generalization

Lifeng Sun, Nan He, Yiming Chen
4 citations
Privacy-Preserving Technologies in Data
1.39
article

FedAWA: Aggregation Weight Adjustment in Federated Domain Generalization

Lifeng Sun, Nan He, Yiming Chen
article en
4 citations

Abstract

Domain Generalization (DG) in the setting of federated learning (i.e. Federated Domain Generalization, FDG) is gaining increasing attention. FDG aims to learn a global model generalizing well to clients with unseen domains in a privacy-preserving manner. Existing works mainly focus on how to learn invariant features or transmit data distributions in a privacy-preserving manner, the correctness of aggregation weights has not been extensively discussed. In this paper, we discuss the rationality of aggregation weights and propose a novel method in FDG, namely FedAWA. We replace traditional weighted aggregation based on data volume with arithmetic mean. Then we propose confidence adjustment to adjust aggregation weights to ensure the rationality of aggregation weights due to the uncertainty of local model training. Moreover, we propose fairness adjustment to adjust local training epochs to prevent local models from contributing excessively or insufficiently to the global model. Our method can serve as a plug-and-play plugina. Experiments on several benchmarks have shown the effectiveness of our method, our method enhances the generalization improvement of federated learning algorithms.

Tsinghua University (CN)
Reduced inequalities
Openalex Percentile: Top 15%
Privacy-Preserving Technologies in Data
1.39
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

FedAWA: Aggregation Weight Adjustment in Federated Domain Generalization — Lifeng Sun, Nan He, et al. · (2024) | TGRS Research Map | TGRS