Draft & Refine: Efficient Resource Management in Federated Learning under Pathological Labels Skew

In Federated Learning (FL), network end-nodes use private data for the local training of classification models that are periodically synchronized with a remote server to update a global model. A key limitation in FL is the high network traffic required to achieve acceptable accuracy, particularly when each client has samples of only a few classes, a problem known as pathological labels skew. Under such constraints, local models become biased toward the available classes, and more synchronization rounds are needed to converge, saturating the communication budget. We address this issue with Draft & Refine, a new resource management strategy to optimize accuracy by dynamically controlling clients' participation based on their remaining budget. Our approach consists of two learning phases: a low-effort drafting phase with only a few clients selected for synchronization, followed by a refinement phase with increased client participation. The available data traffic is used as the control variable to set the duration of the two phases. The proposed strategy outperforms state-of-the-art FL schemes with up to 12.20 % higher accuracy within the same data traffic.

Authors

Institutions

Publication Details

Published
2024-11-18
DOI
https://doi.org/10.1109/icecs61496.2024.10849333
Citations
2
Primary Topic
Privacy-Preserving Technologies in Data
Type
article
Field-Weighted Citation Impact
0.69
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Draft & Refine: Efficient Resource Management in Federated Learning under Pathological Labels Skew

Enrico Macii, Erich Malan, Andrea Calimera, Valentino Peluso
2 citations
Privacy-Preserving Technologies in Data
0.69
article

Draft & Refine: Efficient Resource Management in Federated Learning under Pathological Labels Skew

Enrico Macii, Erich Malan, Andrea Calimera, Valentino Peluso
article en
2 citations

Abstract

In Federated Learning (FL), network end-nodes use private data for the local training of classification models that are periodically synchronized with a remote server to update a global model. A key limitation in FL is the high network traffic required to achieve acceptable accuracy, particularly when each client has samples of only a few classes, a problem known as pathological labels skew. Under such constraints, local models become biased toward the available classes, and more synchronization rounds are needed to converge, saturating the communication budget. We address this issue with Draft & Refine, a new resource management strategy to optimize accuracy by dynamically controlling clients' participation based on their remaining budget. Our approach consists of two learning phases: a low-effort drafting phase with only a few clients selected for synchronization, followed by a refinement phase with increased client participation. The available data traffic is used as the control variable to set the duration of the two phases. The proposed strategy outperforms state-of-the-art FL schemes with up to 12.20 % higher accuracy within the same data traffic.

Politecnico di Torino (IT)
Decent work and economic growth
Openalex Percentile: Top 22%
Privacy-Preserving Technologies in Data
0.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.