Fedavg-Db: A Dual-Loop Dynamic Batch Optimization Framework for Efficient and Robust Federated Learning

Federated Learning (FL), as a distributed machine learning paradigm, demonstrates significant potential in privacy-preserving scenarios but faces dual challenges of client data non-Independent and Identically Distributed (non-IID) characteristics and heterogeneous computing resources. Existing methods like FedAvg employ fixed batch sizes, leading to constrained convergence rates and suboptimal resource utilization. This paper proposes FedAvg-DB, a dynamic batch adjustment framework featuring a dual-loop optimization architecture: At the client level, a three-phase sliding window mechanism monitors loss improvement rate (r_k) and variance (σ_k) in real-time, establishing a threshold-triggered adaptive adjustment system; At the server level, an innovative aggregation strategy integrating median calibration and momentum smoothing effectively mitigates data distribution bias. Experiments on CIFAR-10/100 and FEMNIST datasets demonstrate that the proposed method achieves 18.3% faster convergence, 34.6% lower client loss variance, and 10.3% energy reduction compared to traditional FedAvg. Ablation studies confirm the synergistic effects of dynamic batch adjustment and learning rate square-root scaling rules, validating the framework's effectiveness in practical applications such as medical image segmentation (5.2% Dice coefficient improvement) and industrial predictive maintenance (12.7% RMSE reduction).

Publication Details

Journal
Springer Link (Chiba Institute of Technology)
Published
2025-09-08
DOI
https://doi.org/10.1051/itmconf/20257804007/pdf
Primary Topic
Geochemistry and Geologic Mapping
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fedavg-Db: A Dual-Loop Dynamic Batch Optimization Framework for Efficient and Robust Federated Learning

Springer Link (Chiba Institute of Technology)
Geochemistry and Geologic Mapping
article

Fedavg-Db: A Dual-Loop Dynamic Batch Optimization Framework for Efficient and Robust Federated Learning

article en

Abstract

Federated Learning (FL), as a distributed machine learning paradigm, demonstrates significant potential in privacy-preserving scenarios but faces dual challenges of client data non-Independent and Identically Distributed (non-IID) characteristics and heterogeneous computing resources. Existing methods like FedAvg employ fixed batch sizes, leading to constrained convergence rates and suboptimal resource utilization. This paper proposes FedAvg-DB, a dynamic batch adjustment framework featuring a dual-loop optimization architecture: At the client level, a three-phase sliding window mechanism monitors loss improvement rate (r_k) and variance (σ_k) in real-time, establishing a threshold-triggered adaptive adjustment system; At the server level, an innovative aggregation strategy integrating median calibration and momentum smoothing effectively mitigates data distribution bias. Experiments on CIFAR-10/100 and FEMNIST datasets demonstrate that the proposed method achieves 18.3% faster convergence, 34.6% lower client loss variance, and 10.3% energy reduction compared to traditional FedAvg. Ablation studies confirm the synergistic effects of dynamic batch adjustment and learning rate square-root scaling rules, validating the framework's effectiveness in practical applications such as medical image segmentation (5.2% Dice coefficient improvement) and industrial predictive maintenance (12.7% RMSE reduction).

Springer Link (Chiba Institute of Technology)
Openalex Percentile: Top 44%
Geochemistry and Geologic Mapping
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.