FedHST: Federated Hybrid Spatial–Temporal Optimization for robust non-IID learning

Server-side adaptive optimizers in Federated Learning (FL), such as FedAdam and FedAvgM, scale global updates using historical temporal statistics but do not explicitly model instantaneous cross-client variance within a single communication round. Under severe statistical heterogeneity (non-IID data), this can leave the adaptive step size insufficiently damped precisely when local client updates conflict most. We propose FedHST (Federated Hybrid Spatial-Temporal Optimization), a server-side aggregation framework that augments the temporal second-moment estimate with an instantaneous, coordinate-wise cross-client spatial variance term. This term acts as an additional damper under high client disagreement and vanishes under consensus, at which point FedHST reduces to standard temporal-only adaptation. We establish a non-convex convergence rate of 𝒪(1/T), with the residual term showing explicitly how the spatial damping coefficient γ moderates the effect of statistical heterogeneity on convergence. We evaluate FedHST on FashionMNIST, CIFAR-10, and CIFAR-100 under Dirichlet-partitioned non-IID splits (α∈{0.1,0.3}), comparing against FedAdam and FedDyn - the strongest representatives of the adaptive server-optimization and dynamic client-regularization paradigms, respectively - over three independent random seeds with paired significance testing; FedAvgM, FedYogi, FedAdagrad, FedProx, and SCAFFOLD are reviewed in Related Work. FedHST attains accuracy statistically indistinguishable from, or modestly and significantly exceeding (up to + 0.5 percentage points, p < 0.05 on FashionMNIST), FedAdam, while substantially and significantly outperforming FedDyn (+ 5 to + 28 percentage points across datasets, p < 0.01), at a computational overhead within 1-4% of FedAdam. Ablation studies further show that FedHST's advantage over FedAdam grows systematically with the number of local training epochs and with non-IID severity, consistent with the mechanism by which spatial damping is designed to activate under cross-client conflict.

Authors

Institutions

Publication Details

Journal
PLoS ONE
Published
2026-11-12
DOI
https://doi.org/10.1371/journal.pone.0360546
Primary Topic
Privacy-Preserving Technologies in Data
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

FedHST: Federated Hybrid Spatial–Temporal Optimization for robust non-IID learning

Duy-Dong Le, Thai-Thinh Dang
PLoS ONE
Privacy-Preserving Technologies in Data
article

FedHST: Federated Hybrid Spatial–Temporal Optimization for robust non-IID learning

Duy-Dong Le, Thai-Thinh Dang
article en

Abstract

Server-side adaptive optimizers in Federated Learning (FL), such as FedAdam and FedAvgM, scale global updates using historical temporal statistics but do not explicitly model instantaneous cross-client variance within a single communication round. Under severe statistical heterogeneity (non-IID data), this can leave the adaptive step size insufficiently damped precisely when local client updates conflict most. We propose FedHST (Federated Hybrid Spatial-Temporal Optimization), a server-side aggregation framework that augments the temporal second-moment estimate with an instantaneous, coordinate-wise cross-client spatial variance term. This term acts as an additional damper under high client disagreement and vanishes under consensus, at which point FedHST reduces to standard temporal-only adaptation. We establish a non-convex convergence rate of 𝒪(1/T), with the residual term showing explicitly how the spatial damping coefficient γ moderates the effect of statistical heterogeneity on convergence. We evaluate FedHST on FashionMNIST, CIFAR-10, and CIFAR-100 under Dirichlet-partitioned non-IID splits (α∈{0.1,0.3}), comparing against FedAdam and FedDyn - the strongest representatives of the adaptive server-optimization and dynamic client-regularization paradigms, respectively - over three independent random seeds with paired significance testing; FedAvgM, FedYogi, FedAdagrad, FedProx, and SCAFFOLD are reviewed in Related Work. FedHST attains accuracy statistically indistinguishable from, or modestly and significantly exceeding (up to + 0.5 percentage points, p < 0.05 on FashionMNIST), FedAdam, while substantially and significantly outperforming FedDyn (+ 5 to + 28 percentage points across datasets, p < 0.01), at a computational overhead within 1-4% of FedAdam. Ablation studies further show that FedHST's advantage over FedAdam grows systematically with the number of local training epochs and with non-IID severity, consistent with the mechanism by which spatial damping is designed to activate under cross-client conflict.

PLoS ONEVol. 21(11)
University of Economics Ho Chi Minh City (VN)
Đại học Kinh tế Thành phố Hồ Chí Minh
Privacy-Preserving Technologies in Data
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon