Relative-Error Composite Federated Optimization with One Server-Side Proximal Step per Round

We consider deterministic composite federated optimization, in which distributed smooth client objectives are combined with a shared, possibly nonsmooth, regularizer. We propose Relative-Error Composite FedDyn (REC-FedDyn), an inexact method that supports partial participation, with one server-side proximal evaluation per communication round. REC-FedDyn employs a directly testable relative-error criterion that allows each client to independently control the accuracy of its local subproblem, without a server-side acceptance test. We establish almost-sure iterate convergence for strongly convex and convex problems, almost-sure asymptotic stationarity for nonconvex problems, and communication and parallel gradient-evaluation complexity bounds, all under partial participation and without assuming bounded data heterogeneity. Experiments on image inpainting, fMRI prediction, and neural-network classification with structured regularization demonstrate efficiency and robustness across levels of data heterogeneity and client participation.

Authors

Publication Details

Journal
arXiv (Cornell University)
Published
2026-11-03
DOI
https://doi.org/10.48550/arxiv.2611.04448
Primary Topic
Privacy-Preserving Technologies in Data
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Relative-Error Composite Federated Optimization with One Server-Side Proximal Step per Round

Sirong Dai, Jianting Pan, Ming Yan
arXiv (Cornell University)
Privacy-Preserving Technologies in Data
preprint

Relative-Error Composite Federated Optimization with One Server-Side Proximal Step per Round

Sirong Dai, Jianting Pan, Ming Yan
preprint en

Abstract

We consider deterministic composite federated optimization, in which distributed smooth client objectives are combined with a shared, possibly nonsmooth, regularizer. We propose Relative-Error Composite FedDyn (REC-FedDyn), an inexact method that supports partial participation, with one server-side proximal evaluation per communication round. REC-FedDyn employs a directly testable relative-error criterion that allows each client to independently control the accuracy of its local subproblem, without a server-side acceptance test. We establish almost-sure iterate convergence for strongly convex and convex problems, almost-sure asymptotic stationarity for nonconvex problems, and communication and parallel gradient-evaluation complexity bounds, all under partial participation and without assuming bounded data heterogeneity. Experiments on image inpainting, fMRI prediction, and neural-network classification with structured regularization demonstrate efficiency and robustness across levels of data heterogeneity and client participation.

arXiv (Cornell University)
Privacy-Preserving Technologies in Data
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
Relative-Error Composite Federated Optimization with One Server-Side Proximal Step per Round — Sirong Dai, Jianting Pan, et al. · arXiv (Cornell University) (2026) | TGRS Research Map | TGRS