Distributed Optimization Under Uncertainty: A Cross-Paradigm Review and Future Directions

Due to its significant importance in many disciplines, distributed optimization under uncertainty has become an active research field over the past decade. This paper presents a cross-paradigm review of this development. We organize the literature around three approaches ordered by how much is known about the uncertainty: robust optimization, which uses set or support information; distributionally robust optimization, which uses partial distributional knowledge; and stochastic programming, which uses an estimated or specified distribution. These are regions of a spectrum rather than disjoint classes, and formulations that combine them are noted where they arise. For each approach, we examine modeling frameworks and distributed algorithmic adaptations, together with representative applications across different domains. We synthesize methodological trends, compare algorithmic properties, and identify open challenges for scalable distributed algorithms under uncertainty. Key findings include the widespread adaptation of classical algorithms, particularly the alternating direction method of multipliers (ADMM), across all uncertainty paradigms, alongside an evolution toward data-driven and adaptive methods for real-time uncertainty handling. We also highlight that many advanced centralized techniques for optimization under uncertainty remain only partially adapted to distributed settings, representing a significant research opportunity. Of the 112 reviewed studies falling within the 2015–2025 eligibility window, 59.8% address power and energy systems, 12.5% federated and distributed learning, and 5.4% robotics and autonomous systems, while other application domains contribute only isolated studies. The paper concludes with critical gaps and future directions spanning distributed reformulations, machine learning integration, multi-stage optimization, privacy-preserving computation, and cross-domain methodological unification.

Authors

Institutions

Publication Details

Journal
Mathematics
Published
2026-09-25
DOI
https://doi.org/10.3390/math14193489
Primary Topic
Stochastic Gradient Optimization Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Distributed Optimization Under Uncertainty: A Cross-Paradigm Review and Future Directions

Remy Ineza Mugenga, Pu Li, Abebe Geletu, Silas Steven Mirau
Mathematics
Stochastic Gradient Optimization Techniques
article

Distributed Optimization Under Uncertainty: A Cross-Paradigm Review and Future Directions

Remy Ineza Mugenga, Pu Li, Abebe Geletu, Silas Steven Mirau
article en

Abstract

Due to its significant importance in many disciplines, distributed optimization under uncertainty has become an active research field over the past decade. This paper presents a cross-paradigm review of this development. We organize the literature around three approaches ordered by how much is known about the uncertainty: robust optimization, which uses set or support information; distributionally robust optimization, which uses partial distributional knowledge; and stochastic programming, which uses an estimated or specified distribution. These are regions of a spectrum rather than disjoint classes, and formulations that combine them are noted where they arise. For each approach, we examine modeling frameworks and distributed algorithmic adaptations, together with representative applications across different domains. We synthesize methodological trends, compare algorithmic properties, and identify open challenges for scalable distributed algorithms under uncertainty. Key findings include the widespread adaptation of classical algorithms, particularly the alternating direction method of multipliers (ADMM), across all uncertainty paradigms, alongside an evolution toward data-driven and adaptive methods for real-time uncertainty handling. We also highlight that many advanced centralized techniques for optimization under uncertainty remain only partially adapted to distributed settings, representing a significant research opportunity. Of the 112 reviewed studies falling within the 2015–2025 eligibility window, 59.8% address power and energy systems, 12.5% federated and distributed learning, and 5.4% robotics and autonomous systems, while other application domains contribute only isolated studies. The paper concludes with critical gaps and future directions spanning distributed reformulations, machine learning integration, multi-stage optimization, privacy-preserving computation, and cross-domain methodological unification.

MathematicsVol. 14(19)
Technische Universität Ilmenau (DE), African Institute for Mathematical Sciences (RW), Nelson Mandela African Institution of Science and Technology (TZ)
Affordable and clean energy
Openalex Percentile: Top 9%
Stochastic Gradient Optimization Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.