Regret Function Minimization Algorithms

Introduction. The article addresses the problem of making optimal decisions under uncertainty by minimizing the Savage regret function. This function, which evaluates the difference between the actual outcome and the best possible outcome across all states of nature, is particularly useful in contexts where decision-makers are risk-averse and sensitive to potential loss. The authors propose two algorithms grounded in the subgradient projection method, adapted to handle a large number of possible states and constraints in a computationally efficient manner. Unlike classical approaches where all states of nature and constraints are evaluated at each iteration, the developed algorithms focus on reduced, representative subsets. This significantly reduces the computational load without sacrificing convergence to the optimal solution. The first algorithm deals with problems that include uncertainty but are unconstrained or lightly constrained. The second extends the approach to more general constraint sets. In both cases, theoretical guarantees regarding convergence are established under specific step-size and selection sequence conditions. The paper highlights how the algorithms avoid the need for computing exact values of the Savage function and its subgradients by using approximations that converge to the true values. This characteristic enhances the applicability of the methods to real-world scenarios where exact modeling of every possible state of nature is infeasible. Future research will focus on implementing and testing these methods on practical problems from economics and operations research, where decision-making under uncertainty is frequent and the number of constraints or states is high. These algorithms offer a practical balance between computational feasibility and decision quality. The purpose of the paper is to develop and justify effective algorithms for regret function minimization in decision-making processes under uncertainty, while ensuring convergence through reduced computational effort by operating on selected subsets of constraints and states. Results. Two algorithms are proposed, each using a modified subgradient projection technique. The first addresses unconstrained or lightly constrained decision problems, while the second handles more general constraints. In both cases, convergence to the optimal regret-minimizing solution is theoretically proven. The computational complexity is significantly reduced without loss of accuracy, thanks to the iterative use of partial subsets at each step. Conclusions. The proposed algorithms provide a reliable and efficient framework for solving regret-based decision problems. They are particularly suitable for large-scale applications where traditional methods are computationally intensive or infeasible. The techniques allow approximation of regret values and subgradients with sufficient accuracy to guarantee convergence. Keywords: decision-making, uncertainty, regret minimization, Savage function, subgradient method, convex optimization.

Authors

Institutions

Publication Details

Journal
Cybernetics and Computer Technologies
Published
2025-09-29
DOI
https://doi.org/10.34229/2707-451x.25.3.4
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Regret Function Minimization Algorithms

Anatolie Baractari, Anatol Godonoagă, Borys Chumakov
Cybernetics and Computer Technologies
Neural Networks and Applications
article

Regret Function Minimization Algorithms

Anatolie Baractari, Anatol Godonoagă, Borys Chumakov
article en

Abstract

Introduction. The article addresses the problem of making optimal decisions under uncertainty by minimizing the Savage regret function. This function, which evaluates the difference between the actual outcome and the best possible outcome across all states of nature, is particularly useful in contexts where decision-makers are risk-averse and sensitive to potential loss. The authors propose two algorithms grounded in the subgradient projection method, adapted to handle a large number of possible states and constraints in a computationally efficient manner. Unlike classical approaches where all states of nature and constraints are evaluated at each iteration, the developed algorithms focus on reduced, representative subsets. This significantly reduces the computational load without sacrificing convergence to the optimal solution. The first algorithm deals with problems that include uncertainty but are unconstrained or lightly constrained. The second extends the approach to more general constraint sets. In both cases, theoretical guarantees regarding convergence are established under specific step-size and selection sequence conditions. The paper highlights how the algorithms avoid the need for computing exact values of the Savage function and its subgradients by using approximations that converge to the true values. This characteristic enhances the applicability of the methods to real-world scenarios where exact modeling of every possible state of nature is infeasible. Future research will focus on implementing and testing these methods on practical problems from economics and operations research, where decision-making under uncertainty is frequent and the number of constraints or states is high. These algorithms offer a practical balance between computational feasibility and decision quality. The purpose of the paper is to develop and justify effective algorithms for regret function minimization in decision-making processes under uncertainty, while ensuring convergence through reduced computational effort by operating on selected subsets of constraints and states. Results. Two algorithms are proposed, each using a modified subgradient projection technique. The first addresses unconstrained or lightly constrained decision problems, while the second handles more general constraints. In both cases, convergence to the optimal regret-minimizing solution is theoretically proven. The computational complexity is significantly reduced without loss of accuracy, thanks to the iterative use of partial subsets at each step. Conclusions. The proposed algorithms provide a reliable and efficient framework for solving regret-based decision problems. They are particularly suitable for large-scale applications where traditional methods are computationally intensive or infeasible. The techniques allow approximation of regret values and subgradients with sufficient accuracy to guarantee convergence. Keywords: decision-making, uncertainty, regret minimization, Savage function, subgradient method, convex optimization.

Cybernetics and Computer Technologies(3)
Academy of Economic Studies of Moldova (MD), V.M. Glushkov Institute of Cybernetics (UA)
Openalex Percentile: Top 86%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.