Sample-Based Consistency in Infinite-Dimensional Conic-Constrained Stochastic Optimization

Abstract. This paper is concerned with a class of stochastic optimization problems defined on a Banach space with almost sure conic-type constraints. For this class of problems, we investigate the consistency of optimal values and solutions corresponding to sample average approximation. Consistency is also shown in the case where a Moreau–Yosida-type regularization of the constraint is used. Additionally, the consistency of Karush–Kuhn–Tucker conditions is shown under mild conditions. This work provides theoretical justification for the numerical computation of solutions frequently used in the literature. Several applications are explored showing the flexibility of the framework. We cover nonparametric regression over Sobolev balls, operator learning, optimal transport, optimization with dynamical systems under uncertainty, and optimization with partial differential equations under uncertainty.