Optimal Control of Scalar Diffusions with Finite Action Sets

We study a scalar finite-horizon controlled diffusion with a finite action set. An action may affect the drift, the instantaneous variance, or both, and performance is assessed by a uniformly convex terminal deviation cost. The model represents systems in which decisions are made continuously in time but only finitely many operating settings are available. Under uniform nondegeneracy and an explicit shape condition on the terminal cost, we show that the value function is classical at positive times, establish global positive upper and lower bounds for its second state derivative, and prove that the ratio of its first and second state derivatives is strictly increasing. This ordering implies that each action's optimality region is connected, the active actions occur in monotone order, and adjacent regions are separated by unique switching boundaries. It also yields an exact coefficient-based screen that removes actions that cannot be optimal on any open state region. For smooth continuous-action benchmarks, both the value loss from restricting the action set and the additional loss from rounding the continuous optimal feedback to the nearest available action decrease quadratically with the action-set resolution. Numerical experiments illustrate the resulting action screens, threshold policies, and implementation losses.

Authors

Publication Details

Journal
arXiv (Cornell University)
Published
2026-10-27
DOI
https://doi.org/10.48550/arxiv.2610.37344
Primary Topic
Stochastic processes and financial applications
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Optimal Control of Scalar Diffusions with Finite Action Sets

Linyu Miao
arXiv (Cornell University)
Stochastic processes and financial applications
preprint

Optimal Control of Scalar Diffusions with Finite Action Sets

Linyu Miao
preprint en

Abstract

We study a scalar finite-horizon controlled diffusion with a finite action set. An action may affect the drift, the instantaneous variance, or both, and performance is assessed by a uniformly convex terminal deviation cost. The model represents systems in which decisions are made continuously in time but only finitely many operating settings are available. Under uniform nondegeneracy and an explicit shape condition on the terminal cost, we show that the value function is classical at positive times, establish global positive upper and lower bounds for its second state derivative, and prove that the ratio of its first and second state derivatives is strictly increasing. This ordering implies that each action's optimality region is connected, the active actions occur in monotone order, and adjacent regions are separated by unique switching boundaries. It also yields an exact coefficient-based screen that removes actions that cannot be optimal on any open state region. For smooth continuous-action benchmarks, both the value loss from restricting the action set and the additional loss from rounding the continuous optimal feedback to the nearest available action decrease quadratically with the action-set resolution. Numerical experiments illustrate the resulting action screens, threshold policies, and implementation losses.

arXiv (Cornell University)
Stochastic processes and financial applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon