Control problem for the Markov-modulated Poisson process in the averaging schema

This paper discusses the control problem for the stochastic evolution system under Markov-modulated Poisson perturbations in the averaging schema. Such a perturbation process combines a Poisson process with a Markov process that modulates the intensity of jumps. Formulating the problem allows us to model systems with transitions between regimes or significant rare jumps. In this problem, the control function is determined by the condition of the extremum of the quality criterion function. The asymptotic properties of the stochastic evolution and control coupled process are being investigated initially. For this purpose, we build the generator for the limit process, solving the singular perturbation problem of the original process. The obtained result allows us to formulate and prove the theorem about weak convergence of the evolution process to the averaged one. The solution of a deterministic differential equation determines the limit process for a stochastic evolution system at increasing time intervals. Then, the obtained result allows us to formulate the conditions that ensure the weak convergence of the control function to optimal control.

Authors

Publication Details

Journal
Journal of Applied and Numerical Analysis
Published
2025-09-16
DOI
https://doi.org/10.30970/ana.2025.3.28
Primary Topic
Aquatic and Environmental Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Control problem for the Markov-modulated Poisson process in the averaging schema

Uliana Khimka, Ya. M. Chabanyuk, S. A. Semenyuk, N. Kukharska
Journal of Applied and Numerical Analysis
Aquatic and Environmental Studies
article

Control problem for the Markov-modulated Poisson process in the averaging schema

Uliana Khimka, Ya. M. Chabanyuk, S. A. Semenyuk, N. Kukharska
article en

Abstract

This paper discusses the control problem for the stochastic evolution system under Markov-modulated Poisson perturbations in the averaging schema. Such a perturbation process combines a Poisson process with a Markov process that modulates the intensity of jumps. Formulating the problem allows us to model systems with transitions between regimes or significant rare jumps. In this problem, the control function is determined by the condition of the extremum of the quality criterion function. The asymptotic properties of the stochastic evolution and control coupled process are being investigated initially. For this purpose, we build the generator for the limit process, solving the singular perturbation problem of the original process. The obtained result allows us to formulate and prove the theorem about weak convergence of the evolution process to the averaged one. The solution of a deterministic differential equation determines the limit process for a stochastic evolution system at increasing time intervals. Then, the obtained result allows us to formulate the conditions that ensure the weak convergence of the control function to optimal control.

Journal of Applied and Numerical AnalysisVol. 3
Openalex Percentile: Top 73%
Aquatic and Environmental Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.