On One Approach to Obtaining Estimates of the Rate of Convergence to the Limiting Regime of Markov Chains

We revisit the problem of the computation of the limiting characteristics of (in)homogeneous continuous-time Markov chains with the finite state space. In general, it can be performed only numerically. The common rule of thumb is to interrupt calculations after quite some time, hoping that the values at some distant time interval will represent the sought-after solution. Convergence or ergodicity bounds, when available, can be used to answer such questions more accurately; i.e., they can indicate how to choose the position and the length of that distant time interval. The logarithmic norm method is a general technique that may allow one to obtain such bounds. Although it can handle continuous-time Markov chains with both finite and countable state spaces, its downside is the need to guess the proper similarity transformations, which may not exist. In this paper, we introduce a new technique, which broadens the scope of the logarithmic norm method. This is achieved by firstly splitting the generator of a Markov chain and then merging the convergence bounds of each block into a single bound. The proof of concept is illustrated by simple examples of the queueing theory.

Authors

Institutions

Publication Details

Journal
Mathematics
Published
2024-09-06
DOI
https://doi.org/10.3390/math12172763
Citations
1
Primary Topic
Advanced Queuing Theory Analysis
Type
article
Field-Weighted Citation Impact
0.53

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

On One Approach to Obtaining Estimates of the Rate of Convergence to the Limiting Regime of Markov Chains

Yacov Satin, Alexander Zeifman, Ilya Usov, Rostislav Razumchik
1 citations
Mathematics
Advanced Queuing Theory Analysis
0.53
article

On One Approach to Obtaining Estimates of the Rate of Convergence to the Limiting Regime of Markov Chains

Yacov Satin, Alexander Zeifman, Ilya Usov, Rostislav Razumchik
article en
1 citations

Abstract

We revisit the problem of the computation of the limiting characteristics of (in)homogeneous continuous-time Markov chains with the finite state space. In general, it can be performed only numerically. The common rule of thumb is to interrupt calculations after quite some time, hoping that the values at some distant time interval will represent the sought-after solution. Convergence or ergodicity bounds, when available, can be used to answer such questions more accurately; i.e., they can indicate how to choose the position and the length of that distant time interval. The logarithmic norm method is a general technique that may allow one to obtain such bounds. Although it can handle continuous-time Markov chains with both finite and countable state spaces, its downside is the need to guess the proper similarity transformations, which may not exist. In this paper, we introduce a new technique, which broadens the scope of the logarithmic norm method. This is achieved by firstly splitting the generator of a Markov chain and then merging the convergence bounds of each block into a single bound. The proof of concept is illustrated by simple examples of the queueing theory.

MathematicsVol. 12(17)
Russian State University for the Humanities (RU), Russian Academy of Sciences (RU), Vologda State University (RU), Lomonosov Moscow State University (RU)
Ministry of Science and Higher Education of the Russian Federation
Openalex Percentile: Top 26%
Advanced Queuing Theory Analysis
0.53
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.