Method of calculating stationary probability distribution in Markov chain in modeling social and economic processes

This article proposes an algorithm for calculating the vector of the stationary probability distribution for the Markov chain. Markov chains are effective for modeling complex systems in dynamics, including socio-economic processes, since instead of deterministic equations and dependencies, various scenarios are taken into account. At the same time, with an increase in the number of options, the complexity of solving the problem of finding a stationary probability distribution increases sharply. The idea of the algorithm is to replace the problem of solving the characteristic equation of the n-th degree for the matrix of probability transitions with the problem of linear programming. The mathematical formulation of the problem is formulated, including the definition of independent variables, finding the type of objective function, restrictions in the form of equalities. To perform calculations, a program was created in the algorithmic language Python. In order to verify and prove its effectiveness, calculations were carried out both for typical tasks of a general nature and for specific socio-economic cases. The obtained results completely coincided with the test ones and showed that the complexity of the algorithm is O(n). The developed technique allows wider application of Markov in the study of socio-economic processes and obtain more reliable results due to an increase in the number of probabilistic states of the system.

Authors

Institutions

Publication Details

Journal
Vestnik NSUEM
Published
2024-10-16
DOI
https://doi.org/10.34020/2073-6495-2024-3-134-145
Primary Topic
Matrix Theory and Algorithms
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Method of calculating stationary probability distribution in Markov chain in modeling social and economic processes

E.V. Kuligin
Vestnik NSUEM
Matrix Theory and Algorithms
article

Method of calculating stationary probability distribution in Markov chain in modeling social and economic processes

E.V. Kuligin
article en

Abstract

This article proposes an algorithm for calculating the vector of the stationary probability distribution for the Markov chain. Markov chains are effective for modeling complex systems in dynamics, including socio-economic processes, since instead of deterministic equations and dependencies, various scenarios are taken into account. At the same time, with an increase in the number of options, the complexity of solving the problem of finding a stationary probability distribution increases sharply. The idea of the algorithm is to replace the problem of solving the characteristic equation of the n-th degree for the matrix of probability transitions with the problem of linear programming. The mathematical formulation of the problem is formulated, including the definition of independent variables, finding the type of objective function, restrictions in the form of equalities. To perform calculations, a program was created in the algorithmic language Python. In order to verify and prove its effectiveness, calculations were carried out both for typical tasks of a general nature and for specific socio-economic cases. The obtained results completely coincided with the test ones and showed that the complexity of the algorithm is O(n). The developed technique allows wider application of Markov in the study of socio-economic processes and obtain more reliable results due to an increase in the number of probabilistic states of the system.

Vestnik NSUEM(3)
Novosibirsk State University of Economics and Management (RU)
Openalex Percentile: Top 78%
Matrix Theory and Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Method of calculating stationary probability distribution in Markov chain in modeling social and economic processes — E.V. Kuligin · Vestnik NSUEM (2024) | TGRS Research Map | TGRS