Deeper Inside Finite-state Markov chains

• Main Authors: Le, Trung Kien, Le, Trung Hieu, Tran, Loc Hung, Nguyen, Duy Tien
• Format: Article
• Language: English
• Published: H. : ĐHQGHN 2017
• Subjects: Markov; Finite-state
• Online Access: http://repository.vnu.edu.vn/handle/VNU_123/57461
• Institution: Vietnam National University, Hanoi

The effective application of Markov chains has been paid much attention, and it has raised a lot of thcoretical and applied problems. In this paper, we would like to approach One of these problems which is finding the long-run behavior of extremely huge-state Markov chains according to the direction of investigating the structure of Markov Graph to reduce complexity of computation. We focus on the way to access to the finite-state Markov chain theory via Graph theory. We suggested some basic knowledge about state classification and a small project of modelling the structure and the moving process of the finite-state Markov chain model. This project based on the remark that it is impossible to study deeperly the finite-state Markov Chain theory if we do not have the clear sense about the structure and the movement of it.