Deeper Inside Finite-state Markov chains

The effective application of Markov chains has been paid much attention, and it has raised a lot of thcoretical and applied problems. In this paper, we would like to approach One of these problems which is finding the long-run behavior of extremely huge-state Markov chains according to the direc...

Full description

Saved in:
Bibliographic Details
Main Authors: Le, Trung Kien, Le, Trung Hieu, Tran, Loc Hung, Nguyen, Duy Tien
Format: Article
Language:English
Published: H. : ĐHQGHN 2017
Subjects:
Online Access:http://repository.vnu.edu.vn/handle/VNU_123/57461
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Vietnam National University, Hanoi
Language: English
Description
Summary:The effective application of Markov chains has been paid much attention, and it has raised a lot of thcoretical and applied problems. In this paper, we would like to approach One of these problems which is finding the long-run behavior of extremely huge-state Markov chains according to the direction of investigating the structure of Markov Graph to reduce complexity of computation. We focus on the way to access to the finite-state Markov chain theory via Graph theory. We suggested some basic knowledge about state classification and a small project of modelling the structure and the moving process of the finite-state Markov chain model. This project based on the remark that it is impossible to study deeperly the finite-state Markov Chain theory if we do not have the clear sense about the structure and the movement of it.