SCC-based improved reachability analysis for Markov decision processes

• Main Authors: GUI, Lin, SUN, Jun, SONG, Songzheng, LIU, Yang, DONG, Jin Song
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2014
• Subjects: Convex Hull; Model Check; Markov Decision Process; Discrete Time Markov Chain; Reachability Analysis; Programming Languages and Compilers; Software Engineering
• Online Access: https://ink.library.smu.edu.sg/sis_research/4985; https://ink.library.smu.edu.sg/context/sis_research/article/5988/viewcontent/scc_based_improved.pdf
• Institution: Singapore Management University

Markov decision processes (MDPs) are extensively used to model systems with both probabilistic and nondeterministic behavior. The problem of calculating the probability of reaching certain system states (hereafter reachability analysis) is central to the MDP-based system analysis. It is known that e...