Learning provably stabilizing neural controllers for discrete-time stochastic systems

• Main Authors: ANSARIPOUR, Matin, CHATTERJEE, Krishnendu, HENZINGER, A. Thomas, LECHNER, Mathias, ZIKELIC, Dorde
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: Learning-based control; Stochastic systems; Martingales; Formal verification; Stabilization; Databases and Information Systems
• Online Access: https://ink.library.smu.edu.sg/sis_research/9067; https://ink.library.smu.edu.sg/context/sis_research/article/10070/viewcontent/978_3_031_45329_8.pdf
• Institution: Singapore Management University

We consider the problem of learning control policies in discrete-time stochastic systems which guarantee that the system stabilizes within some specified stabilization region with probability 1. Our approach is based on the novel notion of stabilizing ranking supermartingales (sRSMs) that we introdu...