Planning and learning for Non-Markovian negative side effects using finite state controllers

• Main Authors: SRIVASTAVA, Aishwarya, Saisubramanian, Sandhya, Paruchuri, Praveen, KUMAR, Akshat, Zilberstein, Shlomo
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: Constrained Markov decision process; Finite-state controllers; Incomplete model; Non-Markovian; Artificial Intelligence and Robotics
• Online Access: https://ink.library.smu.edu.sg/sis_research/8092; https://ink.library.smu.edu.sg/context/sis_research/article/9095/viewcontent/26767_pvoa.pdf
• Institution: Singapore Management University

Autonomous systems are often deployed in the open world where it is hard to obtain complete specifications of objectives and constraints. Operating based on an incomplete model can produce negative side effects (NSEs), which affect the safety and reliability of the system. We focus on mitigating NSE...