Difference of convex functions programming for policy optimization in reinforcement learning

• Main Author: KUMAR, Akshat
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2024
• Subjects: Agent policy; Reinforcement learning optimization; Difference-of-convex functions; Reinforcement learning algorithm; Artificial Intelligence and Robotics
• Online Access: https://ink.library.smu.edu.sg/sis_research/9926
• Institution: Singapore Management University

We formulate the problem of optimizing an agent's policy within the Markov decision process (MDP) model as a difference-of-convex functions (DC) program. The DC perspective enables optimizing the policy iteratively where each iteration constructs an easier-to-optimize lower bound on the value f...