SEAPoT-RL: Selective exploration algorithm for policy transfer in RL

• Main Authors: NARAYAN, Akshay, LI, Zhuoru, LEONG, Tze-Yun
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2017
• Subjects: Transfer learning; policy transfer; reinforcement learning; Numerical Analysis and Scientific Computing; Theory and Algorithms
• Online Access: https://ink.library.smu.edu.sg/sis_research/3762; https://ink.library.smu.edu.sg/context/sis_research/article/4764/viewcontent/14729_66712_1_PB.pdf
• Institution: Singapore Management University

We propose a new method for transferring a policy from a source task to a target task in model-based reinforcement learning. Our work is motivated by scenarios where a robotic agent operates in similar but challenging environments, such as hospital wards, differentiated by structural arrangements or obstacles, such as furniture. We address problems that require fast responses adapted from incomplete, prior knowledge of the agent in new scenarios. We present an efficient selective exploration strategy that maximally reuses the source task policy. Reuse efficiency is effected through identifying sub-spaces that are different in the target environment, thus limiting the exploration needed in the target task. We empirically show that SEAPoT performs better in terms of jump starts and cumulative average rewards, as compared to existing state-of-the-art policy reuse methods.