A hybrid architecture combining reactive plan execution and reactive learning

• Main Authors: KARIM, Samin, SONENBERG, Liz, TAN, Ah-Hwee
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2006
• Subjects: Reinforcement Learner; Multiagent System; Domain Expert; Navigation Task; Hybrid Architecture; Databases and Information Systems; Systems Architecture
• Online Access: https://ink.library.smu.edu.sg/sis_research/6699; https://ink.library.smu.edu.sg/context/sis_research/article/7702/viewcontent/LNAI_4099___PRICAI_2006__Trends_in_Artificial_Intelligence.pdf
• Institution: Singapore Management University

Developing software agents has been complicated by the problem of how knowledge should be represented and used. Many researchers have identified that agents need not require the use of complex representations, but in many cases suffice to use “the world” as their representation. However, the problem of introspection, both by the agents themselves and by (human) domain experts, requires a knowledge representation with a higher level of abstraction that is more ‘understandable’. Learning and adaptation in agents has traditionally required knowledge to be represented at an arbitrary, low-level of abstraction. We seek to create an agent that has the capability of learning as well as utilising knowledge represented at a higher level of abstraction. We firstly explore a reactive learner (Falcon) and reactive plan execution engine based on BDI (JACK) through experiments and analysis. We then describe an architecture we have developed that combines the BDI framework to the low-level reinforcement learner and present promising results from experiments using our minefield navigation domain.