Prioritized Shaping of Models for Solving DEC-POMDPs

• Main Authors: VARAKANTHAM, Pradeep Reddy, YEOH, William, Velagapudi, Prasanna, Scerri, Paul
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2012
• Subjects: DEC-POMDP; Uncertainty; Multi-Agent Systems; Artificial Intelligence and Robotics; Business; Operations Research, Systems Engineering and Industrial Engineering
• Online Access: https://ink.library.smu.edu.sg/sis_research/1607; https://ink.library.smu.edu.sg/context/sis_research/article/2606/viewcontent/C14___Prioritized_Shaping_of_Models_for_Solving_DEC_POMDPs__AAMAS2012_.pdf
• Institution: Singapore Management University

An interesting class of multi-agent POMDP planning problems can be solved by having agents iteratively solve individual POMDPs, find interactions with other individual plans, shape their transition and reward functions to encourage good interactions and discourage bad ones and then recompute a new plan. D-TREMOR showed that this approach can allow distributed planning for hundreds of agents. However, the quality and speed of the planning process depends on the prioritization scheme used. Lower priority agents shape their models with respect to the models of higher priority agents. In this paper, we introduce a new prioritization scheme that is guaranteed to converge and is empirically better, in terms of solution quality and planning time, than the existing prioritization scheme for some problems.