End-to-end deep reinforcement learning for multi-agent collaborative exploration

• Main Authors: Chen, Zichen, Subagdja, Bhuditama, Tan, Ah-Hwee
• 其他作者: School of Electrical and Electronic Engineering
• 格式: Conference or Workshop Item
• 語言: English
• 出版: 2021
• 主題: Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence; Multi-agent Exploration; Deep Learning
• 在線閱讀: https://hdl.handle.net/10356/148510
• 機構: Nanyang Technological University

Exploring an unknown environment by multiple autonomous robots is a major challenge in robotics domains. As multiple robots are assigned to explore different locations, they may interfere each other making the overall tasks less efficient. In this paper, we present a new model called CNN-based Multi-agent Proximal Policy Optimization (CMAPPO) to multi-agent exploration wherein the agents learn the effective strategy to allocate and explore the environment using a new deep reinforcement learning architecture. The model combines convolutional neural network to process multi-channel visual inputs, curriculum-based learning, and PPO algorithm for motivation based reinforcement learning. Evaluations show that the proposed method can learn more efficient strategy for multiple agents to explore the environment than the conventional frontier-based method.