Autonomous multi-agent collaborative environment exploration

Exploring an unknown environment with multiple autonomous agents is one of the fundamental research in mobility agents and is essential for numerous environment-related applications, such as autonomous cleaning, mowing, deploying, etc. The major challenge of multi-robot environment exploration is ho...

Full description

Saved in:
Bibliographic Details
Main Author: Luo, Tianze
Other Authors: Tan Ah Hwee
Format: Thesis-Master by Research
Language:English
Published: Nanyang Technological University 2020
Subjects:
Online Access:https://hdl.handle.net/10356/136784
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-136784
record_format dspace
spelling sg-ntu-dr.10356-1367842020-10-28T08:29:18Z Autonomous multi-agent collaborative environment exploration Luo, Tianze Tan Ah Hwee School of Computer Science and Engineering Nanyang Technological University asahtan@ntu.edu.sg Engineering::Computer science and engineering Exploring an unknown environment with multiple autonomous agents is one of the fundamental research in mobility agents and is essential for numerous environment-related applications, such as autonomous cleaning, mowing, deploying, etc. The major challenge of multi-robot environment exploration is how to achieve effective collaboration so that the overall exploration strategy is efficient. One of the typical approaches is the frontier-based exploration, in which the agents move to the appropriate frontier point to explore the environment. Furthermore, exploration through partitioning maps is another efficient explore strategy. However, although many exploration methods have been proposed, autonomous exploring an unknown environment by multiple agents still remains a difficult task. The main issue is due to the inefficient collaboration, e.g. the agents repetitively explore regions which have been explored by other agents. If many agents explore a certain area with few agents exploring other areas, the collaboration is inefficient. In contrast, allocating agents into separate areas of the map, with each agent exploring a separate area, can achieve highly efficient collaboration in the environment exploration task. Since efficient map exploration method can highly benefit numerous related applications and there exists a large gap in multi-agent collaborative exploration, in this report, we focus on developing more efficient multi-agent collaborative environment exploration methods. We propose an efficient and robust map segmentation method, and furthermore, propose an exploration method based on the segmentation algorithm. In addition, we apply reinforcement learning on this task, and propose a novel graph-based multi-agent deep reinforcement learning method in order to derive a more efficient and scalable environment exploration strategy. To evaluate the performance of our methods, we compare with the state-of-the-art map segmentation methods and environment exploration methods. The experimental results show that the map segmentation method can achieve more accurate map partitioning compared to the state-of-the-art segmentation methods. Based on the comprehensive understanding of the map through segmentation, our segmentation based exploration method can also achieve faster and more efficient exploration than the state-of-the-art exploration method. The graph-based multi-agent reinforcement learning method provides a special point of view on solving multi-agent environment exploration problem, and the results show that through this method, the agents are able to learn a better exploration strategy than non-learning methods. Master of Engineering 2020-01-24T04:15:07Z 2020-01-24T04:15:07Z 2019 Thesis-Master by Research Luo, T. (2019). Autonomous multi-agent collaborative environment exploration. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/136784 10.32657/10356/136784 en This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0). application/pdf Nanyang Technological University
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering
spellingShingle Engineering::Computer science and engineering
Luo, Tianze
Autonomous multi-agent collaborative environment exploration
description Exploring an unknown environment with multiple autonomous agents is one of the fundamental research in mobility agents and is essential for numerous environment-related applications, such as autonomous cleaning, mowing, deploying, etc. The major challenge of multi-robot environment exploration is how to achieve effective collaboration so that the overall exploration strategy is efficient. One of the typical approaches is the frontier-based exploration, in which the agents move to the appropriate frontier point to explore the environment. Furthermore, exploration through partitioning maps is another efficient explore strategy. However, although many exploration methods have been proposed, autonomous exploring an unknown environment by multiple agents still remains a difficult task. The main issue is due to the inefficient collaboration, e.g. the agents repetitively explore regions which have been explored by other agents. If many agents explore a certain area with few agents exploring other areas, the collaboration is inefficient. In contrast, allocating agents into separate areas of the map, with each agent exploring a separate area, can achieve highly efficient collaboration in the environment exploration task. Since efficient map exploration method can highly benefit numerous related applications and there exists a large gap in multi-agent collaborative exploration, in this report, we focus on developing more efficient multi-agent collaborative environment exploration methods. We propose an efficient and robust map segmentation method, and furthermore, propose an exploration method based on the segmentation algorithm. In addition, we apply reinforcement learning on this task, and propose a novel graph-based multi-agent deep reinforcement learning method in order to derive a more efficient and scalable environment exploration strategy. To evaluate the performance of our methods, we compare with the state-of-the-art map segmentation methods and environment exploration methods. The experimental results show that the map segmentation method can achieve more accurate map partitioning compared to the state-of-the-art segmentation methods. Based on the comprehensive understanding of the map through segmentation, our segmentation based exploration method can also achieve faster and more efficient exploration than the state-of-the-art exploration method. The graph-based multi-agent reinforcement learning method provides a special point of view on solving multi-agent environment exploration problem, and the results show that through this method, the agents are able to learn a better exploration strategy than non-learning methods.
author2 Tan Ah Hwee
author_facet Tan Ah Hwee
Luo, Tianze
format Thesis-Master by Research
author Luo, Tianze
author_sort Luo, Tianze
title Autonomous multi-agent collaborative environment exploration
title_short Autonomous multi-agent collaborative environment exploration
title_full Autonomous multi-agent collaborative environment exploration
title_fullStr Autonomous multi-agent collaborative environment exploration
title_full_unstemmed Autonomous multi-agent collaborative environment exploration
title_sort autonomous multi-agent collaborative environment exploration
publisher Nanyang Technological University
publishDate 2020
url https://hdl.handle.net/10356/136784
_version_ 1683493092082057216