Autonomous multi-agent collaborative environment exploration
Exploring an unknown environment with multiple autonomous agents is one of the fundamental research in mobility agents and is essential for numerous environment-related applications, such as autonomous cleaning, mowing, deploying, etc. The major challenge of multi-robot environment exploration is ho...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Thesis-Master by Research |
Language: | English |
Published: |
Nanyang Technological University
2020
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/136784 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-136784 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1367842020-10-28T08:29:18Z Autonomous multi-agent collaborative environment exploration Luo, Tianze Tan Ah Hwee School of Computer Science and Engineering Nanyang Technological University asahtan@ntu.edu.sg Engineering::Computer science and engineering Exploring an unknown environment with multiple autonomous agents is one of the fundamental research in mobility agents and is essential for numerous environment-related applications, such as autonomous cleaning, mowing, deploying, etc. The major challenge of multi-robot environment exploration is how to achieve effective collaboration so that the overall exploration strategy is efficient. One of the typical approaches is the frontier-based exploration, in which the agents move to the appropriate frontier point to explore the environment. Furthermore, exploration through partitioning maps is another efficient explore strategy. However, although many exploration methods have been proposed, autonomous exploring an unknown environment by multiple agents still remains a difficult task. The main issue is due to the inefficient collaboration, e.g. the agents repetitively explore regions which have been explored by other agents. If many agents explore a certain area with few agents exploring other areas, the collaboration is inefficient. In contrast, allocating agents into separate areas of the map, with each agent exploring a separate area, can achieve highly efficient collaboration in the environment exploration task. Since efficient map exploration method can highly benefit numerous related applications and there exists a large gap in multi-agent collaborative exploration, in this report, we focus on developing more efficient multi-agent collaborative environment exploration methods. We propose an efficient and robust map segmentation method, and furthermore, propose an exploration method based on the segmentation algorithm. In addition, we apply reinforcement learning on this task, and propose a novel graph-based multi-agent deep reinforcement learning method in order to derive a more efficient and scalable environment exploration strategy. To evaluate the performance of our methods, we compare with the state-of-the-art map segmentation methods and environment exploration methods. The experimental results show that the map segmentation method can achieve more accurate map partitioning compared to the state-of-the-art segmentation methods. Based on the comprehensive understanding of the map through segmentation, our segmentation based exploration method can also achieve faster and more efficient exploration than the state-of-the-art exploration method. The graph-based multi-agent reinforcement learning method provides a special point of view on solving multi-agent environment exploration problem, and the results show that through this method, the agents are able to learn a better exploration strategy than non-learning methods. Master of Engineering 2020-01-24T04:15:07Z 2020-01-24T04:15:07Z 2019 Thesis-Master by Research Luo, T. (2019). Autonomous multi-agent collaborative environment exploration. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/136784 10.32657/10356/136784 en This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0). application/pdf Nanyang Technological University |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Computer science and engineering |
spellingShingle |
Engineering::Computer science and engineering Luo, Tianze Autonomous multi-agent collaborative environment exploration |
description |
Exploring an unknown environment with multiple autonomous agents is one of the fundamental research in mobility agents and is essential for numerous environment-related applications, such as autonomous cleaning, mowing, deploying, etc. The major challenge of multi-robot environment exploration is how to achieve effective collaboration so that the overall exploration strategy is efficient. One of the typical approaches is the frontier-based exploration, in which the agents move to the appropriate frontier point to explore the environment. Furthermore, exploration through partitioning maps is another efficient explore strategy.
However, although many exploration methods have been proposed, autonomous exploring an unknown environment by multiple agents still remains a difficult task. The main issue is due to the inefficient collaboration, e.g. the agents repetitively explore regions which have been explored by other agents. If many agents explore a certain area with few agents exploring other areas, the collaboration is inefficient. In contrast, allocating agents into separate areas of the map, with each agent exploring a separate area, can achieve highly efficient collaboration in the environment exploration task.
Since efficient map exploration method can highly benefit numerous related applications and there exists a large gap in multi-agent collaborative exploration, in this report, we focus on developing more efficient multi-agent collaborative environment exploration methods. We propose an efficient and robust map segmentation method, and furthermore, propose an exploration method based on the segmentation algorithm. In addition, we apply reinforcement learning on this task, and propose a novel graph-based multi-agent deep reinforcement learning method in order to derive a more efficient and scalable environment exploration strategy.
To evaluate the performance of our methods, we compare with the state-of-the-art map segmentation methods and environment exploration methods. The experimental results show that the map segmentation method can achieve more accurate map partitioning compared to the state-of-the-art segmentation methods. Based on the comprehensive understanding of the map through segmentation, our segmentation based exploration method can also achieve faster and more efficient exploration than the state-of-the-art exploration method. The graph-based multi-agent reinforcement learning method provides a special point of view on solving multi-agent environment exploration problem, and the results show that through this method, the agents are able to learn a better exploration strategy than non-learning methods. |
author2 |
Tan Ah Hwee |
author_facet |
Tan Ah Hwee Luo, Tianze |
format |
Thesis-Master by Research |
author |
Luo, Tianze |
author_sort |
Luo, Tianze |
title |
Autonomous multi-agent collaborative environment exploration |
title_short |
Autonomous multi-agent collaborative environment exploration |
title_full |
Autonomous multi-agent collaborative environment exploration |
title_fullStr |
Autonomous multi-agent collaborative environment exploration |
title_full_unstemmed |
Autonomous multi-agent collaborative environment exploration |
title_sort |
autonomous multi-agent collaborative environment exploration |
publisher |
Nanyang Technological University |
publishDate |
2020 |
url |
https://hdl.handle.net/10356/136784 |
_version_ |
1683493092082057216 |