Multi-robot semantic mapping based on deep learning framework
In this work, we mathematically model the collaborative semantic perception problem with derive its probability decomposition, based on which we propose a novel incremental hierarchical collaborative probabilistic semantic mapping framework where a multi-modal sensor data fusion method is utilized t...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Thesis-Master by Coursework |
Language: | English |
Published: |
Nanyang Technological University
2020
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/141300 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-141300 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1413002023-07-04T16:52:39Z Multi-robot semantic mapping based on deep learning framework Zhao, Chunyang Wang Dan Wei School of Electrical and Electronic Engineering EDWWANG@ntu.edu.sg Engineering::Electrical and electronic engineering::Control and instrumentation::Robotics In this work, we mathematically model the collaborative semantic perception problem with derive its probability decomposition, based on which we propose a novel incremental hierarchical collaborative probabilistic semantic mapping framework where a multi-modal sensor data fusion method is utilized to incorporate information of sensors, a Bayesian based update scheme is employed to update the current state with prior knowledge and current observations, an Expectation-Maximization approach is exploited to infer the hidden data association between local maps. Experiments conducted both on open source dataset and real robot platforms show the respective 3D semantic reconstruction generated by our proposed system both in single robot local mapping level and multi-robot global mapping level. These results demonstrate the accuracy and utility of our system and indicates the potential of this system to be used in the real robot application. Master of Science (Computer Control and Automation) 2020-06-06T12:51:22Z 2020-06-06T12:51:22Z 2020 Thesis-Master by Coursework https://hdl.handle.net/10356/141300 en application/pdf Nanyang Technological University |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Electrical and electronic engineering::Control and instrumentation::Robotics |
spellingShingle |
Engineering::Electrical and electronic engineering::Control and instrumentation::Robotics Zhao, Chunyang Multi-robot semantic mapping based on deep learning framework |
description |
In this work, we mathematically model the collaborative semantic perception problem with derive its probability decomposition, based on which we propose a novel incremental hierarchical collaborative probabilistic semantic mapping framework where a multi-modal sensor data fusion method is utilized to incorporate information of sensors, a Bayesian based update scheme is employed to update the current state with prior knowledge and current observations, an Expectation-Maximization approach is exploited to infer the hidden data association between local maps.
Experiments conducted both on open source dataset and real robot platforms show the respective 3D semantic reconstruction generated by our proposed system both in single robot local mapping level and multi-robot global mapping level. These results demonstrate the accuracy and utility of our system and indicates the potential of this system to be used in the real robot application. |
author2 |
Wang Dan Wei |
author_facet |
Wang Dan Wei Zhao, Chunyang |
format |
Thesis-Master by Coursework |
author |
Zhao, Chunyang |
author_sort |
Zhao, Chunyang |
title |
Multi-robot semantic mapping based on deep learning framework |
title_short |
Multi-robot semantic mapping based on deep learning framework |
title_full |
Multi-robot semantic mapping based on deep learning framework |
title_fullStr |
Multi-robot semantic mapping based on deep learning framework |
title_full_unstemmed |
Multi-robot semantic mapping based on deep learning framework |
title_sort |
multi-robot semantic mapping based on deep learning framework |
publisher |
Nanyang Technological University |
publishDate |
2020 |
url |
https://hdl.handle.net/10356/141300 |
_version_ |
1772827401082896384 |