SectionKey: 3-D semantic point cloud descriptor for place recognition in large-scale environments

Place recognition is seen as a crucial factor to correct cumulative errors in Simultaneous Localization and Mapping (SLAM) applications. Most existing place recognition studies focus on vision-based approaches, which are sensitive to environmental changes such as illumination, weather, and season...

Full description

Saved in:
Bibliographic Details
Main Author: Jin, Shutong
Other Authors: Wang Dan Wei
Format: Thesis-Master by Coursework
Language:English
Published: Nanyang Technological University 2022
Subjects:
Online Access:https://hdl.handle.net/10356/156767
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-156767
record_format dspace
spelling sg-ntu-dr.10356-1567672023-07-04T17:47:19Z SectionKey: 3-D semantic point cloud descriptor for place recognition in large-scale environments Jin, Shutong Wang Dan Wei School of Electrical and Electronic Engineering EDWWANG@ntu.edu.sg Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision Place recognition is seen as a crucial factor to correct cumulative errors in Simultaneous Localization and Mapping (SLAM) applications. Most existing place recognition studies focus on vision-based approaches, which are sensitive to environmental changes such as illumination, weather, and seasons due to their inherent limitations. More recent attention has been attracted to use 3-D Light Detection and Ranging (LiDAR) scans, where most of the LiDAR-based methods work by leveraging accurate geometric information that demonstrates more credibility. However, these pure geometric-based methods are tend to fail in repetitive and ambiguous scenarios in the urban environments, which may result in low place recognition accuracy and efficiency. Considering these facts, this dissertation proposes a novel global descriptor, named SectionKey, which leverages both semantic and geometric information to tackle the problem of place recognition in large-scale urban environments. In addition to the robustness against moving objects, the proposed descriptor is also invariant to viewpoint changes and able to return translation to correct the drifting errors. Specifically, the encoded three-layers key serves as a pre-selection step and a ‘candidate center’ selection strategy is deployed before calculating the similarity score, thus improving the accuracy and efficiency significantly. Then, a two-step semantic iterative closest point (ICP) algorithm is applied to acquire the 3-D pose (x, y,q) that is used to align the candidate point clouds with the query frame, and calculate the similarity score. Extensive experiments have been conducted on public Semantic KITTI dataset and self-collected dataset in NTU, and the results demonstrate the superior performance of the proposed system over state of-the-art baselines. Master of Science (Computer Control and Automation) 2022-04-20T23:29:40Z 2022-04-20T23:29:40Z 2022 Thesis-Master by Coursework Jin, S. (2022). SectionKey: 3-D semantic point cloud descriptor for place recognition in large-scale environments. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/156767 https://hdl.handle.net/10356/156767 en application/pdf Nanyang Technological University
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision
spellingShingle Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision
Jin, Shutong
SectionKey: 3-D semantic point cloud descriptor for place recognition in large-scale environments
description Place recognition is seen as a crucial factor to correct cumulative errors in Simultaneous Localization and Mapping (SLAM) applications. Most existing place recognition studies focus on vision-based approaches, which are sensitive to environmental changes such as illumination, weather, and seasons due to their inherent limitations. More recent attention has been attracted to use 3-D Light Detection and Ranging (LiDAR) scans, where most of the LiDAR-based methods work by leveraging accurate geometric information that demonstrates more credibility. However, these pure geometric-based methods are tend to fail in repetitive and ambiguous scenarios in the urban environments, which may result in low place recognition accuracy and efficiency. Considering these facts, this dissertation proposes a novel global descriptor, named SectionKey, which leverages both semantic and geometric information to tackle the problem of place recognition in large-scale urban environments. In addition to the robustness against moving objects, the proposed descriptor is also invariant to viewpoint changes and able to return translation to correct the drifting errors. Specifically, the encoded three-layers key serves as a pre-selection step and a ‘candidate center’ selection strategy is deployed before calculating the similarity score, thus improving the accuracy and efficiency significantly. Then, a two-step semantic iterative closest point (ICP) algorithm is applied to acquire the 3-D pose (x, y,q) that is used to align the candidate point clouds with the query frame, and calculate the similarity score. Extensive experiments have been conducted on public Semantic KITTI dataset and self-collected dataset in NTU, and the results demonstrate the superior performance of the proposed system over state of-the-art baselines.
author2 Wang Dan Wei
author_facet Wang Dan Wei
Jin, Shutong
format Thesis-Master by Coursework
author Jin, Shutong
author_sort Jin, Shutong
title SectionKey: 3-D semantic point cloud descriptor for place recognition in large-scale environments
title_short SectionKey: 3-D semantic point cloud descriptor for place recognition in large-scale environments
title_full SectionKey: 3-D semantic point cloud descriptor for place recognition in large-scale environments
title_fullStr SectionKey: 3-D semantic point cloud descriptor for place recognition in large-scale environments
title_full_unstemmed SectionKey: 3-D semantic point cloud descriptor for place recognition in large-scale environments
title_sort sectionkey: 3-d semantic point cloud descriptor for place recognition in large-scale environments
publisher Nanyang Technological University
publishDate 2022
url https://hdl.handle.net/10356/156767
_version_ 1772828887503339520