Unsupervised point cloud representation learning with deep neural networks: a survey

Point cloud data have been widely explored due to its superior accuracy and robustness under various adverse situations. Meanwhile, deep neural networks (DNNs) have achieved very impressive success in various applications such as surveillance and autonomous driving. The convergence of point cloud an...

Full description

Saved in:
Bibliographic Details
Main Authors: Xiao, Aoran, Huang, Jiaxing, Guan, Dayan, Zhang, Xiaoqin, Lu, Shijian, Shao, Ling
Other Authors: School of Computer Science and Engineering
Format: Article
Language:English
Published: 2023
Subjects:
Online Access:https://hdl.handle.net/10356/172186
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-172186
record_format dspace
spelling sg-ntu-dr.10356-1721862023-11-28T07:39:23Z Unsupervised point cloud representation learning with deep neural networks: a survey Xiao, Aoran Huang, Jiaxing Guan, Dayan Zhang, Xiaoqin Lu, Shijian Shao, Ling School of Computer Science and Engineering Engineering::Computer science and engineering 3D Vision Deep Neural Network Point cloud data have been widely explored due to its superior accuracy and robustness under various adverse situations. Meanwhile, deep neural networks (DNNs) have achieved very impressive success in various applications such as surveillance and autonomous driving. The convergence of point cloud and DNNs has led to many deep point cloud models, largely trained under the supervision of large-scale and densely-labelled point cloud data. Unsupervised point cloud representation learning, which aims to learn general and useful point cloud representations from unlabelled point cloud data, has recently attracted increasing attention due to the constraint in large-scale point cloud labelling. This paper provides a comprehensive review of unsupervised point cloud representation learning using DNNs. It first describes the motivation, general pipelines as well as terminologies of the recent studies. Relevant background including widely adopted point cloud datasets and DNN architectures is then briefly presented. This is followed by an extensive discussion of existing unsupervised point cloud representation learning methods according to their technical approaches. We also quantitatively benchmark and discuss the reviewed methods over multiple widely adopted point cloud datasets. Finally, we share our humble opinion about several challenges and problems that could be pursued in the future research in unsupervised point cloud representation learning. Ministry of Education (MOE) This work was funded in part by the Ministry of Education Singapore, under the Tier-1 scheme with project under Grant RG18/22. It is also supported in part under the RIE2020 Industry Alignment Fund – Industry Collaboration Projects (IAF-ICP) Funding Initiative, as well as cash and in-kind contributions from Singapore Telecommunications Limited (Singtel), through Singtel Cognitive and Artificial Intelligence Lab for Enterprises (SCALE@NTU). 2023-11-28T07:39:23Z 2023-11-28T07:39:23Z 2023 Journal Article Xiao, A., Huang, J., Guan, D., Zhang, X., Lu, S. & Shao, L. (2023). Unsupervised point cloud representation learning with deep neural networks: a survey. IEEE Transactions On Pattern Analysis and Machine Intelligence, 45(9), 11321-11339. https://dx.doi.org/10.1109/TPAMI.2023.3262786 0162-8828 https://hdl.handle.net/10356/172186 10.1109/TPAMI.2023.3262786 37030870 2-s2.0-85151565213 9 45 11321 11339 en RG18/22 IEEE Transactions on Pattern Analysis and Machine Intelligence © 2023 IEEE. All rights reserved.
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering
3D Vision
Deep Neural Network
spellingShingle Engineering::Computer science and engineering
3D Vision
Deep Neural Network
Xiao, Aoran
Huang, Jiaxing
Guan, Dayan
Zhang, Xiaoqin
Lu, Shijian
Shao, Ling
Unsupervised point cloud representation learning with deep neural networks: a survey
description Point cloud data have been widely explored due to its superior accuracy and robustness under various adverse situations. Meanwhile, deep neural networks (DNNs) have achieved very impressive success in various applications such as surveillance and autonomous driving. The convergence of point cloud and DNNs has led to many deep point cloud models, largely trained under the supervision of large-scale and densely-labelled point cloud data. Unsupervised point cloud representation learning, which aims to learn general and useful point cloud representations from unlabelled point cloud data, has recently attracted increasing attention due to the constraint in large-scale point cloud labelling. This paper provides a comprehensive review of unsupervised point cloud representation learning using DNNs. It first describes the motivation, general pipelines as well as terminologies of the recent studies. Relevant background including widely adopted point cloud datasets and DNN architectures is then briefly presented. This is followed by an extensive discussion of existing unsupervised point cloud representation learning methods according to their technical approaches. We also quantitatively benchmark and discuss the reviewed methods over multiple widely adopted point cloud datasets. Finally, we share our humble opinion about several challenges and problems that could be pursued in the future research in unsupervised point cloud representation learning.
author2 School of Computer Science and Engineering
author_facet School of Computer Science and Engineering
Xiao, Aoran
Huang, Jiaxing
Guan, Dayan
Zhang, Xiaoqin
Lu, Shijian
Shao, Ling
format Article
author Xiao, Aoran
Huang, Jiaxing
Guan, Dayan
Zhang, Xiaoqin
Lu, Shijian
Shao, Ling
author_sort Xiao, Aoran
title Unsupervised point cloud representation learning with deep neural networks: a survey
title_short Unsupervised point cloud representation learning with deep neural networks: a survey
title_full Unsupervised point cloud representation learning with deep neural networks: a survey
title_fullStr Unsupervised point cloud representation learning with deep neural networks: a survey
title_full_unstemmed Unsupervised point cloud representation learning with deep neural networks: a survey
title_sort unsupervised point cloud representation learning with deep neural networks: a survey
publishDate 2023
url https://hdl.handle.net/10356/172186
_version_ 1783955602184077312