3D point cloud analytics

Performant and efficient 3D object detection and 3D semantic segmentation models for scene understanding are crucial for autonomous vehicles safety. Recent advancement in fusion methods for object detection complemented lidar’s geometric and spatial features with rich semantic information from image...

Full description

Saved in:
Bibliographic Details
Main Author: Lew, Desmond Jiang Yang
Other Authors: Lu Shijian
Format: Final Year Project
Language:English
Published: Nanyang Technological University 2023
Subjects:
Online Access:https://hdl.handle.net/10356/166420
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:Performant and efficient 3D object detection and 3D semantic segmentation models for scene understanding are crucial for autonomous vehicles safety. Recent advancement in fusion methods for object detection complemented lidar’s geometric and spatial features with rich semantic information from images. On the other hand, research on semantic segmentation have mainly relied on lidar based methods for classification of points. Object predictions from the object detection pipeline could be used to localize semantic and lidar features from the detection branch to share with the semantic segmentation branch through modality fusion. Particularly, the use of transformers, which have had success with modality fusion, is explored in this project. The transformer-based fuser is about 30x smaller than the main segmentation model used, and achieved comparable performance on features extracted from the networks.