Temporal feature matching and propagation for semantic segmentation on 3D point cloud sequences

• Main Authors: Shi, Hanyu, Li, Ruibo, Liu, Fayao, Lin, Guosheng
• Other Authors: School of Computer Science and Engineering
• Format: Article
• Language: English
• Published: 2023
• Subjects: Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence; 4D Point Clouds; Semantic Segmentation
• Online Access: https://hdl.handle.net/10356/172229
• Institution: Nanyang Technological University

In real-world LiDAR-based applications, data is generated in the form of 3D point cloud sequences or 4D point clouds. However, the topic of semantic segmentation on 4D point clouds is under-investigated and existing methods are still not able to achieve satisfactory performance to meet the requirement for real-world applications. The temporal information across different point clouds plays an important role in dynamic scene understanding, which is not well explored in existing work. In this paper, we focus on exploring effective temporal information across two consecutive point clouds for semantic segmentation on point cloud sequences. To this end, we design three novel modules to enhance the features of target frames by extracting different temporal information in the local regions and global regions. Experimental results on SemanticKITTI and SemanticPOSS demonstrate that our method achieves superior performance in 4D semantic segmentation by utilizing temporal information.