HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion

LiDAR relocalization plays a crucial role in many fields, including robotics, autonomous driving, and computer vision. LiDAR-based retrieval from a database typically incurs high computation storage costs and can lead to globally inaccurate pose estimations if the database is too sparse. On the othe...

Full description

Saved in:
Bibliographic Details
Main Authors: Wang, Sijie, Kang, Qiyu, She, Rui, Wang, Wei, Zhao, Kai, Song, Yang, Tay, Wee Peng
Other Authors: School of Electrical and Electronic Engineering
Format: Conference or Workshop Item
Language:English
Published: 2023
Subjects:
Online Access:https://hdl.handle.net/10356/165273
https://cvpr2023.thecvf.com/Conferences/2023
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-165273
record_format dspace
spelling sg-ntu-dr.10356-1652732023-08-29T00:44:20Z HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion Wang, Sijie Kang, Qiyu She, Rui Wang, Wei Zhao, Kai Song, Yang Tay, Wee Peng School of Electrical and Electronic Engineering IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2023) Connected Smart Mobility (COSMO) Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Visual Relocalization Sensors LiDAR relocalization plays a crucial role in many fields, including robotics, autonomous driving, and computer vision. LiDAR-based retrieval from a database typically incurs high computation storage costs and can lead to globally inaccurate pose estimations if the database is too sparse. On the other hand, pose regression methods take images or point clouds as inputs and directly regress global poses in an end-to-end manner. They do not perform database matching and are more computationally efficient than retrieval techniques. We propose HypLiLoc, a new model for LiDAR pose regression. We use two branched backbones to extract 3D features and 2D projection features, respectively. We consider multi-modal feature fusion in both Euclidean and hyperbolic spaces to obtain more effective feature representations. Experimental results indicate that HypLiLoc achieves state-of-the-art performance in both outdoor and indoor datasets. We also conduct extensive ablation studies on the framework design, which demonstrate the effectiveness of multi-modal feature extraction and multi-space embedding. Agency for Science, Technology and Research (A*STAR) Info-communications Media Development Authority (IMDA) National Research Foundation (NRF) Submitted/Accepted version This research is supported by A*STAR under its RIE2020 Advanced Manufacturing and Engineering (AME) Industry Alignment Fund – Pre Positioning (IAF-PP) (Grant No. A19D6a0053) and the National Research Foundation, Singapore and Infocomm Media Development Authority under its Future Communications Research and Development Programme. 2023-08-22T08:17:28Z 2023-08-22T08:17:28Z 2023 Conference Paper Wang, S., Kang, Q., She, R., Wang, W., Zhao, K., Song, Y. & Tay, W. P. (2023). HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2023). https://dx.doi.org/10.1109/CVPR52729.2023.00501 https://hdl.handle.net/10356/165273 10.1109/CVPR52729.2023.00501 https://cvpr2023.thecvf.com/Conferences/2023 en A19D6a0053 © 2023 The Author(s). Published by Computer Vision Foundation. This is an open-access article distributed under the terms of the Creative Commons Attribution License. The final published version of the proceedings is available on IEEE Xplore. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
Visual Relocalization
Sensors
spellingShingle Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
Visual Relocalization
Sensors
Wang, Sijie
Kang, Qiyu
She, Rui
Wang, Wei
Zhao, Kai
Song, Yang
Tay, Wee Peng
HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion
description LiDAR relocalization plays a crucial role in many fields, including robotics, autonomous driving, and computer vision. LiDAR-based retrieval from a database typically incurs high computation storage costs and can lead to globally inaccurate pose estimations if the database is too sparse. On the other hand, pose regression methods take images or point clouds as inputs and directly regress global poses in an end-to-end manner. They do not perform database matching and are more computationally efficient than retrieval techniques. We propose HypLiLoc, a new model for LiDAR pose regression. We use two branched backbones to extract 3D features and 2D projection features, respectively. We consider multi-modal feature fusion in both Euclidean and hyperbolic spaces to obtain more effective feature representations. Experimental results indicate that HypLiLoc achieves state-of-the-art performance in both outdoor and indoor datasets. We also conduct extensive ablation studies on the framework design, which demonstrate the effectiveness of multi-modal feature extraction and multi-space embedding.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Wang, Sijie
Kang, Qiyu
She, Rui
Wang, Wei
Zhao, Kai
Song, Yang
Tay, Wee Peng
format Conference or Workshop Item
author Wang, Sijie
Kang, Qiyu
She, Rui
Wang, Wei
Zhao, Kai
Song, Yang
Tay, Wee Peng
author_sort Wang, Sijie
title HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion
title_short HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion
title_full HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion
title_fullStr HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion
title_full_unstemmed HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion
title_sort hypliloc: towards effective lidar pose regression with hyperbolic fusion
publishDate 2023
url https://hdl.handle.net/10356/165273
https://cvpr2023.thecvf.com/Conferences/2023
_version_ 1779156642094383104