HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion
LiDAR relocalization plays a crucial role in many fields, including robotics, autonomous driving, and computer vision. LiDAR-based retrieval from a database typically incurs high computation storage costs and can lead to globally inaccurate pose estimations if the database is too sparse. On the othe...
Saved in:
Main Authors: | , , , , , , |
---|---|
Other Authors: | |
Format: | Conference or Workshop Item |
Language: | English |
Published: |
2023
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/165273 https://cvpr2023.thecvf.com/Conferences/2023 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-165273 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1652732023-08-29T00:44:20Z HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion Wang, Sijie Kang, Qiyu She, Rui Wang, Wei Zhao, Kai Song, Yang Tay, Wee Peng School of Electrical and Electronic Engineering IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2023) Connected Smart Mobility (COSMO) Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Visual Relocalization Sensors LiDAR relocalization plays a crucial role in many fields, including robotics, autonomous driving, and computer vision. LiDAR-based retrieval from a database typically incurs high computation storage costs and can lead to globally inaccurate pose estimations if the database is too sparse. On the other hand, pose regression methods take images or point clouds as inputs and directly regress global poses in an end-to-end manner. They do not perform database matching and are more computationally efficient than retrieval techniques. We propose HypLiLoc, a new model for LiDAR pose regression. We use two branched backbones to extract 3D features and 2D projection features, respectively. We consider multi-modal feature fusion in both Euclidean and hyperbolic spaces to obtain more effective feature representations. Experimental results indicate that HypLiLoc achieves state-of-the-art performance in both outdoor and indoor datasets. We also conduct extensive ablation studies on the framework design, which demonstrate the effectiveness of multi-modal feature extraction and multi-space embedding. Agency for Science, Technology and Research (A*STAR) Info-communications Media Development Authority (IMDA) National Research Foundation (NRF) Submitted/Accepted version This research is supported by A*STAR under its RIE2020 Advanced Manufacturing and Engineering (AME) Industry Alignment Fund – Pre Positioning (IAF-PP) (Grant No. A19D6a0053) and the National Research Foundation, Singapore and Infocomm Media Development Authority under its Future Communications Research and Development Programme. 2023-08-22T08:17:28Z 2023-08-22T08:17:28Z 2023 Conference Paper Wang, S., Kang, Q., She, R., Wang, W., Zhao, K., Song, Y. & Tay, W. P. (2023). HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2023). https://dx.doi.org/10.1109/CVPR52729.2023.00501 https://hdl.handle.net/10356/165273 10.1109/CVPR52729.2023.00501 https://cvpr2023.thecvf.com/Conferences/2023 en A19D6a0053 © 2023 The Author(s). Published by Computer Vision Foundation. This is an open-access article distributed under the terms of the Creative Commons Attribution License. The final published version of the proceedings is available on IEEE Xplore. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Visual Relocalization Sensors |
spellingShingle |
Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Visual Relocalization Sensors Wang, Sijie Kang, Qiyu She, Rui Wang, Wei Zhao, Kai Song, Yang Tay, Wee Peng HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion |
description |
LiDAR relocalization plays a crucial role in many fields, including robotics, autonomous driving, and computer vision. LiDAR-based retrieval from a database typically incurs high computation storage costs and can lead to globally inaccurate pose estimations if the database is too sparse. On the other hand, pose regression methods take images or point clouds as inputs and directly regress global poses in an end-to-end manner. They do not perform database matching and are more computationally efficient than retrieval techniques. We propose HypLiLoc, a new model for LiDAR pose regression. We use two branched backbones to extract 3D features and 2D projection features, respectively. We consider multi-modal feature fusion in both Euclidean and hyperbolic spaces to obtain more effective feature representations. Experimental results indicate that HypLiLoc achieves state-of-the-art performance in both outdoor and indoor datasets. We also conduct extensive ablation studies on the framework design, which demonstrate the effectiveness of multi-modal feature extraction and multi-space embedding. |
author2 |
School of Electrical and Electronic Engineering |
author_facet |
School of Electrical and Electronic Engineering Wang, Sijie Kang, Qiyu She, Rui Wang, Wei Zhao, Kai Song, Yang Tay, Wee Peng |
format |
Conference or Workshop Item |
author |
Wang, Sijie Kang, Qiyu She, Rui Wang, Wei Zhao, Kai Song, Yang Tay, Wee Peng |
author_sort |
Wang, Sijie |
title |
HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion |
title_short |
HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion |
title_full |
HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion |
title_fullStr |
HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion |
title_full_unstemmed |
HypLiLoc: towards effective LiDAR pose regression with hyperbolic fusion |
title_sort |
hypliloc: towards effective lidar pose regression with hyperbolic fusion |
publishDate |
2023 |
url |
https://hdl.handle.net/10356/165273 https://cvpr2023.thecvf.com/Conferences/2023 |
_version_ |
1779156642094383104 |