RobustLoc: robust camera pose regression in challenging driving environments

Camera relocalization has various applications in autonomous driving. Previous camera pose regression models consider only ideal scenarios where there is little environmental perturbation. To deal with challenging driving environments that may have changing seasons, weather, illumination, and the pr...

Full description

Saved in:
Bibliographic Details
Main Authors: Wang, Sijie, Kang, Qiyu, She, Rui, Tay, Wee Peng, Hartmannsgruber, Andreas, Navarro, Diego Navarro
Other Authors: School of Electrical and Electronic Engineering
Format: Conference or Workshop Item
Language:English
Published: 2023
Subjects:
Online Access:https://hdl.handle.net/10356/165272
https://aaai.org/aaai-publications/aaai-conference-proceedings/
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-165272
record_format dspace
spelling sg-ntu-dr.10356-1652722023-04-13T08:40:31Z RobustLoc: robust camera pose regression in challenging driving environments Wang, Sijie Kang, Qiyu She, Rui Tay, Wee Peng Hartmannsgruber, Andreas Navarro, Diego Navarro School of Electrical and Electronic Engineering 37th AAAI Conference on Artificial Intelligence (AAAI 2023) Continental-NTU Corporate Lab Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Visual Relocalization Autonomous Driving Camera relocalization has various applications in autonomous driving. Previous camera pose regression models consider only ideal scenarios where there is little environmental perturbation. To deal with challenging driving environments that may have changing seasons, weather, illumination, and the presence of unstable objects, we propose RobustLoc, which derives its robustness against perturbations from neural differential equations. Our model uses a convolutional neural network to extract feature maps from multi-view images, a robust neural differential equation diffusion block module to diffuse information interactively, and a branched pose decoder with multi-layer training to estimate the vehicle poses. Experiments demonstrate that RobustLoc surpasses current state-of-the-art camera pose regression models and achieves robust performance in various environments. Info-communications Media Development Authority (IMDA) National Research Foundation (NRF) This work is supported under the RIE2020 Industry Alignment Fund-Industry Collaboration Projects (IAF-ICP) Funding Initiative, as well as cash and in-kind contribution from the industry partner(s), and by the National Research Foundation, Singapore and Infocomm Media Development Authority under its Future Communications Research & Development Programme. 2023-04-13T08:39:31Z 2023-04-13T08:39:31Z 2023 Conference Paper Wang, S., Kang, Q., She, R., Tay, W. P., Hartmannsgruber, A. & Navarro, D. N. (2023). RobustLoc: robust camera pose regression in challenging driving environments. 37th AAAI Conference on Artificial Intelligence (AAAI 2023). https://hdl.handle.net/10356/165272 2211.11238 https://aaai.org/aaai-publications/aaai-conference-proceedings/ en IAF-ICP © 2023 Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
Visual Relocalization
Autonomous Driving
spellingShingle Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
Visual Relocalization
Autonomous Driving
Wang, Sijie
Kang, Qiyu
She, Rui
Tay, Wee Peng
Hartmannsgruber, Andreas
Navarro, Diego Navarro
RobustLoc: robust camera pose regression in challenging driving environments
description Camera relocalization has various applications in autonomous driving. Previous camera pose regression models consider only ideal scenarios where there is little environmental perturbation. To deal with challenging driving environments that may have changing seasons, weather, illumination, and the presence of unstable objects, we propose RobustLoc, which derives its robustness against perturbations from neural differential equations. Our model uses a convolutional neural network to extract feature maps from multi-view images, a robust neural differential equation diffusion block module to diffuse information interactively, and a branched pose decoder with multi-layer training to estimate the vehicle poses. Experiments demonstrate that RobustLoc surpasses current state-of-the-art camera pose regression models and achieves robust performance in various environments.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Wang, Sijie
Kang, Qiyu
She, Rui
Tay, Wee Peng
Hartmannsgruber, Andreas
Navarro, Diego Navarro
format Conference or Workshop Item
author Wang, Sijie
Kang, Qiyu
She, Rui
Tay, Wee Peng
Hartmannsgruber, Andreas
Navarro, Diego Navarro
author_sort Wang, Sijie
title RobustLoc: robust camera pose regression in challenging driving environments
title_short RobustLoc: robust camera pose regression in challenging driving environments
title_full RobustLoc: robust camera pose regression in challenging driving environments
title_fullStr RobustLoc: robust camera pose regression in challenging driving environments
title_full_unstemmed RobustLoc: robust camera pose regression in challenging driving environments
title_sort robustloc: robust camera pose regression in challenging driving environments
publishDate 2023
url https://hdl.handle.net/10356/165272
https://aaai.org/aaai-publications/aaai-conference-proceedings/
_version_ 1764208063259082752