RobustLoc: robust camera pose regression in challenging driving environments
Camera relocalization has various applications in autonomous driving. Previous camera pose regression models consider only ideal scenarios where there is little environmental perturbation. To deal with challenging driving environments that may have changing seasons, weather, illumination, and the pr...
Saved in:
Main Authors: | , , , , , |
---|---|
Other Authors: | |
Format: | Conference or Workshop Item |
Language: | English |
Published: |
2023
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/165272 https://aaai.org/aaai-publications/aaai-conference-proceedings/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-165272 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1652722023-04-13T08:40:31Z RobustLoc: robust camera pose regression in challenging driving environments Wang, Sijie Kang, Qiyu She, Rui Tay, Wee Peng Hartmannsgruber, Andreas Navarro, Diego Navarro School of Electrical and Electronic Engineering 37th AAAI Conference on Artificial Intelligence (AAAI 2023) Continental-NTU Corporate Lab Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Visual Relocalization Autonomous Driving Camera relocalization has various applications in autonomous driving. Previous camera pose regression models consider only ideal scenarios where there is little environmental perturbation. To deal with challenging driving environments that may have changing seasons, weather, illumination, and the presence of unstable objects, we propose RobustLoc, which derives its robustness against perturbations from neural differential equations. Our model uses a convolutional neural network to extract feature maps from multi-view images, a robust neural differential equation diffusion block module to diffuse information interactively, and a branched pose decoder with multi-layer training to estimate the vehicle poses. Experiments demonstrate that RobustLoc surpasses current state-of-the-art camera pose regression models and achieves robust performance in various environments. Info-communications Media Development Authority (IMDA) National Research Foundation (NRF) This work is supported under the RIE2020 Industry Alignment Fund-Industry Collaboration Projects (IAF-ICP) Funding Initiative, as well as cash and in-kind contribution from the industry partner(s), and by the National Research Foundation, Singapore and Infocomm Media Development Authority under its Future Communications Research & Development Programme. 2023-04-13T08:39:31Z 2023-04-13T08:39:31Z 2023 Conference Paper Wang, S., Kang, Q., She, R., Tay, W. P., Hartmannsgruber, A. & Navarro, D. N. (2023). RobustLoc: robust camera pose regression in challenging driving environments. 37th AAAI Conference on Artificial Intelligence (AAAI 2023). https://hdl.handle.net/10356/165272 2211.11238 https://aaai.org/aaai-publications/aaai-conference-proceedings/ en IAF-ICP © 2023 Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Visual Relocalization Autonomous Driving |
spellingShingle |
Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Visual Relocalization Autonomous Driving Wang, Sijie Kang, Qiyu She, Rui Tay, Wee Peng Hartmannsgruber, Andreas Navarro, Diego Navarro RobustLoc: robust camera pose regression in challenging driving environments |
description |
Camera relocalization has various applications in autonomous driving. Previous camera pose regression models consider only ideal scenarios where there is little environmental perturbation. To deal with challenging driving environments that may have changing seasons, weather, illumination, and the presence of unstable objects, we propose RobustLoc, which derives its robustness against perturbations from neural differential equations. Our model uses a convolutional neural network to extract feature maps from multi-view images, a robust neural differential equation diffusion block module to diffuse information interactively, and a branched pose decoder with multi-layer training to estimate the vehicle poses. Experiments demonstrate that RobustLoc surpasses current state-of-the-art camera pose regression models and achieves robust performance in various environments. |
author2 |
School of Electrical and Electronic Engineering |
author_facet |
School of Electrical and Electronic Engineering Wang, Sijie Kang, Qiyu She, Rui Tay, Wee Peng Hartmannsgruber, Andreas Navarro, Diego Navarro |
format |
Conference or Workshop Item |
author |
Wang, Sijie Kang, Qiyu She, Rui Tay, Wee Peng Hartmannsgruber, Andreas Navarro, Diego Navarro |
author_sort |
Wang, Sijie |
title |
RobustLoc: robust camera pose regression in challenging driving environments |
title_short |
RobustLoc: robust camera pose regression in challenging driving environments |
title_full |
RobustLoc: robust camera pose regression in challenging driving environments |
title_fullStr |
RobustLoc: robust camera pose regression in challenging driving environments |
title_full_unstemmed |
RobustLoc: robust camera pose regression in challenging driving environments |
title_sort |
robustloc: robust camera pose regression in challenging driving environments |
publishDate |
2023 |
url |
https://hdl.handle.net/10356/165272 https://aaai.org/aaai-publications/aaai-conference-proceedings/ |
_version_ |
1764208063259082752 |