Heterogeneous stereo : a human vision inspired method for general robotics sensing
In this paper, we introduce a heterogeneous stereo sensing system that aim to solve the real life difficulties in vision based autonomous navigation. The common practice for vision autonomous robotics navigation is to concatenate camera(s), SLAM and path planning modules. We observe an dilemma where...
Saved in:
Main Authors: | , , |
---|---|
Other Authors: | |
Format: | Conference or Workshop Item |
Language: | English |
Published: |
2020
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/140471 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-140471 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1404712020-05-29T07:08:57Z Heterogeneous stereo : a human vision inspired method for general robotics sensing Wang, Han Yuan, Shenghai Wu, Keyu School of Electrical and Electronic Engineering 2017 IEEE Region 10 Conference (TENCON 2017) Engineering::Electrical and electronic engineering Cameras Lenses In this paper, we introduce a heterogeneous stereo sensing system that aim to solve the real life difficulties in vision based autonomous navigation. The common practice for vision autonomous robotics navigation is to concatenate camera(s), SLAM and path planning modules. We observe an dilemma where visual SLAM demand wide angle cameras to perform robust tracking and path planning require sensor to sense long range to perform better. The dilemma exists to both monocular and stereo based system. Such dilemma made the vision only robot can only travel at slow speed or risk crashes. We also take note that current monocular SLAM can do everything that stereo SLAM can do which leads to inefficient uses of the secondary frames. To handle this dilemma and inefficiency, out system rely on two camera with different lenses to achieve maximum information gain with given time frames. Our system fuse observation from consecutive intra frames and spatial inter frames. Intra frames are used to estimate both motion and obstacles at various distance. Spatial inter frames are used to estimate a popper scale whenever possible. To propagate the scale to frames which a good scale can not be observed, monocular ORBSLAM is modified to accept our scale modifier. Using our proposed system, we are able to detect both long range and short range obstacles without using super resolution images or wide baseline stereo rig. We show that by using our proposed system accident such as Tesla autopilot crashes can be avoided. 2020-05-29T07:08:57Z 2020-05-29T07:08:57Z 2017 Conference Paper Wang, H., Yuan, S., & Wu, K. (2017). Heterogeneous stereo : a human vision inspired method for general robotics sensing. Proceedings of the 2017 IEEE Region 10 Conference (TENCON 2017), 793-798. doi:10.1109/TENCON.2017.8227967 978-1-5090-1135-3 https://hdl.handle.net/10356/140471 10.1109/TENCON.2017.8227967 2-s2.0-85044199715 793 798 en © 2017 IEEE. All rights reserved. |
institution |
Nanyang Technological University |
building |
NTU Library |
country |
Singapore |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Electrical and electronic engineering Cameras Lenses |
spellingShingle |
Engineering::Electrical and electronic engineering Cameras Lenses Wang, Han Yuan, Shenghai Wu, Keyu Heterogeneous stereo : a human vision inspired method for general robotics sensing |
description |
In this paper, we introduce a heterogeneous stereo sensing system that aim to solve the real life difficulties in vision based autonomous navigation. The common practice for vision autonomous robotics navigation is to concatenate camera(s), SLAM and path planning modules. We observe an dilemma where visual SLAM demand wide angle cameras to perform robust tracking and path planning require sensor to sense long range to perform better. The dilemma exists to both monocular and stereo based system. Such dilemma made the vision only robot can only travel at slow speed or risk crashes. We also take note that current monocular SLAM can do everything that stereo SLAM can do which leads to inefficient uses of the secondary frames. To handle this dilemma and inefficiency, out system rely on two camera with different lenses to achieve maximum information gain with given time frames. Our system fuse observation from consecutive intra frames and spatial inter frames. Intra frames are used to estimate both motion and obstacles at various distance. Spatial inter frames are used to estimate a popper scale whenever possible. To propagate the scale to frames which a good scale can not be observed, monocular ORBSLAM is modified to accept our scale modifier. Using our proposed system, we are able to detect both long range and short range obstacles without using super resolution images or wide baseline stereo rig. We show that by using our proposed system accident such as Tesla autopilot crashes can be avoided. |
author2 |
School of Electrical and Electronic Engineering |
author_facet |
School of Electrical and Electronic Engineering Wang, Han Yuan, Shenghai Wu, Keyu |
format |
Conference or Workshop Item |
author |
Wang, Han Yuan, Shenghai Wu, Keyu |
author_sort |
Wang, Han |
title |
Heterogeneous stereo : a human vision inspired method for general robotics sensing |
title_short |
Heterogeneous stereo : a human vision inspired method for general robotics sensing |
title_full |
Heterogeneous stereo : a human vision inspired method for general robotics sensing |
title_fullStr |
Heterogeneous stereo : a human vision inspired method for general robotics sensing |
title_full_unstemmed |
Heterogeneous stereo : a human vision inspired method for general robotics sensing |
title_sort |
heterogeneous stereo : a human vision inspired method for general robotics sensing |
publishDate |
2020 |
url |
https://hdl.handle.net/10356/140471 |
_version_ |
1681058296038948864 |