A robust 6-D pose tracking approach by fusing a multi-camera tracking device and an AHRS module

Optical tracking technique based on multiple cameras is widely employed in robots, virtual reality, and industrial measurements due to its excellent position accuracy. However, its 6-D tracking practicability is impaired by the line-of-sight issue and the complicated tracker based on multiple marker...

Full description

Saved in:
Bibliographic Details
Main Authors: Wang, Zengwei, Dai, Houde, Zeng, Yadan, Lueth, Tim C.
Other Authors: School of Mechanical and Aerospace Engineering
Format: Article
Language:English
Published: 2022
Subjects:
Online Access:https://hdl.handle.net/10356/163777
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-163777
record_format dspace
spelling sg-ntu-dr.10356-1637772022-12-16T05:45:59Z A robust 6-D pose tracking approach by fusing a multi-camera tracking device and an AHRS module Wang, Zengwei Dai, Houde Zeng, Yadan Lueth, Tim C. School of Mechanical and Aerospace Engineering Engineering::Mechanical engineering Multi-Camera Object Tracking Optical tracking technique based on multiple cameras is widely employed in robots, virtual reality, and industrial measurements due to its excellent position accuracy. However, its 6-D tracking practicability is impaired by the line-of-sight issue and the complicated tracker based on multiple markers. Hence, we implemented a custom-built hybrid tracking system consisting of four-camera equipment and a 6-D tracker comprising a single optical marker and an automatic heading reference system (AHRS). AHRS provides the 3-D orientation of the tracked object directly and compensates for the 3-D position when the optical tracking is occluded. A two-stage cascaded adaptive unscented Kalman filtering (CAUKF) was proposed to enhance real-time fusion tracking performance. The CAUKF not only provides a reliable frequency enhancement solution for the optical tracking adapting to various frequencies, but also improves the continuality of prediction on fusion state variables and the corresponding covariance matrix, which helps initialize the occlusion tracking accurately. When an occlusion occurs, a learning-based adaptive unscented Kalman filter (LAUKF) module can adaptively adjust noise estimation matrices in the unscented transformation according to the AHRS data, thereby significantly reducing the position estimation error. Experimental results reveal that the proposed tracking approach achieved 6-D tracking at 100 Hz with 0.32-mm position error (mean absolute error) and 0.1° orientation error. This study furnishes a novel implementation method for the full 6-D pose tracking with a simplified tracker structure and improved accuracy, continuity, and stability. This work was supported in part by the National Natural Science Foundation of China under Grant 61973293, in part by the Key Project of Foreign Cooperation for the International Partner Program of the Chinese Academy of Sciences under Grant 121835KYSB20190069, and in part by the Quanzhou Science and Technology Project under Grant 2019STS006/2019C012R. 2022-12-16T05:45:59Z 2022-12-16T05:45:59Z 2021 Journal Article Wang, Z., Dai, H., Zeng, Y. & Lueth, T. C. (2021). A robust 6-D pose tracking approach by fusing a multi-camera tracking device and an AHRS module. IEEE Transactions On Instrumentation and Measurement, 71, 7000611-. https://dx.doi.org/10.1109/TIM.2021.3139655 0018-9456 https://hdl.handle.net/10356/163777 10.1109/TIM.2021.3139655 2-s2.0-85122589146 71 7000611 en IEEE Transactions on Instrumentation and Measurement © 2021 IEEE. All rights reserved.
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Mechanical engineering
Multi-Camera
Object Tracking
spellingShingle Engineering::Mechanical engineering
Multi-Camera
Object Tracking
Wang, Zengwei
Dai, Houde
Zeng, Yadan
Lueth, Tim C.
A robust 6-D pose tracking approach by fusing a multi-camera tracking device and an AHRS module
description Optical tracking technique based on multiple cameras is widely employed in robots, virtual reality, and industrial measurements due to its excellent position accuracy. However, its 6-D tracking practicability is impaired by the line-of-sight issue and the complicated tracker based on multiple markers. Hence, we implemented a custom-built hybrid tracking system consisting of four-camera equipment and a 6-D tracker comprising a single optical marker and an automatic heading reference system (AHRS). AHRS provides the 3-D orientation of the tracked object directly and compensates for the 3-D position when the optical tracking is occluded. A two-stage cascaded adaptive unscented Kalman filtering (CAUKF) was proposed to enhance real-time fusion tracking performance. The CAUKF not only provides a reliable frequency enhancement solution for the optical tracking adapting to various frequencies, but also improves the continuality of prediction on fusion state variables and the corresponding covariance matrix, which helps initialize the occlusion tracking accurately. When an occlusion occurs, a learning-based adaptive unscented Kalman filter (LAUKF) module can adaptively adjust noise estimation matrices in the unscented transformation according to the AHRS data, thereby significantly reducing the position estimation error. Experimental results reveal that the proposed tracking approach achieved 6-D tracking at 100 Hz with 0.32-mm position error (mean absolute error) and 0.1° orientation error. This study furnishes a novel implementation method for the full 6-D pose tracking with a simplified tracker structure and improved accuracy, continuity, and stability.
author2 School of Mechanical and Aerospace Engineering
author_facet School of Mechanical and Aerospace Engineering
Wang, Zengwei
Dai, Houde
Zeng, Yadan
Lueth, Tim C.
format Article
author Wang, Zengwei
Dai, Houde
Zeng, Yadan
Lueth, Tim C.
author_sort Wang, Zengwei
title A robust 6-D pose tracking approach by fusing a multi-camera tracking device and an AHRS module
title_short A robust 6-D pose tracking approach by fusing a multi-camera tracking device and an AHRS module
title_full A robust 6-D pose tracking approach by fusing a multi-camera tracking device and an AHRS module
title_fullStr A robust 6-D pose tracking approach by fusing a multi-camera tracking device and an AHRS module
title_full_unstemmed A robust 6-D pose tracking approach by fusing a multi-camera tracking device and an AHRS module
title_sort robust 6-d pose tracking approach by fusing a multi-camera tracking device and an ahrs module
publishDate 2022
url https://hdl.handle.net/10356/163777
_version_ 1753801180872441856