Structure priors aided visual-inertial navigation in building inspection tasks with auxiliary line features

• Main Authors: Lyu, Yang, Yuan, Shenghai, Xie, Lihua
• Other Authors: School of Electrical and Electronic Engineering
• Format: Article
• Language: English
• Published: 2022
• Subjects: Engineering::Electrical and electronic engineering; Inspection; Buildings
• Online Access: https://hdl.handle.net/10356/163765
• Institution: Nanyang Technological University

The article proposes a visual-inertial navigation method to support the autonomous operation of a quadrotor UAV during the building faade inspection tasks, where state-of-the-art vision-based localization methods may fail due to texture point feature insufficiency. Considering the appearance characteristics of the building faades, we additionally fuse line features and their corresponding structure prior information to the sliding-window-based estimator to improve localization reliability and accuracy. The contribution of the proposed method lies mainly in two aspects. First, we develop an informative feature selection mechanism according to the faade patterns and the inspection trajectory patterns to make a balance between localization accuracy and computation overheads. Second, we further utilize structure prior information, which is defined as line-to-line and point-to-line relationships, as another source of high-fidelity measurement to restrain the localization drifts. The proposed method is tested not only on public datasets, but also on an actual flight data package recorded in a building inspection task. Experimental results show that the proposed method can serve as a practical tool for navigating a robot in a building inspection task, with improved localization reliability and accuracy.