BIM-based indoor mobile robot initialization for construction automation using object detection
In recent years, there has been increasing interest in robotic solutions to revolutionize the conventional construction industry. Despite various advances in developing mobile robotic solutions for construction automation. One key bottleneck towards a fully automated robotic solution in construction...
Saved in:
Main Authors: | , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2023
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/164652 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-164652 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1646522023-02-07T07:36:18Z BIM-based indoor mobile robot initialization for construction automation using object detection Zhao, Xinge Cheah, Chien Chern School of Electrical and Electronic Engineering Engineering::Electrical and electronic engineering Mobile Robot Initialization Construction Robot In recent years, there has been increasing interest in robotic solutions to revolutionize the conventional construction industry. Despite various advances in developing mobile robotic solutions for construction automation. One key bottleneck towards a fully automated robotic solution in construction is the initialization of the mobile robot. Currently, most of the commercialized mobile construction robots are manually initialized before autonomous navigation can be performed at the construction sites for automated tasks. Even if the robot is initialized, the location information can be lost while navigating and re-initialization is required to resume the navigation. Any wrong initialization can cause failure in robot pose tracking and thus prevent the robot from performing the planned tasks. However, in indoor construction sites, GPS is not accessible, and indoor infrastructures, such as beacon devices are not available for robot initialization. In addition, construction environments are dynamic with significant change in scenes and structures for different construction blocks and floors, making pre-scanning of the environments and map matching difficult and time-consuming. An infrastructure-free and environment-independent robot initialization method is therefore required. In this paper, we propose an integrated Building Information Model (BIM)-based indoor robot initialization system using an object detector to automatically initialize the mobile robot when it is deployed at an unknown location. Convolutional neural network (CNN)-based object detection technique is used to detect and locate the visual features, which are widely distributed building components at construction sites. A feature matching algorithm is developed to correlate the acquired online information of detected features with geometric and semantic information retrieved from BIM. The robot location in the BIM coordinate frame is then estimated based on the feature association. Moreover, the proposed system aggregates the BIM information and the sensory information to supervise the online robot decision making, making the entire system fully automatic. The proposed system is validated through experiments in various environments including a university building and ongoing construction sites. Agency for Science, Technology and Research (A*STAR) This work is supported by the Agency For Science, Technology and Research (A*STAR), Singapore, under the National Robotics Program (NRP)-Robotics Domain Specific (RDS: Ref. [1922200001]). 2023-02-07T07:36:18Z 2023-02-07T07:36:18Z 2023 Journal Article Zhao, X. & Cheah, C. C. (2023). BIM-based indoor mobile robot initialization for construction automation using object detection. Automation in Construction, 146, 104647-. https://dx.doi.org/10.1016/j.autcon.2022.104647 0926-5805 https://hdl.handle.net/10356/164652 10.1016/j.autcon.2022.104647 2-s2.0-85142901787 146 104647 en NRP-RDS-1922200001 Automation in Construction © 2022 Elsevier B.V. All rights reserved. |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Electrical and electronic engineering Mobile Robot Initialization Construction Robot |
spellingShingle |
Engineering::Electrical and electronic engineering Mobile Robot Initialization Construction Robot Zhao, Xinge Cheah, Chien Chern BIM-based indoor mobile robot initialization for construction automation using object detection |
description |
In recent years, there has been increasing interest in robotic solutions to revolutionize the conventional construction industry. Despite various advances in developing mobile robotic solutions for construction automation. One key bottleneck towards a fully automated robotic solution in construction is the initialization of the mobile robot. Currently, most of the commercialized mobile construction robots are manually initialized before autonomous navigation can be performed at the construction sites for automated tasks. Even if the robot is initialized, the location information can be lost while navigating and re-initialization is required to resume the navigation. Any wrong initialization can cause failure in robot pose tracking and thus prevent the robot from performing the planned tasks. However, in indoor construction sites, GPS is not accessible, and indoor infrastructures, such as beacon devices are not available for robot initialization. In addition, construction environments are dynamic with significant change in scenes and structures for different construction blocks and floors, making pre-scanning of the environments and map matching difficult and time-consuming. An infrastructure-free and environment-independent robot initialization method is therefore required. In this paper, we propose an integrated Building Information Model (BIM)-based indoor robot initialization system using an object detector to automatically initialize the mobile robot when it is deployed at an unknown location. Convolutional neural network (CNN)-based object detection technique is used to detect and locate the visual features, which are widely distributed building components at construction sites. A feature matching algorithm is developed to correlate the acquired online information of detected features with geometric and semantic information retrieved from BIM. The robot location in the BIM coordinate frame is then estimated based on the feature association. Moreover, the proposed system aggregates the BIM information and the sensory information to supervise the online robot decision making, making the entire system fully automatic. The proposed system is validated through experiments in various environments including a university building and ongoing construction sites. |
author2 |
School of Electrical and Electronic Engineering |
author_facet |
School of Electrical and Electronic Engineering Zhao, Xinge Cheah, Chien Chern |
format |
Article |
author |
Zhao, Xinge Cheah, Chien Chern |
author_sort |
Zhao, Xinge |
title |
BIM-based indoor mobile robot initialization for construction automation using object detection |
title_short |
BIM-based indoor mobile robot initialization for construction automation using object detection |
title_full |
BIM-based indoor mobile robot initialization for construction automation using object detection |
title_fullStr |
BIM-based indoor mobile robot initialization for construction automation using object detection |
title_full_unstemmed |
BIM-based indoor mobile robot initialization for construction automation using object detection |
title_sort |
bim-based indoor mobile robot initialization for construction automation using object detection |
publishDate |
2023 |
url |
https://hdl.handle.net/10356/164652 |
_version_ |
1759058783648088064 |