A spatial-channel hierarchical deep learning network for pixel-level automated crack detection
This research develops a novel computer vision approach named a spatial-channel hierarchical network (SCHNet), which is feasible to support the automated and reliable concrete crack segmentation at the pixel level. Specifically, SCHNet with a base net Visual Geometry Group 19 (VGG19) contains a self...
Saved in:
Main Authors: | , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2022
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/161075 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-161075 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1610752022-08-15T02:02:22Z A spatial-channel hierarchical deep learning network for pixel-level automated crack detection Pan, Yue Zhang, Gaowei Zhang, Limao School of Civil and Environmental Engineering Engineering::Civil engineering Computer Vision Automated Crack Detection This research develops a novel computer vision approach named a spatial-channel hierarchical network (SCHNet), which is feasible to support the automated and reliable concrete crack segmentation at the pixel level. Specifically, SCHNet with a base net Visual Geometry Group 19 (VGG19) contains a self-attention mechanism, which is realized by three parallel modules, including the feature pyramid attention module, the spatial attention module, and the channel attention module. It can not only consider the semantic interdependencies in spatial and channel dimensions, but also adaptively integrate local features into their global dependencies. The segmentation performance is evaluated by a metric named Mean Intersection over Union (IoU) in a public dataset containing 11,000 cracked and non-cracked images with a unified resolution at 256 × 256 pixels (px). The experimental results confirm the effectiveness of the three attention modules, since they can individually increase Mean IoU by 1.62% (74.16%–72.54%), 5.15% (79.31%–74.16%), and 5.76% (79.92%–74.16%), respectively. With the help of new strategies like the data augmentation and multi-grid method, SCHNet can boost Mean IoU to 85.31%. In a comparison of the state-of-the-art models (i.e. U-net, DeepLab-v2, PSPNet, Ding, Dilated FCN) on the test dataset, SCHNet can outperform others with an improvement of at least 7.51% in Mean IoU. Moreover, SCHNet is robust to noises with a better generalization ability under various conditions, including shadows, roughness surfaces, and holes. Overall, this research contributes to developing SCHNet to integrate spatial and channel information in feature extraction, resulting in a more accurate and efficient crack detection process. Ministry of Education (MOE) Nanyang Technological University The Ministry of Education Tier 1 Grant, Singapore (No. 04MNP000279C120) and the Start-Up Grant at Nanyang Technological University, Singapore (No. 04INS000423C120) are acknowledged for their financial support of this research. 2022-08-15T02:02:22Z 2022-08-15T02:02:22Z 2020 Journal Article Pan, Y., Zhang, G. & Zhang, L. (2020). A spatial-channel hierarchical deep learning network for pixel-level automated crack detection. Automation in Construction, 119, 103357-. https://dx.doi.org/10.1016/j.autcon.2020.103357 0926-5805 https://hdl.handle.net/10356/161075 10.1016/j.autcon.2020.103357 2-s2.0-85088541317 119 103357 en 04MNP000279C120 04INS000423C120 Automation in Construction © 2020 Elsevier B.V. All rights reserved. |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Civil engineering Computer Vision Automated Crack Detection |
spellingShingle |
Engineering::Civil engineering Computer Vision Automated Crack Detection Pan, Yue Zhang, Gaowei Zhang, Limao A spatial-channel hierarchical deep learning network for pixel-level automated crack detection |
description |
This research develops a novel computer vision approach named a spatial-channel hierarchical network (SCHNet), which is feasible to support the automated and reliable concrete crack segmentation at the pixel level. Specifically, SCHNet with a base net Visual Geometry Group 19 (VGG19) contains a self-attention mechanism, which is realized by three parallel modules, including the feature pyramid attention module, the spatial attention module, and the channel attention module. It can not only consider the semantic interdependencies in spatial and channel dimensions, but also adaptively integrate local features into their global dependencies. The segmentation performance is evaluated by a metric named Mean Intersection over Union (IoU) in a public dataset containing 11,000 cracked and non-cracked images with a unified resolution at 256 × 256 pixels (px). The experimental results confirm the effectiveness of the three attention modules, since they can individually increase Mean IoU by 1.62% (74.16%–72.54%), 5.15% (79.31%–74.16%), and 5.76% (79.92%–74.16%), respectively. With the help of new strategies like the data augmentation and multi-grid method, SCHNet can boost Mean IoU to 85.31%. In a comparison of the state-of-the-art models (i.e. U-net, DeepLab-v2, PSPNet, Ding, Dilated FCN) on the test dataset, SCHNet can outperform others with an improvement of at least 7.51% in Mean IoU. Moreover, SCHNet is robust to noises with a better generalization ability under various conditions, including shadows, roughness surfaces, and holes. Overall, this research contributes to developing SCHNet to integrate spatial and channel information in feature extraction, resulting in a more accurate and efficient crack detection process. |
author2 |
School of Civil and Environmental Engineering |
author_facet |
School of Civil and Environmental Engineering Pan, Yue Zhang, Gaowei Zhang, Limao |
format |
Article |
author |
Pan, Yue Zhang, Gaowei Zhang, Limao |
author_sort |
Pan, Yue |
title |
A spatial-channel hierarchical deep learning network for pixel-level automated crack detection |
title_short |
A spatial-channel hierarchical deep learning network for pixel-level automated crack detection |
title_full |
A spatial-channel hierarchical deep learning network for pixel-level automated crack detection |
title_fullStr |
A spatial-channel hierarchical deep learning network for pixel-level automated crack detection |
title_full_unstemmed |
A spatial-channel hierarchical deep learning network for pixel-level automated crack detection |
title_sort |
spatial-channel hierarchical deep learning network for pixel-level automated crack detection |
publishDate |
2022 |
url |
https://hdl.handle.net/10356/161075 |
_version_ |
1743119484764291072 |