A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof

Asphalt pavement cracks are one of the major road damage problems in the civil field as they may potentially threaten road and highway safety. Crack detection and classification are challenging tasks due to the complicated pavement conditions such as the presence of shadows, oil stains, and water sp...

全面介紹

Saved in:
書目詳細資料
主要作者: Muhamed Yusof, Nor Aizam
格式: Thesis
語言:English
出版: 2021
主題:
在線閱讀:https://ir.uitm.edu.my/id/eprint/61064/1/61064.pdf
https://ir.uitm.edu.my/id/eprint/61064/
標簽: 添加標簽
沒有標簽, 成為第一個標記此記錄!
機構: Universiti Teknologi Mara
語言: English
id my.uitm.ir.61064
record_format eprints
spelling my.uitm.ir.610642022-06-07T07:41:46Z https://ir.uitm.edu.my/id/eprint/61064/ A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof Muhamed Yusof, Nor Aizam Neural networks (Computer science) Pavements and paved roads Asphalt pavement cracks are one of the major road damage problems in the civil field as they may potentially threaten road and highway safety. Crack detection and classification are challenging tasks due to the complicated pavement conditions such as the presence of shadows, oil stains, and water spots. These conditions will eventually result in poor visual and low contrast between cracks and the surrounding pavement. Therefore, in tackling these issues, this study proposes a fully automated pavement crack detection and classification using a new Deep Convolutional Neural Network architecture (DCNN) called hierarchical DCNN (Hi-DCNN). The image of pavement cracks is manually prepared in RGB format with a dimension of 1024×768 pixels. This image is captured using NIKON digital camera and segmented into patches (32×32 pixels) as a training dataset from the original pavement cracks. To ease these processes, this study introduces a new app, CrackLabel, that can automatically label patches in the crack images into two groups, crack and non-crack. The CrackLabel utilises a special design image thresholding algorithm known as Global and Lower Quartile Average Intensity (GLQAI). In the first part, a DCNN structure, DCNN-1, is proposed to perform crack detection based on the labelled patches as its input. This is necessary to build training and testing datasets for the network. As a result, the network managed to achieve better performance in crack detection with 98.50%, 98.85%, 98.68%, and 98.67% for recall, precision, accuracy, and F-score respectively. As for the second part involving the crack classification process, DCNN-2 is proposed to classify the detected crack images, obtained from the previous step. This stage is performed to classify images into three groups which are transverse, longitudinal, and alligator cracks. The Hi-DCNN structure achieved promising accuracy of 96.80%, 97.41%, and 95.58% for transverse, longitudinal and alligator respectively. The last part is the integration of the optimized performance networks from the Hi-DCNN, which proposes a new app system that can automatically detect and classify pavement cracks. This app can facilitate and assist civil surveyors in determining pavement distress through a simple and user-friendly interface. For future work, this study suggests a real-time automated app that allows the integration between crack images and a manual operated digital camera to facilitate the automated process. In addition, the conversion of the RGB images into HSV colour space and further evaluation on the crack depth analysis help to obtain fine-detailed information for handling network robustness. 2021-08 Thesis NonPeerReviewed text en https://ir.uitm.edu.my/id/eprint/61064/1/61064.pdf A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof. (2021) PhD thesis, thesis, Universiti Teknologi MARA.
institution Universiti Teknologi Mara
building Tun Abdul Razak Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Teknologi Mara
content_source UiTM Institutional Repository
url_provider http://ir.uitm.edu.my/
language English
topic Neural networks (Computer science)
Pavements and paved roads
spellingShingle Neural networks (Computer science)
Pavements and paved roads
Muhamed Yusof, Nor Aizam
A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof
description Asphalt pavement cracks are one of the major road damage problems in the civil field as they may potentially threaten road and highway safety. Crack detection and classification are challenging tasks due to the complicated pavement conditions such as the presence of shadows, oil stains, and water spots. These conditions will eventually result in poor visual and low contrast between cracks and the surrounding pavement. Therefore, in tackling these issues, this study proposes a fully automated pavement crack detection and classification using a new Deep Convolutional Neural Network architecture (DCNN) called hierarchical DCNN (Hi-DCNN). The image of pavement cracks is manually prepared in RGB format with a dimension of 1024×768 pixels. This image is captured using NIKON digital camera and segmented into patches (32×32 pixels) as a training dataset from the original pavement cracks. To ease these processes, this study introduces a new app, CrackLabel, that can automatically label patches in the crack images into two groups, crack and non-crack. The CrackLabel utilises a special design image thresholding algorithm known as Global and Lower Quartile Average Intensity (GLQAI). In the first part, a DCNN structure, DCNN-1, is proposed to perform crack detection based on the labelled patches as its input. This is necessary to build training and testing datasets for the network. As a result, the network managed to achieve better performance in crack detection with 98.50%, 98.85%, 98.68%, and 98.67% for recall, precision, accuracy, and F-score respectively. As for the second part involving the crack classification process, DCNN-2 is proposed to classify the detected crack images, obtained from the previous step. This stage is performed to classify images into three groups which are transverse, longitudinal, and alligator cracks. The Hi-DCNN structure achieved promising accuracy of 96.80%, 97.41%, and 95.58% for transverse, longitudinal and alligator respectively. The last part is the integration of the optimized performance networks from the Hi-DCNN, which proposes a new app system that can automatically detect and classify pavement cracks. This app can facilitate and assist civil surveyors in determining pavement distress through a simple and user-friendly interface. For future work, this study suggests a real-time automated app that allows the integration between crack images and a manual operated digital camera to facilitate the automated process. In addition, the conversion of the RGB images into HSV colour space and further evaluation on the crack depth analysis help to obtain fine-detailed information for handling network robustness.
format Thesis
author Muhamed Yusof, Nor Aizam
author_facet Muhamed Yusof, Nor Aizam
author_sort Muhamed Yusof, Nor Aizam
title A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof
title_short A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof
title_full A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof
title_fullStr A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof
title_full_unstemmed A hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / Nor Aizam Muhamed Yusof
title_sort hierarchical deep convolutional neural network for asphalt pavement crack detection and classification / nor aizam muhamed yusof
publishDate 2021
url https://ir.uitm.edu.my/id/eprint/61064/1/61064.pdf
https://ir.uitm.edu.my/id/eprint/61064/
_version_ 1735389680404267008