FHENet: lightweight feature hierarchical exploration network for real-time rail surface defect inspection in RGB-D images

• Main Authors: Zhou, Wujie, Hong, Jiankang
• Other Authors: School of Computer Science and Engineering
• Format: Article
• Language: English
• Published: 2023
• Subjects: Engineering::Computer science and engineering; Boundary Extraction; Cross-Modality Exploration
• Online Access: https://hdl.handle.net/10356/170750
• Institution: Nanyang Technological University

In recent years, computer vision systems have been increasingly applied to rail defect inspection. Rail defects should be identified quickly and accurately to ensure safe, stable, and fast train operations and thereby reduce the incidence of accidents and economic losses. As most existing methods focus on accuracy, they cannot be deployed on mobile devices with limited computational resources. To solve this problem, we propose a lightweight feature hierarchical exploration network (FHENet) for real-time rail surface defect inspection. First, boundary textures of rail defects are acquired based on the maximum function and maximum pooling in a novel boundary extraction module (BEM), which improves boundary prediction while avoiding heavy computations. Second, a novel cross-modality exploration module (CEM) complements prominent regions through basic operations to avoid complex inference while providing high detection performance. Third, a novel multifeature integration module (MIM) optimizes representative feature regions by using simple operations to avoid complex computations. Results from extensive experiments demonstrate the superiority of the proposed FHENet to 14 state-of-the-art methods. Regarding efficiency, FHENet outperforms the state-of-the-art methods with only 5.26 M parameters and a processing speed of 60.33 frames/s. The FHENet code and results are available at https://github.com/hjklearn/Rail-Defect-Detection.