Defect-GAN : high-fidelity defect synthesis for automated defect inspection

Automated defect inspection is critical for effective and efficient maintenance, repair, and operations in advanced manufacturing. On the other hand, automated defect inspection is often constrained by the lack of defect samples, especially when we adopt deep neural networks for this task. This pape...

Full description

Saved in:
Bibliographic Details
Main Authors: Zhang, Gongjie, Cui, Kaiwen, Hung, Tzu-Yi, Lu, Shijian
Other Authors: School of Electrical and Electronic Engineering
Format: Conference or Workshop Item
Language:English
Published: 2021
Subjects:
Online Access:https://hdl.handle.net/10356/146285
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-146285
record_format dspace
spelling sg-ntu-dr.10356-1462852021-02-05T02:29:52Z Defect-GAN : high-fidelity defect synthesis for automated defect inspection Zhang, Gongjie Cui, Kaiwen Hung, Tzu-Yi Lu, Shijian School of Electrical and Electronic Engineering 2021 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) Delta Research Center, Singapore Delta-NTU Corporate Laboratory Engineering::Computer science and engineering Defect Inspection Image Synthesis Automated defect inspection is critical for effective and efficient maintenance, repair, and operations in advanced manufacturing. On the other hand, automated defect inspection is often constrained by the lack of defect samples, especially when we adopt deep neural networks for this task. This paper presents Defect-GAN, an automated defect synthesis network that generates realistic and diverse defect samples for training accurate and robust defect inspection networks. Defect-GAN learns through defacement and restoration processes, where the defacement generates defects on normal surface images while the restoration removes defects to generate normal images. It employs a novel compositional layer-based architecture for generating realistic defects within various image backgrounds with different textures and appearances. It can also mimic the stochastic variations of defects and offer flexible control over the locations and categories of the generated defects within the image background. Extensive experiments show that Defect-GAN is capable of synthesizing various defects with superior diversity and fidelity. In addition, the synthesized defect samples demonstrate their effectiveness in training better defect inspection networks. National Research Foundation (NRF) Accepted version This work was conducted within the Delta-NTU Corporate Lab for Cyber-Physical Systems with funding support from Delta Electronics Inc. and the National Research Foundation (NRF) Singapore under the Corp Lab@University Scheme (Project No.: DELTA-NTU CORP-SMA-RP15). 2021-02-05T02:29:52Z 2021-02-05T02:29:52Z 2021 Conference Paper Zhang, G., Cui, K., Hung, T.- Y., & Lu, S. (2021). Defect-GAN : high-fidelity defect synthesis for automated defect inspection. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2524-2534. https://hdl.handle.net/10356/146285 2524 2534 en DELTA-NTU CORP-SMA-RP15 © 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering
Defect Inspection
Image Synthesis
spellingShingle Engineering::Computer science and engineering
Defect Inspection
Image Synthesis
Zhang, Gongjie
Cui, Kaiwen
Hung, Tzu-Yi
Lu, Shijian
Defect-GAN : high-fidelity defect synthesis for automated defect inspection
description Automated defect inspection is critical for effective and efficient maintenance, repair, and operations in advanced manufacturing. On the other hand, automated defect inspection is often constrained by the lack of defect samples, especially when we adopt deep neural networks for this task. This paper presents Defect-GAN, an automated defect synthesis network that generates realistic and diverse defect samples for training accurate and robust defect inspection networks. Defect-GAN learns through defacement and restoration processes, where the defacement generates defects on normal surface images while the restoration removes defects to generate normal images. It employs a novel compositional layer-based architecture for generating realistic defects within various image backgrounds with different textures and appearances. It can also mimic the stochastic variations of defects and offer flexible control over the locations and categories of the generated defects within the image background. Extensive experiments show that Defect-GAN is capable of synthesizing various defects with superior diversity and fidelity. In addition, the synthesized defect samples demonstrate their effectiveness in training better defect inspection networks.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Zhang, Gongjie
Cui, Kaiwen
Hung, Tzu-Yi
Lu, Shijian
format Conference or Workshop Item
author Zhang, Gongjie
Cui, Kaiwen
Hung, Tzu-Yi
Lu, Shijian
author_sort Zhang, Gongjie
title Defect-GAN : high-fidelity defect synthesis for automated defect inspection
title_short Defect-GAN : high-fidelity defect synthesis for automated defect inspection
title_full Defect-GAN : high-fidelity defect synthesis for automated defect inspection
title_fullStr Defect-GAN : high-fidelity defect synthesis for automated defect inspection
title_full_unstemmed Defect-GAN : high-fidelity defect synthesis for automated defect inspection
title_sort defect-gan : high-fidelity defect synthesis for automated defect inspection
publishDate 2021
url https://hdl.handle.net/10356/146285
_version_ 1692012933174788096