Remove specular highlight from facial images using deep learning

• Main Author: Ooi, Yue Ying
• Other Authors: Cham Tat Jen
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2021
• Subjects: Engineering::General
• Online Access: https://hdl.handle.net/10356/148186
• Institution: Nanyang Technological University

In this paper, I present an image pre-processing technique, known as specular highlight removal in facial images. In comparison to previous works that depend on physical and statistical properties of human skin and faces, I propose a deep learning algorithm using autoencoder to generate highlight-free/diffuse facial images. By taking facial images with specular highlight as the input, the autoencoder model that has been trained on the corresponding diffuse images will attempt to reconstruct diffuse images from the features that it has learned. The results obtained in this project demonstrate a good learning efficiency and reliable reconstruction of the facial image. I have also built a dataset of synthetic facial images in a different lighting environment that was used in this facial highlight removal experiment.