Face image reflection removal

Face images captured through glass are usually contaminated by reflections. The low-transmitted reflections make the reflection removal more challenging than for general scenes because important facial features would be completely occluded. In this paper, we propose and solve the face image reflecti...

Full description

Saved in:
Bibliographic Details
Main Authors: Wan, Renjie, Shi, Boxin, Li, Haoliang, Duan, Ling-Yu, Kot, Alex Chichung
Other Authors: School of Electrical and Electronic Engineering
Format: Article
Language:English
Published: 2022
Subjects:
Online Access:https://hdl.handle.net/10356/160951
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-160951
record_format dspace
spelling sg-ntu-dr.10356-1609512022-08-08T07:31:12Z Face image reflection removal Wan, Renjie Shi, Boxin Li, Haoliang Duan, Ling-Yu Kot, Alex Chichung School of Electrical and Electronic Engineering Rapid-Rich Object Search (ROSE) Lab Engineering::Electrical and electronic engineering Reflection Removal Deep Learning Face images captured through glass are usually contaminated by reflections. The low-transmitted reflections make the reflection removal more challenging than for general scenes because important facial features would be completely occluded. In this paper, we propose and solve the face image reflection removal problem. We recover the important facial structures by incorporating inpainting ideas into a guided reflection removal framework, which takes two images as the input and considers various face-specific priors. We use a newly collected face reflection image dataset to train our model and compare with state-of-the-art methods. The proposed method shows advantages in estimating reflection-free face images for improving face recognition. Nanyang Technological University The work is supported in part by the Wallenberg-NTU Presidential Postdoctoral Fellowship, the NTU-PKU Joint Research Institute, a collaboration between the Nanyang Technological University and Peking University that is sponsored by a donation from the Ng Teng Fong Charitable Foundation, and the Science and Technology Foundation of Guangzhou Huangpu Development District under Grant 201902010028. This research is in part supported by the National Natural Science Foundation of China under Grants 61872012 and U1611461, and Beijing Academy of Artificial Intelligence (BAAI). 2022-08-08T07:31:12Z 2022-08-08T07:31:12Z 2021 Journal Article Wan, R., Shi, B., Li, H., Duan, L. & Kot, A. C. (2021). Face image reflection removal. International Journal of Computer Vision, 129(2), 385-399. https://dx.doi.org/10.1007/s11263-020-01372-5 0920-5691 https://hdl.handle.net/10356/160951 10.1007/s11263-020-01372-5 2-s2.0-85091063871 2 129 385 399 en International Journal of Computer Vision © 2020 Springer Science+Business Media, LLC, part of Springer Nature.
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Electrical and electronic engineering
Reflection Removal
Deep Learning
spellingShingle Engineering::Electrical and electronic engineering
Reflection Removal
Deep Learning
Wan, Renjie
Shi, Boxin
Li, Haoliang
Duan, Ling-Yu
Kot, Alex Chichung
Face image reflection removal
description Face images captured through glass are usually contaminated by reflections. The low-transmitted reflections make the reflection removal more challenging than for general scenes because important facial features would be completely occluded. In this paper, we propose and solve the face image reflection removal problem. We recover the important facial structures by incorporating inpainting ideas into a guided reflection removal framework, which takes two images as the input and considers various face-specific priors. We use a newly collected face reflection image dataset to train our model and compare with state-of-the-art methods. The proposed method shows advantages in estimating reflection-free face images for improving face recognition.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Wan, Renjie
Shi, Boxin
Li, Haoliang
Duan, Ling-Yu
Kot, Alex Chichung
format Article
author Wan, Renjie
Shi, Boxin
Li, Haoliang
Duan, Ling-Yu
Kot, Alex Chichung
author_sort Wan, Renjie
title Face image reflection removal
title_short Face image reflection removal
title_full Face image reflection removal
title_fullStr Face image reflection removal
title_full_unstemmed Face image reflection removal
title_sort face image reflection removal
publishDate 2022
url https://hdl.handle.net/10356/160951
_version_ 1743119482048479232