Reflection removal on single light field capture using focus manipulation

• Main Authors: Ni, Yun, Chen, Jie, Chau, Lap-Pui
• Other Authors: School of Electrical and Electronic Engineering
• Format: Article
• Language: English
• Published: 2020
• Subjects: Engineering::Electrical and electronic engineering; Reflection Removal; Light Field
• Online Access: https://hdl.handle.net/10356/140148
• Institution: Nanyang Technological University

Photos taken through reflective surfaces such as display windows inevitably suffer from visual degradations caused by reflection interferences. The superimposition of two layers, i.e., background and reflection, obscures important target features, and causes challenges for subsequent computer vision applications. In this paper, we introduce a reflection removal method using single light field (LF) captures. Through focus manipulation and subsequent optimization, our algorithm is able to separate reflection from background effectively by exploiting the subtle pixel parallax of LF data. Since it requires only a single capture of the scene, it can handle moving scenes that change quickly, as well as static ones. Extensive experiments have been carried out over both synthetic and real LF data, which show our method outperforms state-of-the-art ones by at least 2.9 dB in terms of background restoration PSNR, with significantly fewer visual artifacts.