Reflection removal on single light field capture using focus manipulation

Photos taken through reflective surfaces such as display windows inevitably suffer from visual degradations caused by reflection interferences. The superimposition of two layers, i.e., background and reflection, obscures important target features, and causes challenges for subsequent computer vision...

Full description

Saved in:
Bibliographic Details
Main Authors: Ni, Yun, Chen, Jie, Chau, Lap-Pui
Other Authors: School of Electrical and Electronic Engineering
Format: Article
Language:English
Published: 2020
Subjects:
Online Access:https://hdl.handle.net/10356/140148
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:Photos taken through reflective surfaces such as display windows inevitably suffer from visual degradations caused by reflection interferences. The superimposition of two layers, i.e., background and reflection, obscures important target features, and causes challenges for subsequent computer vision applications. In this paper, we introduce a reflection removal method using single light field (LF) captures. Through focus manipulation and subsequent optimization, our algorithm is able to separate reflection from background effectively by exploiting the subtle pixel parallax of LF data. Since it requires only a single capture of the scene, it can handle moving scenes that change quickly, as well as static ones. Extensive experiments have been carried out over both synthetic and real LF data, which show our method outperforms state-of-the-art ones by at least 2.9 dB in terms of background restoration PSNR, with significantly fewer visual artifacts.