Region-aware reflection removal with unified content and gradient priors

• Main Authors: WAN, Renjie, SHI, Boxin, DUAN, Ling-Yu, TAN, Ah-hwee, GAO, Wen, KOT, Alex C.
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2018
• Subjects: Reflection removal; internal patch recurrence; content prior; sparse representation; Databases and Information Systems; OS and Networks; Software Engineering
• Online Access: https://ink.library.smu.edu.sg/sis_research/5194; https://ink.library.smu.edu.sg/context/sis_research/article/6197/viewcontent/Region_Aware_Reflection_Removal_With_Unified_Content_and_Gradient_Priors.pdf
• Institution: Singapore Management University

Removing the undesired reflections in images taken through the glass is of broad application to various image processing and computer vision tasks. Existing single image-based solutions heavily rely on scene priors such as separable sparse gradients caused by different levels of blur, and they are fragile when such priors are not observed. In this paper, we notice that strong reflections usually dominant a limited region in the whole image, and propose a region-aware reflection removal approach by automatically detecting and heterogeneously processing regions with and without reflections. We integrate content and gradient priors to jointly achieve missing contents restoration, as well as background and reflection separation, in a unified optimization framework. Extensive validation using 50 sets of real data shows that the proposed method outperforms state-of-the-art on both quantitative metrics and visual qualities.