Mask-shadownet: Toward shadow removal via masked adaptive instance normalization

• Main Authors: HE, Shengfeng, PENG, Bing, DONG, Junyu, DU, Yong
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2021
• Subjects: Aligners; Global feature; Image processing and computer vision; Shadow mask; Shadow removal; State of the art; Databases and Information Systems; Theory and Algorithms
• Online Access: https://ink.library.smu.edu.sg/sis_research/8380
• Institution: Singapore Management University

Shadow removal is an important yet challenging task in image processing and computer vision. Existing methods are limited in extracting good global features due to the interference of shadow. And also, most of them ignore a fact that features inside and outside the shaded area should be treated disparately because of different semantics or materials. In this letter, we propose a novel deep neural network Mask-ShadowNet for shadow removal. The core of our approach is a well-designed masked adaptive instance normalization (MAdaIN) mechanism with embedded aligners that serves two goals: 1) producing hidden features that considering an illumination consistency of different regions. 2) treating the feature statistics of shadow and non-shadow areas discriminately based on the shadow mask. Experimental results demonstrate that the proposed model outperforms the state-of-the-art on the ISTD benchmark.