Stylizing face images via multiple exemplars

• Main Authors: SONG, Yibing, BAO, Linchao, HE, Shengfeng, YANG, Qingxiong, YANG, Ming-Hsuan
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2017
• Subjects: Style transfer; Image processing; Information Security
• Online Access: https://ink.library.smu.edu.sg/sis_research/7841; https://ink.library.smu.edu.sg/context/sis_research/article/8844/viewcontent/stylizing.pdf
• Institution: Singapore Management University

We address the problem of transferring the style of a headshot photo to face images. Existing methods using a single exemplar lead to inaccurate results when the exemplar does not contain sufficient stylized facial components for a given photo. In this work, we propose an algorithm to stylize face images using multiple exemplars containing different subjects in the same style. Patch correspondences between an input photo and multiple exemplars are established using a Markov Random Field (MRF), which enables accurate local energy transfer via Laplacian stacks. As image patches from multiple exemplars are used, the boundaries of facial components on the target image are inevitably inconsistent. The artifacts are removed by a post-processing step using an edge-preserving filter. Experimental results show that the proposed algorithm consistently produces visually pleasing results. (C) 2017 Elsevier Inc. All rights reserved.