Vectorization based color transfer for portrait images

• Main Authors: Fu, Qian, He, Ying, Hou, Fei, Zhang, Juyong, Zeng, Anxiang, Liu, Yong-Jin
• Other Authors: School of Computer Science and Engineering
• Format: Article
• Language: English
• Published: 2021
• Subjects: Engineering::Computer science and engineering; Color Transfer; Portrait Images
• Online Access: https://hdl.handle.net/10356/152285
• Institution: Nanyang Technological University

This paper introduces a method for transferring colors between portrait images. Using a trained neural network to extract facial mask, we vectorize each image with a set of sparse diffusion curves to encode the low-frequency colors, and use the Laplacian of residual colors to represent the high-frequency details. Then we apply optimal mass transport to transfer the boundary colors between the diffusion curves of the source and reference images. Finally, the original or modified Laplacians of colors are added to the transferred diffusion curve image. Unlike the existing methods that either require 3D information or assume the source and reference images have similar poses and dense correspondence, our method is computationally efficient and flexible, which can work for portrait images with large pose and color differences.