Two-stage photograph cartoonization via line tracing

• Main Authors: LI, Simin, WEN, Qiang, ZHAO, Shuang, SUN, Zixun, HE, Shengfeng
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2020
• Subjects: Computing; methodologies; Neural networks; Image processing; Information Security
• Online Access: https://ink.library.smu.edu.sg/sis_research/7842; https://ink.library.smu.edu.sg/context/sis_research/article/8845/viewcontent/twostage.pdf
• Institution: Singapore Management University

Cartoon is highly abstracted with clear edges, which makes it unique from the other art forms. In this paper, we focus on the essential cartoon factors of abstraction and edges, aiming to cartoonize real-world photographs like an artist. To this end, we propose a two-stage network, each stage explicitly targets at producing abstracted shading and crisp edges respectively. In the first abstraction stage, we propose a novel unsupervised bilateral flattening loss, which allows generating high-quality smoothing results in a label-free manner. Together with two other semantic-aware losses, the abstraction stage imposes different forms of regularization for creating cartoon-like flattened images. In the second stage we draw lines on the structural edges of the flattened cartoon with the fully supervised line drawing objective and unsupervised edge augmenting loss. We collect a cartoon-line dataset with line tracing, and it serves as the starting point for preparing abstraction and line drawing data. We have evaluated the proposed method on a large number of photographs, by converting them to three different cartoon styles. Our method substantially outperforms state-of-the-art methods in terms of visual quality quantitatively and qualitatively.