Visibility constrained generative model for depth-based 3D facial pose tracking

• Main Authors: Sheng, Lu, Cai, Jianfei, Cham, Tat-Jen, Pavlovic, Vladimir, Ngan, King Ngi
• Other Authors: School of Computer Science and Engineering
• Format: Article
• Language: English
• Published: 2020
• Subjects: Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision; 3D Facial Pose Tracking; Generative Model
• Online Access: https://hdl.handle.net/10356/138265
• Institution: Nanyang Technological University

In this paper, we propose a generative framework that unifies depth-based 3D facial pose tracking and face model adaptation on-the-fly, in the unconstrained scenarios with heavy occlusions and arbitrary facial expression variations. Specifically, we introduce a statistical 3D morphable model that fl...