Dynamic 3-D facial compression using low rank and sparse decomposition

• Main Authors: Chau, Lap-Pui, Hou, Junhui, He, Ying, Quynh, Dao Thi Phuong, Magnenat-Thalmann, Nadia
• Other Authors: School of Computer Engineering
• Format: Conference or Workshop Item
• Language: English
• Published: 2013
• Subjects: DRNTU::Engineering::Computer science and engineering
• Online Access: https://hdl.handle.net/10356/97582; http://hdl.handle.net/10220/12085
• Institution: Nanyang Technological University

In this paper, we propose a new compression framework for dynamic 3-D facial expressions acquired from structured light based 3-D camera, based on our previous work. Taking advantage of the near-isometric property of human facial expressions, we parameterize the dynamic 3-D faces into an expression-invariant canonical domain, which naturally generates geometry video and allows us to apply the well-studied video compression technique. Then, low rank and sparse decomposition is applied to each dimension (i.e., X, Y and Z, respectively) before the H.264/AVC encoder is employed to separately encode each dimension instead of encoding them as a whole. Experimental results show that the averaged 3-4 dB gain is achieved by the proposed scheme compared with existing algorithms.