3D face and motion estimation from sparse points using adaptive bracketed minimization

• Main Authors: Chouvatut,V., Madarasmi,S., Tüceryan,M.
• Format: Article
• Published: Springer Netherlands 2015
• Subjects: Computer Networks and Communications; Hardware and Architecture; Software; Media Technology
• Online Access: http://www.scopus.com/inward/record.url?partnerID=HzOxMe3b&scp=84874930357&origin=inward; http://cmuir.cmu.ac.th/handle/6653943832/38689
• Institution: Chiang Mai University

This paper presents a novel method for estimating camera motion and reconstructing human face from a video sequence. The coarse-to-fine method is applied via combining the concepts of Powell's minimization with gradient descent. Sparse points defining the human face in every frame are tracked using the active appearance model. The case of occluded points, even for self-occlusion, does not pose a problem in the proposed method. Robustness in the presence of noise and 3D accuracy using this method is also demonstrated. Examples of face reconstruction using other methods including trifocal tensor, Powell's minimization, and gradient descent are also compared to the proposed method. Experiments on both synthetic and real faces are presented and analyzed. Also, different camera movement paths are illustrated. All real-world experiments used an off-the-shelf digital camera carried by a human walking without using any dolly to demonstrate the robustness and practicality of the proposed method. © 2011 Springer Science+Business Media, LLC.