CUDA acceleration of 3D dynamic scene reconstruction and 3D motion estimation for motion capture

Tracking of 3D human body movement from multiple camera video streams is an important problem in the domain of computer vision. In this paper we perform body pose tracking in 3D space using 3D data reconstructed at every frame. We present an efficient GPU-based method for 3D reconstruction of the re...

Full description

Saved in:
Bibliographic Details
Main Authors: Zhang, Zheng, Seah, Hock Soon
Other Authors: School of Computer Engineering
Format: Conference or Workshop Item
Language:English
Published: 2013
Subjects:
Online Access:https://hdl.handle.net/10356/98302
http://hdl.handle.net/10220/12376
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:Tracking of 3D human body movement from multiple camera video streams is an important problem in the domain of computer vision. In this paper we perform body pose tracking in 3D space using 3D data reconstructed at every frame. We present an efficient GPU-based method for 3D reconstruction of the real world dynamic scenes. Besides volumetric reconstruction, we propose to compute view-independent 3D optical flow (i.e., scene flow) in combination with volumetric reconstruction, and have attained efficient scene flow estimation using GPU acceleration. Body pose estimation starts from a deterministic prediction based on scene flow, and then uses a multi-layer search algorithm involving stochastic search and local optimization. We design and parallelize the PSO-based (particle swarm optimization) stochastic search algorithm and 3D DT (distance transform) computation of the pose estimation method on GPU. To the end, our system can reach efficient and robust body pose tracking.