Scalable 3D interface system with multiple kinects

As you may have seen the situation where one person stands in the front of the Windows Xbox game station and uses only the hand motion and spoken command to play the hottest Fruit Ninja game, this is the magic brought by the latest kinetic gaming controller Microsoft Kinect. It resembles the latest...

Full description

Saved in:
Bibliographic Details
Main Author: Guo, Hao.
Other Authors: Seah Hock Soon
Format: Final Year Project
Language:English
Published: 2012
Subjects:
Online Access:http://hdl.handle.net/10356/48817
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:As you may have seen the situation where one person stands in the front of the Windows Xbox game station and uses only the hand motion and spoken command to play the hottest Fruit Ninja game, this is the magic brought by the latest kinetic gaming controller Microsoft Kinect. It resembles the latest technology in the natural interaction interface and brought its application to various industries from gaming and education to medical operation and manufacturing. This project aimed to build a scalable 3D gaming interface with multiple Kinects devices. The OpenNI framework was utilized as the middleware to communicate with the Kinect devices. The whole project was built on the Qt framework. The Intermediate data processing and visualization was dependent on the OpenCV and VTK libraries. The software level across Kinects synchronization was achieved by a multiple threads system. The OpenCV based stereo calibration was implemented to get the respective location of any two Kinect devices and then the 3D scene data could be projected to the common image plan. Lastly the reconstructed 3D scene based on the cloud of points was implemented and visualized with Visualization Toolkit.