Scalable 3D interface system with multiple kinects

• Main Author: Guo, Hao.
• Other Authors: Seah Hock Soon
• Format: Final Year Project
• Language: English
• Published: 2012
• Subjects: DRNTU::Engineering::Computer science and engineering::Information systems
• Online Access: http://hdl.handle.net/10356/48817
• Institution: Nanyang Technological University

As you may have seen the situation where one person stands in the front of the Windows Xbox game station and uses only the hand motion and spoken command to play the hottest Fruit Ninja game, this is the magic brought by the latest kinetic gaming controller Microsoft Kinect. It resembles the latest technology in the natural interaction interface and brought its application to various industries from gaming and education to medical operation and manufacturing. This project aimed to build a scalable 3D gaming interface with multiple Kinects devices. The OpenNI framework was utilized as the middleware to communicate with the Kinect devices. The whole project was built on the Qt framework. The Intermediate data processing and visualization was dependent on the OpenCV and VTK libraries. The software level across Kinects synchronization was achieved by a multiple threads system. The OpenCV based stereo calibration was implemented to get the respective location of any two Kinect devices and then the 3D scene data could be projected to the common image plan. Lastly the reconstructed 3D scene based on the cloud of points was implemented and visualized with Visualization Toolkit.