Virtual assembling using hand tracking with leap motion controller

The hand tracking device Leap Motion Controller has been applied in many areas since it was released. Most applications are related to gaming and sign language recognition, where high precision is not a necessity. However, in places like surgical training and virtual assembly, the precision could b...

Full description

Saved in:
Bibliographic Details
Main Author: Mu, Siyi
Other Authors: Alexei Sourin
Format: Final Year Project
Language:English
Published: Nanyang Technological University 2021
Subjects:
Online Access:https://hdl.handle.net/10356/147966
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:The hand tracking device Leap Motion Controller has been applied in many areas since it was released. Most applications are related to gaming and sign language recognition, where high precision is not a necessity. However, in places like surgical training and virtual assembly, the precision could be fatal. With the aim of higher precision, a new interaction mechanism is designed to manipulate objects, in which collision detection between the virtual hand and objects is not required. Instead, it controls the grasping and releasing with the gestures of one hand and moves the object with the other hand's displacement. This mechanism is implemented in Unity 20.1.2 with Leap Motion SDK 4.1.0 and Leap Motion Unity Module 4.7.1. After several tests, the mechanism is proven to have reasonably high precision. It allows the users to adjust the parameters to create customized systems, leading to an optimal outcome.