Virtual assembly using hand tracking with Microsoft Kinect

Virtual reality allows users to interact with objects in a virtual environment in a way like real life. Camera devices like the Microsoft Kinect are required, where the body of the users are tracked using its equipped camera sensors. Additionally, the user’s body orientation and gestures like clo...

Full description

Saved in:
Bibliographic Details
Main Author: Teo, Brendon Yu Jie
Other Authors: Alexei Sourin
Format: Final Year Project
Language:English
Published: Nanyang Technological University 2022
Subjects:
Online Access:https://hdl.handle.net/10356/157659
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-157659
record_format dspace
spelling sg-ntu-dr.10356-1576592022-05-21T13:29:49Z Virtual assembly using hand tracking with Microsoft Kinect Teo, Brendon Yu Jie Alexei Sourin School of Computer Science and Engineering assourin@ntu.edu.sg Engineering::Computer science and engineering::Computer applications Virtual reality allows users to interact with objects in a virtual environment in a way like real life. Camera devices like the Microsoft Kinect are required, where the body of the users are tracked using its equipped camera sensors. Additionally, the user’s body orientation and gestures like closing and opening of the hands, can be tracked. This allows realistic interactions such as grabbing and releasing an object or changing an object’s orientation to be mapped to the user’s gestures and body orientation. In an ideal situation, tasks performed in virtual reality should take as long as in real life. However, limitations such as the lack of physical feedback, and tracking problems such as occlusion can affect the accuracy of interactions and can make tasks take longer to complete in Virtual Reality. In this project, using the Unity Engine, the interactions methods were developed to circumvent these limitations and scripted with C#, utilizing the Microsoft Kinect. A user study is carried out to determine how effective and user-friendly these interactions methods are. Users will be tasked to complete tasks created in Unity and in real-life and the completion times are recorded. These interaction methods are evaluated by the difference in completion times between the Unity and real-life variants and feedback gathered from the users’ experience. Bachelor of Engineering (Computer Engineering) 2022-05-21T13:29:48Z 2022-05-21T13:29:48Z 2022 Final Year Project (FYP) Teo, B. Y. J. (2022). Virtual assembly using hand tracking with Microsoft Kinect. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/157659 https://hdl.handle.net/10356/157659 en SCSE21-0133 application/pdf Nanyang Technological University
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering::Computer applications
spellingShingle Engineering::Computer science and engineering::Computer applications
Teo, Brendon Yu Jie
Virtual assembly using hand tracking with Microsoft Kinect
description Virtual reality allows users to interact with objects in a virtual environment in a way like real life. Camera devices like the Microsoft Kinect are required, where the body of the users are tracked using its equipped camera sensors. Additionally, the user’s body orientation and gestures like closing and opening of the hands, can be tracked. This allows realistic interactions such as grabbing and releasing an object or changing an object’s orientation to be mapped to the user’s gestures and body orientation. In an ideal situation, tasks performed in virtual reality should take as long as in real life. However, limitations such as the lack of physical feedback, and tracking problems such as occlusion can affect the accuracy of interactions and can make tasks take longer to complete in Virtual Reality. In this project, using the Unity Engine, the interactions methods were developed to circumvent these limitations and scripted with C#, utilizing the Microsoft Kinect. A user study is carried out to determine how effective and user-friendly these interactions methods are. Users will be tasked to complete tasks created in Unity and in real-life and the completion times are recorded. These interaction methods are evaluated by the difference in completion times between the Unity and real-life variants and feedback gathered from the users’ experience.
author2 Alexei Sourin
author_facet Alexei Sourin
Teo, Brendon Yu Jie
format Final Year Project
author Teo, Brendon Yu Jie
author_sort Teo, Brendon Yu Jie
title Virtual assembly using hand tracking with Microsoft Kinect
title_short Virtual assembly using hand tracking with Microsoft Kinect
title_full Virtual assembly using hand tracking with Microsoft Kinect
title_fullStr Virtual assembly using hand tracking with Microsoft Kinect
title_full_unstemmed Virtual assembly using hand tracking with Microsoft Kinect
title_sort virtual assembly using hand tracking with microsoft kinect
publisher Nanyang Technological University
publishDate 2022
url https://hdl.handle.net/10356/157659
_version_ 1734310167164485632