Kinect-based automatic sign language recognition

As technology advances, so does its popularity as a teaching tool, and it can be envisioned that technology will play an integral role in education in the future. This project aims to integrate the use of technology with sign-language to help improve and promote communication not only amongst the he...

Full description

Saved in:
Bibliographic Details
Main Author: Lin, Zi Ying
Other Authors: Cham Tat Jen
Format: Final Year Project
Language:English
Published: 2016
Subjects:
Online Access:http://hdl.handle.net/10356/66915
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-66915
record_format dspace
spelling sg-ntu-dr.10356-669152023-03-03T20:31:19Z Kinect-based automatic sign language recognition Lin, Zi Ying Cham Tat Jen School of Computer Engineering DRNTU::Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision As technology advances, so does its popularity as a teaching tool, and it can be envisioned that technology will play an integral role in education in the future. This project aims to integrate the use of technology with sign-language to help improve and promote communication not only amongst the hearing-impaired, but also with their friends and family as well. The project works on using the functionality of the depth sensor on the Microsoft Kinect to recognize gestures according to the American Sign Language (ASL). The project is a prototype that demonstrates the concept of learning with technology by allowing users to practice the ASL hand gestures through an educational game. The depth sensor in the Microsoft Kinect allows the project to detect and identify the hand and 5 individual fingers. The concept of gesture recognition is essential to future developments of this project and serves a basis, as this project scratches only the surface of the potential of this concept. This report details the process of development of this project, the detection of the hand and fingers, as well as the recognition of gestures. Bachelor of Engineering (Computer Science) 2016-05-04T08:16:28Z 2016-05-04T08:16:28Z 2016 Final Year Project (FYP) http://hdl.handle.net/10356/66915 en Nanyang Technological University 39 p. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic DRNTU::Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision
spellingShingle DRNTU::Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision
Lin, Zi Ying
Kinect-based automatic sign language recognition
description As technology advances, so does its popularity as a teaching tool, and it can be envisioned that technology will play an integral role in education in the future. This project aims to integrate the use of technology with sign-language to help improve and promote communication not only amongst the hearing-impaired, but also with their friends and family as well. The project works on using the functionality of the depth sensor on the Microsoft Kinect to recognize gestures according to the American Sign Language (ASL). The project is a prototype that demonstrates the concept of learning with technology by allowing users to practice the ASL hand gestures through an educational game. The depth sensor in the Microsoft Kinect allows the project to detect and identify the hand and 5 individual fingers. The concept of gesture recognition is essential to future developments of this project and serves a basis, as this project scratches only the surface of the potential of this concept. This report details the process of development of this project, the detection of the hand and fingers, as well as the recognition of gestures.
author2 Cham Tat Jen
author_facet Cham Tat Jen
Lin, Zi Ying
format Final Year Project
author Lin, Zi Ying
author_sort Lin, Zi Ying
title Kinect-based automatic sign language recognition
title_short Kinect-based automatic sign language recognition
title_full Kinect-based automatic sign language recognition
title_fullStr Kinect-based automatic sign language recognition
title_full_unstemmed Kinect-based automatic sign language recognition
title_sort kinect-based automatic sign language recognition
publishDate 2016
url http://hdl.handle.net/10356/66915
_version_ 1759855474678693888