Extreme learning machines based human hand sign language recognition

In the field of Human Machine Interaction, with the development of 3D cameras and computer vision, recognition of human hand gestures and motions has become a real trending topic and is gaining greater significance in Natural User Interface (NUI). By detecting, tracking and recognizing hand gestures...

Full description

Saved in:
Bibliographic Details
Main Author: Cai, Xiao
Other Authors: Huang Guangbin
Format: Final Year Project
Language:English
Published: 2015
Subjects:
Online Access:http://hdl.handle.net/10356/63820
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-63820
record_format dspace
spelling sg-ntu-dr.10356-638202023-07-07T15:46:58Z Extreme learning machines based human hand sign language recognition Cai, Xiao Huang Guangbin School of Electrical and Electronic Engineering DRNTU::Engineering::Electrical and electronic engineering::Control and instrumentation::Control engineering In the field of Human Machine Interaction, with the development of 3D cameras and computer vision, recognition of human hand gestures and motions has become a real trending topic and is gaining greater significance in Natural User Interface (NUI). By detecting, tracking and recognizing hand gestures and motions, together with the development of graphical user interfaces, the use of traditional input devices such as key boards and mouse could be reduced. However, challenges have been faced as the accuracy and speed of real-time gesture recognition are seen as one of the bottlenecks with the current development. The final year project, Extreme Learning Machines based Human Hand Sign Language Recognition, is hence proposed with the aim of investigating real-time recognition of three broad classifications of gestures – static, dynamic, and motion detection with respective applications. Previous studies and available algorithms are examined to define the gap between the performance of Extreme Learning Machines proposed by Prof. Huang and other kernel methods. Suitable development platform, techniques for feature extraction and refinement, application of ELM methods are selected for the research. The desktop, game, and PowerPoint slides control application is developed based on 3Gear Nimble hand tracking library. Three applications for static gesture recognition, namely simultaneous detection of both hands, music player triggering application, and rock paper scissors game application, are presented. The dynamic gesture recognition is to combine both training and normal operation together for four main gestures. Windows default music player could also be triggered by making use of two of the dynamic gestures. The motion detection part of this project achieves recognition of writing number from 0 to 9 based on a countdown system, however, receiving not very nice performance. Performance of these three broad ranges of gesture recognition applications is evaluated compare with support vector machines. Recommendations for future work regarding the project is provided, in terms of achieving real-time recognition and performance improvement. Bachelor of Engineering 2015-05-19T05:46:19Z 2015-05-19T05:46:19Z 2015 2015 Final Year Project (FYP) http://hdl.handle.net/10356/63820 en Nanyang Technological University 98 p. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic DRNTU::Engineering::Electrical and electronic engineering::Control and instrumentation::Control engineering
spellingShingle DRNTU::Engineering::Electrical and electronic engineering::Control and instrumentation::Control engineering
Cai, Xiao
Extreme learning machines based human hand sign language recognition
description In the field of Human Machine Interaction, with the development of 3D cameras and computer vision, recognition of human hand gestures and motions has become a real trending topic and is gaining greater significance in Natural User Interface (NUI). By detecting, tracking and recognizing hand gestures and motions, together with the development of graphical user interfaces, the use of traditional input devices such as key boards and mouse could be reduced. However, challenges have been faced as the accuracy and speed of real-time gesture recognition are seen as one of the bottlenecks with the current development. The final year project, Extreme Learning Machines based Human Hand Sign Language Recognition, is hence proposed with the aim of investigating real-time recognition of three broad classifications of gestures – static, dynamic, and motion detection with respective applications. Previous studies and available algorithms are examined to define the gap between the performance of Extreme Learning Machines proposed by Prof. Huang and other kernel methods. Suitable development platform, techniques for feature extraction and refinement, application of ELM methods are selected for the research. The desktop, game, and PowerPoint slides control application is developed based on 3Gear Nimble hand tracking library. Three applications for static gesture recognition, namely simultaneous detection of both hands, music player triggering application, and rock paper scissors game application, are presented. The dynamic gesture recognition is to combine both training and normal operation together for four main gestures. Windows default music player could also be triggered by making use of two of the dynamic gestures. The motion detection part of this project achieves recognition of writing number from 0 to 9 based on a countdown system, however, receiving not very nice performance. Performance of these three broad ranges of gesture recognition applications is evaluated compare with support vector machines. Recommendations for future work regarding the project is provided, in terms of achieving real-time recognition and performance improvement.
author2 Huang Guangbin
author_facet Huang Guangbin
Cai, Xiao
format Final Year Project
author Cai, Xiao
author_sort Cai, Xiao
title Extreme learning machines based human hand sign language recognition
title_short Extreme learning machines based human hand sign language recognition
title_full Extreme learning machines based human hand sign language recognition
title_fullStr Extreme learning machines based human hand sign language recognition
title_full_unstemmed Extreme learning machines based human hand sign language recognition
title_sort extreme learning machines based human hand sign language recognition
publishDate 2015
url http://hdl.handle.net/10356/63820
_version_ 1772825737820110848