Hand sign language translator in human computer interaction

• Main Author: Yang, Da Rui
• Other Authors: Yap Kim Hui
• Format: Final Year Project
• Language: English
• Published: 2014
• Subjects: DRNTU::Engineering::Computer science and engineering
• Online Access: http://hdl.handle.net/10356/61244
• Institution: Nanyang Technological University

As a normal people live in this world, we can’t imagine what life is like if we can’t communicate with each other by speaking. But there are about 70 million deaf people and many hearing-impaired people [1] who live in the world with us together, so sign language will be their first language and mother tongue which is can share the same linguistic roots in the same way as spoken languages do. In order to understand and feel these people’s world, we need some medium to help both the hearing-impaired people and normal people. To achieve above purpose, my project is to develop a human computer interaction system which is hand sign language translator to help hearing-impaired people and normal people to learn ASL (American Sign Language) though computer-based software. The original software, “Let’s talk”, had been completed by previous student in April 2011. But there are still some rooms to improve and create more useful application base on the original software. My work here are further expanded the animated 3D model database by Poser Pro 2014 which is latest version 3D rendering and animation creation tool developed by Smith Micro Software. In addition to this, some useful functions had been created such as “Video simulation”, “E-book reading” and “Kids song” etc. Visual Basic 6.0 (VB6) has been used as software platform for my project which can help me to integrate previous student’s job and save me a lot of time to put effort on others. “E-booking reading” has been added into software’s main page as improvement. “Child’s play” module had been added other 2 applications to help young child and their parents to learn ASL with more fun. After enhance and improve the project, the new version “Let’s Talk” can help to fill the gap between hearing-impaired people and normal people better and become a more useful tool to educate hearing-impaired children and their parents.