A real-time automatic translation of text to sign language

• Main Authors: Sanaullah, M., Ahmad, B., Kashif, M., Safdar, T., Hassan, M., Hasan, M.H., Aziz, N.
• Format: Article
• Published: Tech Science Press 2022
• Online Access: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85115998361&doi=10.32604%2fcmc.2022.019420&partnerID=40&md5=de853614032d1691b25f27c93e331654; http://eprints.utp.edu.my/28896/
• Institution: Universiti Teknologi Petronas

Communication is a basic need of every human being; by this, they can learn, express their feelings and exchange their ideas, but deaf people cannot listen and speak. For communication, they use various hands gestures, also known as Sign Language (SL), which they learn from special schools. As normal people have not taken SL classes; therefore, they are unable to perform signs of daily routine sentences (e.g., what are the specifications of this mobile phone?). A technological solution can facilitate in overcoming this communication gap by which normal people can communicate with deaf people. This paper presents an architecture for an application named Sign4PSL that translates the sentences to Pakistan Sign Language (PSL) for deaf people with visual representation using virtual signing character. This research aims to develop a generic independent application that is lightweight and reusable on any platform, including web and mobile, with an ability to perform offline text translation. The Sign4PSL relies on a knowledge base that stores both corpus of PSL Words and their coded form in the notation system. Sign4PSL takes English language text as an input, performs the translation to PSL through sign language notation and displays gestures to the user using virtual character. The system is tested on deaf students at a special school. The results have shown that the students were able to understand the story presented to them appropriately. © 2022 Tech Science Press. All rights reserved.