Accuracy Performance and Potentiality of Real-Time Avatar Lip Sync Animation in Different Languages

With the fast growth in computing power nowadays, the qualities of animation enable an extra layer of visually con-vincing realism. In lip sync animation, creation of realistic lip movement is arduous in getting the lip shape and position to syn-chronize with the speech sounds....

Full description

Saved in:
Bibliographic Details
Main Authors: Loh, Ngiik Hoon, Siti Shukhaila, Shaharuddin
Format: Article
Language:English
Published: Blue Eyes Intelligence Engineering & Sciences Publication 2019
Subjects:
Online Access:http://ir.unimas.my/id/eprint/24719/1/Loh%2C%20Ngiik%20Hoon.pdf
http://ir.unimas.my/id/eprint/24719/
http://www.ijrte.org
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Universiti Malaysia Sarawak
Language: English
id my.unimas.ir.24719
record_format eprints
spelling my.unimas.ir.247192023-11-21T03:06:08Z http://ir.unimas.my/id/eprint/24719/ Accuracy Performance and Potentiality of Real-Time Avatar Lip Sync Animation in Different Languages Loh, Ngiik Hoon Siti Shukhaila, Shaharuddin L Education (General) T Technology (General) With the fast growth in computing power nowadays, the qualities of animation enable an extra layer of visually con-vincing realism. In lip sync animation, creation of realistic lip movement is arduous in getting the lip shape and position to syn-chronize with the speech sounds.To note, spendinghours in manually generating every single lip movement can be a long and challengingtask.Consequently,acomprehensive analysis on viseme based multiple phonemes in English, Bahasa Melayu and Mandarin was carried out, to develop anaccurate and potential platform forrealtime talkingavatar inmultiple languages.The accuracy performancebetween human and avatar in real timewere compared and evaluated. The findings revealed successfulutilization of real time synchronization to drive the synthetic 3D avatars based on live speechinputfor multiple languages, with satisfiedaccurate lip motion result.This paper provides useful knowledge for multilingual solution which accurately predicts mouth movement on real human face, when a person is speaking and directs to lip sync process. Itcontributesto live performances and valuable inopen-ended fieldwith tons of potential, such as animation productionindustry, entertainment, gaming, digital marketingand media education. Blue Eyes Intelligence Engineering & Sciences Publication 2019-04 Article PeerReviewed text en http://ir.unimas.my/id/eprint/24719/1/Loh%2C%20Ngiik%20Hoon.pdf Loh, Ngiik Hoon and Siti Shukhaila, Shaharuddin (2019) Accuracy Performance and Potentiality of Real-Time Avatar Lip Sync Animation in Different Languages. International Journal of Recent Technology and Engineering, 7 (6S2). pp. 57-66. ISSN 2277-3878 http://www.ijrte.org
institution Universiti Malaysia Sarawak
building Centre for Academic Information Services (CAIS)
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Malaysia Sarawak
content_source UNIMAS Institutional Repository
url_provider http://ir.unimas.my/
language English
topic L Education (General)
T Technology (General)
spellingShingle L Education (General)
T Technology (General)
Loh, Ngiik Hoon
Siti Shukhaila, Shaharuddin
Accuracy Performance and Potentiality of Real-Time Avatar Lip Sync Animation in Different Languages
description With the fast growth in computing power nowadays, the qualities of animation enable an extra layer of visually con-vincing realism. In lip sync animation, creation of realistic lip movement is arduous in getting the lip shape and position to syn-chronize with the speech sounds.To note, spendinghours in manually generating every single lip movement can be a long and challengingtask.Consequently,acomprehensive analysis on viseme based multiple phonemes in English, Bahasa Melayu and Mandarin was carried out, to develop anaccurate and potential platform forrealtime talkingavatar inmultiple languages.The accuracy performancebetween human and avatar in real timewere compared and evaluated. The findings revealed successfulutilization of real time synchronization to drive the synthetic 3D avatars based on live speechinputfor multiple languages, with satisfiedaccurate lip motion result.This paper provides useful knowledge for multilingual solution which accurately predicts mouth movement on real human face, when a person is speaking and directs to lip sync process. Itcontributesto live performances and valuable inopen-ended fieldwith tons of potential, such as animation productionindustry, entertainment, gaming, digital marketingand media education.
format Article
author Loh, Ngiik Hoon
Siti Shukhaila, Shaharuddin
author_facet Loh, Ngiik Hoon
Siti Shukhaila, Shaharuddin
author_sort Loh, Ngiik Hoon
title Accuracy Performance and Potentiality of Real-Time Avatar Lip Sync Animation in Different Languages
title_short Accuracy Performance and Potentiality of Real-Time Avatar Lip Sync Animation in Different Languages
title_full Accuracy Performance and Potentiality of Real-Time Avatar Lip Sync Animation in Different Languages
title_fullStr Accuracy Performance and Potentiality of Real-Time Avatar Lip Sync Animation in Different Languages
title_full_unstemmed Accuracy Performance and Potentiality of Real-Time Avatar Lip Sync Animation in Different Languages
title_sort accuracy performance and potentiality of real-time avatar lip sync animation in different languages
publisher Blue Eyes Intelligence Engineering & Sciences Publication
publishDate 2019
url http://ir.unimas.my/id/eprint/24719/1/Loh%2C%20Ngiik%20Hoon.pdf
http://ir.unimas.my/id/eprint/24719/
http://www.ijrte.org
_version_ 1783883506669060096