Using 3D deformable template trellis to describe the movement of the lip

Lip reading becomes a fascinating research area in multimedia since 1990’s. It is proven with many experiments that even small effort is made toward the incorporation of visual signal, the performance of a speech recognizer is improved compared with a purely acoustic recognizer. Such enhancement...

وصف كامل

محفوظ في:
التفاصيل البيبلوغرافية
المؤلفون الرئيسيون: Foo, Say Wei, Yong, Lian, Liang, Dong
مؤلفون آخرون: School of Electrical and Electronic Engineering
التنسيق: Conference or Workshop Item
اللغة:English
منشور في: 2009
الموضوعات:
الوصول للمادة أونلاين:https://hdl.handle.net/10356/91394
http://hdl.handle.net/10220/6037
الوسوم: إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
id sg-ntu-dr.10356-91394
record_format dspace
spelling sg-ntu-dr.10356-913942020-03-07T13:24:46Z Using 3D deformable template trellis to describe the movement of the lip Foo, Say Wei Yong, Lian Liang, Dong School of Electrical and Electronic Engineering European Workshop on Image Analysis for Multimedia Interactive Services (4th : 2003 : London) DRNTU::Engineering::Electrical and electronic engineering::Computer hardware, software and systems Lip reading becomes a fascinating research area in multimedia since 1990’s. It is proven with many experiments that even small effort is made toward the incorporation of visual signal, the performance of a speech recognizer is improved compared with a purely acoustic recognizer. Such enhancement effect is especially prominent under noisy environment such as in bus station, airport, office and stock market. As a result, lip reading holds the promise to broaden the range of applicability of speech recognition to unfavorable environments. Most previous studies focus on tracking the movement of the lip during speaking. In this paper, a novel approach for this purpose is also reported. By applying 3D templates, together with probability trellis, we show that the movement of the lip at various head positions can be properly tracked. Accepted version 2009-08-11T06:53:41Z 2019-12-06T18:04:53Z 2009-08-11T06:53:41Z 2019-12-06T18:04:53Z 2003 2003 Conference Paper Foo, S. W., Yong, L., & Liang, D. (2003). Using 3D deformable template trellis to describe the movement of the lip. Proceedings of 4th European Workshop on Image Analysis for Multimedia Interactive Services, 5(18), 445-448. https://hdl.handle.net/10356/91394 http://hdl.handle.net/10220/6037 10.1142/9789812704337_0081 en Using 3D deformable template trellis to describe the movement of the lip © copyright 2003 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE. This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder. This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder. http://www.ieee.org/portal/site. 4 p. application/pdf
institution Nanyang Technological University
building NTU Library
country Singapore
collection DR-NTU
language English
topic DRNTU::Engineering::Electrical and electronic engineering::Computer hardware, software and systems
spellingShingle DRNTU::Engineering::Electrical and electronic engineering::Computer hardware, software and systems
Foo, Say Wei
Yong, Lian
Liang, Dong
Using 3D deformable template trellis to describe the movement of the lip
description Lip reading becomes a fascinating research area in multimedia since 1990’s. It is proven with many experiments that even small effort is made toward the incorporation of visual signal, the performance of a speech recognizer is improved compared with a purely acoustic recognizer. Such enhancement effect is especially prominent under noisy environment such as in bus station, airport, office and stock market. As a result, lip reading holds the promise to broaden the range of applicability of speech recognition to unfavorable environments. Most previous studies focus on tracking the movement of the lip during speaking. In this paper, a novel approach for this purpose is also reported. By applying 3D templates, together with probability trellis, we show that the movement of the lip at various head positions can be properly tracked.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Foo, Say Wei
Yong, Lian
Liang, Dong
format Conference or Workshop Item
author Foo, Say Wei
Yong, Lian
Liang, Dong
author_sort Foo, Say Wei
title Using 3D deformable template trellis to describe the movement of the lip
title_short Using 3D deformable template trellis to describe the movement of the lip
title_full Using 3D deformable template trellis to describe the movement of the lip
title_fullStr Using 3D deformable template trellis to describe the movement of the lip
title_full_unstemmed Using 3D deformable template trellis to describe the movement of the lip
title_sort using 3d deformable template trellis to describe the movement of the lip
publishDate 2009
url https://hdl.handle.net/10356/91394
http://hdl.handle.net/10220/6037
_version_ 1681048584437366784