Using 3D deformable template trellis to describe the movement of the lip

Lip reading becomes a fascinating research area in multimedia since 1990’s. It is proven with many experiments that even small effort is made toward the incorporation of visual signal, the performance of a speech recognizer is improved compared with a purely acoustic recognizer. Such enhancement...

Full description

Saved in:

Bibliographic Details
Main Authors:	Foo, Say Wei, Yong, Lian, Liang, Dong
Other Authors:	School of Electrical and Electronic Engineering
Format:	Conference or Workshop Item
Language:	English
Published:	2009
Subjects:	DRNTU::Engineering::Electrical and electronic engineering::Computer hardware, software and systems
Online Access:	https://hdl.handle.net/10356/91394 http://hdl.handle.net/10220/6037
Tags:	Add Tag No Tags, Be the first to tag this record!
Institution:	Nanyang Technological University
Language:	English

id	sg-ntu-dr.10356-91394
record_format	dspace
spelling	sg-ntu-dr.10356-913942020-03-07T13:24:46Z Using 3D deformable template trellis to describe the movement of the lip Foo, Say Wei Yong, Lian Liang, Dong School of Electrical and Electronic Engineering European Workshop on Image Analysis for Multimedia Interactive Services (4th : 2003 : London) DRNTU::Engineering::Electrical and electronic engineering::Computer hardware, software and systems Lip reading becomes a fascinating research area in multimedia since 1990’s. It is proven with many experiments that even small effort is made toward the incorporation of visual signal, the performance of a speech recognizer is improved compared with a purely acoustic recognizer. Such enhancement effect is especially prominent under noisy environment such as in bus station, airport, office and stock market. As a result, lip reading holds the promise to broaden the range of applicability of speech recognition to unfavorable environments. Most previous studies focus on tracking the movement of the lip during speaking. In this paper, a novel approach for this purpose is also reported. By applying 3D templates, together with probability trellis, we show that the movement of the lip at various head positions can be properly tracked. Accepted version 2009-08-11T06:53:41Z 2019-12-06T18:04:53Z 2009-08-11T06:53:41Z 2019-12-06T18:04:53Z 2003 2003 Conference Paper Foo, S. W., Yong, L., & Liang, D. (2003). Using 3D deformable template trellis to describe the movement of the lip. Proceedings of 4th European Workshop on Image Analysis for Multimedia Interactive Services, 5(18), 445-448. https://hdl.handle.net/10356/91394 http://hdl.handle.net/10220/6037 10.1142/9789812704337_0081 en Using 3D deformable template trellis to describe the movement of the lip © copyright 2003 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE. This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder. This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder. http://www.ieee.org/portal/site. 4 p. application/pdf
institution	Nanyang Technological University
building	NTU Library
country	Singapore
collection	DR-NTU
language	English
topic	DRNTU::Engineering::Electrical and electronic engineering::Computer hardware, software and systems
spellingShingle	DRNTU::Engineering::Electrical and electronic engineering::Computer hardware, software and systems Foo, Say Wei Yong, Lian Liang, Dong Using 3D deformable template trellis to describe the movement of the lip
description	Lip reading becomes a fascinating research area in multimedia since 1990’s. It is proven with many experiments that even small effort is made toward the incorporation of visual signal, the performance of a speech recognizer is improved compared with a purely acoustic recognizer. Such enhancement effect is especially prominent under noisy environment such as in bus station, airport, office and stock market. As a result, lip reading holds the promise to broaden the range of applicability of speech recognition to unfavorable environments. Most previous studies focus on tracking the movement of the lip during speaking. In this paper, a novel approach for this purpose is also reported. By applying 3D templates, together with probability trellis, we show that the movement of the lip at various head positions can be properly tracked.
author2	School of Electrical and Electronic Engineering
author_facet	School of Electrical and Electronic Engineering Foo, Say Wei Yong, Lian Liang, Dong
format	Conference or Workshop Item
author	Foo, Say Wei Yong, Lian Liang, Dong
author_sort	Foo, Say Wei
title	Using 3D deformable template trellis to describe the movement of the lip
title_short	Using 3D deformable template trellis to describe the movement of the lip
title_full	Using 3D deformable template trellis to describe the movement of the lip
title_fullStr	Using 3D deformable template trellis to describe the movement of the lip
title_full_unstemmed	Using 3D deformable template trellis to describe the movement of the lip
title_sort	using 3d deformable template trellis to describe the movement of the lip
publishDate	2009
url	https://hdl.handle.net/10356/91394 http://hdl.handle.net/10220/6037
_version_	1681048584437366784

Using 3D deformable template trellis to describe the movement of the lip

Similar Items