A lip geometry approach for feature-fusion based audio-visual speech recognition

• Main Authors: M. Z., Ibrahim, Mulvaney, D. J.
• Format: Conference or Workshop Item
• Language: English; English
• Published: IEEE 2014
• Subjects: TK Electrical engineering. Electronics Nuclear engineering
• Online Access: http://umpir.ump.edu.my/id/eprint/29900/1/A%20lip%20geometry%20approach%20for%20feature-fusion%20based%20audio.pdf; http://umpir.ump.edu.my/id/eprint/29900/2/A%20lip%20geometry%20approach%20for%20feature-fusion%20based%20audio_FULL.pdf; http://umpir.ump.edu.my/id/eprint/29900/; https://doi.org/10.1109/ISCCSP.2014.6877957
• Institution: Universiti Malaysia Pahang

This paper describes a feature-fusion audio-visual speech recognition (AVSR) system that extracts lip geometry from the mouth region using a combination of skin color filter, border following and convex hull, and classification using a Hidden Markov Model. By defining a small number of highly descri...