Real-time facial emotion recognition with LSTM-CNN

In the digital age of communication, video as a means of communication becomes increasingly common. In video interviews or video-based user research, the ability to recognize emotions presents valuable insights to the subject’s emotional state. While deep learning methods have been shown to perform...

全面介紹

Saved in:
書目詳細資料
主要作者: Lim, Varick Sheng Rui
其他作者: Tan Yap Peng
格式: Final Year Project
語言:English
出版: 2019
主題:
在線閱讀:http://hdl.handle.net/10356/77388
標簽: 添加標簽
沒有標簽, 成為第一個標記此記錄!
實物特徵
總結:In the digital age of communication, video as a means of communication becomes increasingly common. In video interviews or video-based user research, the ability to recognize emotions presents valuable insights to the subject’s emotional state. While deep learning methods have been shown to perform well in the area of Facial Emotion Recognition (FER), most of these conventional methods are limited to still images and do not use temporal features across consecutive video frames. In this project, a real-time facial emotional recognition system is developed using a hybrid deep learning network. This approach uses a Convolutional Neural Network (CNN) for spatial feature extraction and a Long Short-Term Memory (LSTM) network for temporal features of consecutive frames. The subject’s emotions are predicted and displayed in real-time through a graphical display.