Development of video-based emotion recognition system using transfer learning

• Main Authors: Gunawan, Teddy Surya, Muktaruddin, Muhammad Nuruddin, Kartiwi, Mira, Ahmad, Yasser Asrul, Rosahdi, Tina Dewi, Ulfiah, Ulfiah
• Format: Conference or Workshop Item
• Language: English; English
• Published: IEEE 2022
• Subjects: TK7885 Computer engineering
• Online Access: http://irep.iium.edu.my/101865/7/101865_Development%20of%20Video-based%20Emotion%20Recognition%20System%20using%20Transfer%20Learning.pdf; http://irep.iium.edu.my/101865/13/101865_Development%20of%20Video-Based%20Emotion%20Recognition%20System%20using%20Transfer%20Learning_Scopus.pdf; http://irep.iium.edu.my/101865/; https://icsima.ieeemy-ims.org/22/program-schedule/; https://doi.org/10.1109/ICSIMA55652.2022.9928867
• Institution: Universiti Islam Antarabangsa Malaysia

Due to the complexity of its system and the numerous advantages of its implementation, video emotion identification is a popular area of study today. There have been multiple ways implemented. In this project, emotion recognition in videos will be performed using deep learning. The model will include initialization, feature extraction, emotion categorization, and prediction. LeNet and AlexNet, two distinct neural networks, are used to extract features and classify emotions. There will be some parameter tuning to determine if it enhances the employed architecture’s performance, including optimizers and batch size. Each architecture for deep learning will generate a final forecast of four fundamental emotions: disgust, happiness, sadness, and surprise. AlexNet’s performance is enhanced by the SGD optimizer, whereas RMSprop improves LeNet’s performance. Results showed that AlexNet with SGD optimizer provides 93.00% recognition accuracy.