Face Detection and Recognition of the Seven Emotions via Facial Expression: Integration of Machine Learning Algorithm into the NAO Robot

• Main Authors: Reyes, Rosula SJ, Depano, Keanu M, Velasco, Aaron Matthew A, Kwong, John Chris T, Oppus, Carlos
• Format: text
• Published: Archīum Ateneo 2020
• Subjects: NAO; NAOqi; Choregraphe Suite; Human-Robot Interaction; Support Vector Machine; Histogram of Oriented Gradien; Local Binary Pattern; Emotion Recognition via Facial Expression; Electrical and Computer Engineering
• Online Access: https://archium.ateneo.edu/ecce-faculty-pubs/41; https://ieeexplore.ieee.org/abstract/document/9096267?casa_token=WZ7yTvBSMgAAAAAA:Cg72fn5OwTm1O5t5c-dKT8hh_c_wP68taim3DuSHKYpg3gADsF07lLOi5xqfyz2Z4ZyEHljMw9E
• Institution: Ateneo De Manila University

This study revolves around NAO, a programmable and interactive robot, to do Emotion Recognition via Facial Expression, and to give an appropriate response for the identified emotion whilst accumulating images to further enhance the accuracy. To develop this cohesive system, the authors utilized Computer Vision and Haar-Cascade Classifier along with the feature descriptors, Histogram of Oriented Gradient and Local Binary Pattern to train the Support Vector Machine Learning Algorithm. Gathering and increasing data with Asian/Filipino participants whilst being added to the CK+ database in different stages of retraining, optimization, and undertaking cross-fold validation yielded improved results with the highest average accuracy across the seven emotions of 87.14%. Suggesting that adding images with a specific ethnicity yields a higher accuracy model for a more diverse testing dataset and in the wild image classifications. With the machine learning model capable of accurately recognizing the emotion and reinforcing it with the accumulated local images, NAO equipped with emotion recognition capabilities can better aid and support the individuals in need.