Music changing system based on emotion from facial expression

• Main Author: Wong, Ryan Jing Heng
• Other Authors: Owen Noel Newton Fernando
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2023
• Subjects: Engineering::Computer science and engineering::Computer systems organization::Special-purpose and application-based systems; Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision; Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
• Online Access: https://hdl.handle.net/10356/171986
• Institution: Nanyang Technological University

Facial expression analysis is essential in providing information such as deduced emotions like happiness and sadness. A study conducted by Albert Mehrabian, a researcher of body language found out that communication is 55 percent is by facial expressions, 38 percent vocal and 7 percent by words [1]. Facial expression can be collected and analysed in various ways such as by tracking facial electromyographic activity (fEMG) and using computer-vision algorithms. The Facial Action Coding System (FACS) is an extensive anatomical framework designed to depict all observable facial motions. It permits the modular formulation of emotions by utilizing combinations of Action Units, which are distinct elements of muscle movement. These units are employed to interpret shifts in emotions by means of facial expressions [2]. As a large amount of information comes from our faces, in this project, I proposed using facial expression analysis to further enhance modern music systems and elevate users’ experience.