Towards the development of affective recognition using heart sound signal: a proposal

• Main Authors: Suryady, Zeldi, Abdul Rahman, Abdul Wahab, Handayani, Dini Oktarina Dwi
• Format: Proceeding Paper
• Language: English; English
• Published: IEEE 2022
• Subjects: QA76 Computer software
• Online Access: http://irep.iium.edu.my/103437/1/103437_Towards%20the%20development%20of%20affective%20recognition.pdf; http://irep.iium.edu.my/103437/7/103437_Towards%20the%20Development%20of%20Affective%20Recognition%20Using%20Heart%20Sound%20Signal_%20A%20Proposal%20_%20SCOPUS.pdf; http://irep.iium.edu.my/103437/; https://ieeexplore.ieee.org/document/10010662
• Institution: Universiti Islam Antarabangsa Malaysia

In recent years, the development of physiologicalbased human emotion is centred around the use of Electroencephalogram (EEG) as the main modality. However, heart sound signal (also referred to as Phonocardiography) offers unique and reliable advantages to infer emotions. As one of the physiological parameters, heart signals may infer emotions and can be used for emotion recognition. In addition, the use of heart sound signals for emotion recognition is substantially cheaper, and the process of acquiring the signal for heart sound analysis is comfortable as compared to other physiological measures. Nevertheless, the use of Phonocardiography (PCG) in the emotion recognition domain is still scarce in the research literature. Therefore, this work conducts a review on affective computing in general and discusses how emotions are described and the common procedure used to elicit emotion. We also highlight how far the PCG has been used in the domain of affective computing. Finally, we propose the framework and methodology to develop human emotion recognition using heart sound signals.