A Deep Residual-based Model on Multi-Branch Aggregation for Stress and Emotion Recognition through Biosignals
Stress and emotion recognition (SER) is a rapidly growing field of study that has applications in various areas, including psychological wellbeing, rehabilitative services, athletic training, and human-computer interaction. Biological information such as the electrocardiogram (ECG), electromyography...
Saved in:
Main Authors: | , , |
---|---|
Other Authors: | |
Format: | Conference or Workshop Item |
Published: |
2022
|
Subjects: | |
Online Access: | https://repository.li.mahidol.ac.th/handle/123456789/73756 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Mahidol University |
Summary: | Stress and emotion recognition (SER) is a rapidly growing field of study that has applications in various areas, including psychological wellbeing, rehabilitative services, athletic training, and human-computer interaction. Biological information such as the electrocardiogram (ECG), electromyography (EMG), and electrodermal activity (EDA) has been frequently utilized for the SER for learning-based approaches. This study introduces a convolutional neural network motivated by ResNeXt to facilitate multimodal awareness. The proposed model, named StressNeXt, can extract high-level insights from raw bio-signal signals and classify emotional expressions effectively. We undertake a series of investigations using a publicly released standard dataset (WESAD) to determine the optimal implementation of the proposed solution for recognizing stress and emotion. After incorporating preliminary fusion events, we examined deep learning models using 5-fold cross-validation. Our study demonstrates that the suggested technique can comprehend robust multimodal representations with an accuracy of 87.73% utilizing EDA. Additionally, the identification was designed to provide better to 99.92% by fusing with accelerometer sensor data. |
---|