Comprehensive analysis of feature extraction methods for emotion recognition from multichannel EEG recordings

Advances in signal processing and machine learning have expedited electroencephalogram (EEG)-based emotion recognition research, and numerous EEG signal features have been investigated to detect or characterize human emotions. However, most studies in this area have used relatively small monocentric...

Full description

Saved in:
Bibliographic Details
Main Authors: Yuvaraj, Rajamanickam, Thagavel, Prasanth, Thomas, John, Fogarty, Jack, Ali, Farhan
Other Authors: Interdisciplinary Graduate School (IGS)
Format: Article
Language:English
Published: 2023
Subjects:
EEG
Online Access:https://hdl.handle.net/10356/169462
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-169462
record_format dspace
spelling sg-ntu-dr.10356-1694622023-07-23T15:36:36Z Comprehensive analysis of feature extraction methods for emotion recognition from multichannel EEG recordings Yuvaraj, Rajamanickam Thagavel, Prasanth Thomas, John Fogarty, Jack Ali, Farhan Interdisciplinary Graduate School (IGS) National Institute of Education Science::Medicine EEG Emotion Recognition Advances in signal processing and machine learning have expedited electroencephalogram (EEG)-based emotion recognition research, and numerous EEG signal features have been investigated to detect or characterize human emotions. However, most studies in this area have used relatively small monocentric data and focused on a limited range of EEG features, making it difficult to compare the utility of different sets of EEG features for emotion recognition. This study addressed that by comparing the classification accuracy (performance) of a comprehensive range of EEG feature sets for identifying emotional states, in terms of valence and arousal. The classification accuracy of five EEG feature sets were investigated, including statistical features, fractal dimension (FD), Hjorth parameters, higher order spectra (HOS), and those derived using wavelet analysis. Performance was evaluated using two classifier methods, support vector machine (SVM) and classification and regression tree (CART), across five independent and publicly available datasets linking EEG to emotional states: MAHNOB-HCI, DEAP, SEED, AMIGOS, and DREAMER. The FD-CART feature-classification method attained the best mean classification accuracy for valence (85.06%) and arousal (84.55%) across the five datasets. The stability of these findings across the five different datasets also indicate that FD features derived from EEG data are reliable for emotion recognition. The results may lead to the possible development of an online feature extraction framework, thereby enabling the development of an EEG-based emotion recognition system in real time. Ministry of Education (MOE) Published version This research was financed by the Singapore Ministry of Education (MOE) through the Education Research Funding Programme (ERFP) (Grant No: PG 03/21 YR), which was overseen by the National Institute of Education (NIE), Nanyang Technological University (NTU), Singapore. 2023-07-19T06:09:31Z 2023-07-19T06:09:31Z 2023 Journal Article Yuvaraj, R., Thagavel, P., Thomas, J., Fogarty, J. & Ali, F. (2023). Comprehensive analysis of feature extraction methods for emotion recognition from multichannel EEG recordings. Sensors, 23(2), 915-. https://dx.doi.org/10.3390/s23020915 1424-8220 https://hdl.handle.net/10356/169462 10.3390/s23020915 36679710 2-s2.0-85146702421 2 23 915 en PG 03/21 YR Sensors © 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https:// creativecommons.org/licenses/by/ 4.0/). application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Science::Medicine
EEG
Emotion Recognition
spellingShingle Science::Medicine
EEG
Emotion Recognition
Yuvaraj, Rajamanickam
Thagavel, Prasanth
Thomas, John
Fogarty, Jack
Ali, Farhan
Comprehensive analysis of feature extraction methods for emotion recognition from multichannel EEG recordings
description Advances in signal processing and machine learning have expedited electroencephalogram (EEG)-based emotion recognition research, and numerous EEG signal features have been investigated to detect or characterize human emotions. However, most studies in this area have used relatively small monocentric data and focused on a limited range of EEG features, making it difficult to compare the utility of different sets of EEG features for emotion recognition. This study addressed that by comparing the classification accuracy (performance) of a comprehensive range of EEG feature sets for identifying emotional states, in terms of valence and arousal. The classification accuracy of five EEG feature sets were investigated, including statistical features, fractal dimension (FD), Hjorth parameters, higher order spectra (HOS), and those derived using wavelet analysis. Performance was evaluated using two classifier methods, support vector machine (SVM) and classification and regression tree (CART), across five independent and publicly available datasets linking EEG to emotional states: MAHNOB-HCI, DEAP, SEED, AMIGOS, and DREAMER. The FD-CART feature-classification method attained the best mean classification accuracy for valence (85.06%) and arousal (84.55%) across the five datasets. The stability of these findings across the five different datasets also indicate that FD features derived from EEG data are reliable for emotion recognition. The results may lead to the possible development of an online feature extraction framework, thereby enabling the development of an EEG-based emotion recognition system in real time.
author2 Interdisciplinary Graduate School (IGS)
author_facet Interdisciplinary Graduate School (IGS)
Yuvaraj, Rajamanickam
Thagavel, Prasanth
Thomas, John
Fogarty, Jack
Ali, Farhan
format Article
author Yuvaraj, Rajamanickam
Thagavel, Prasanth
Thomas, John
Fogarty, Jack
Ali, Farhan
author_sort Yuvaraj, Rajamanickam
title Comprehensive analysis of feature extraction methods for emotion recognition from multichannel EEG recordings
title_short Comprehensive analysis of feature extraction methods for emotion recognition from multichannel EEG recordings
title_full Comprehensive analysis of feature extraction methods for emotion recognition from multichannel EEG recordings
title_fullStr Comprehensive analysis of feature extraction methods for emotion recognition from multichannel EEG recordings
title_full_unstemmed Comprehensive analysis of feature extraction methods for emotion recognition from multichannel EEG recordings
title_sort comprehensive analysis of feature extraction methods for emotion recognition from multichannel eeg recordings
publishDate 2023
url https://hdl.handle.net/10356/169462
_version_ 1773551387862368256