Compact Convolutional neural network (CNN) based on SincNet for end-to-end motor imagery decoding and analysis

In the field of human-computer interaction, the detection, extraction and classification of the electroencephalogram (EEG) spectral and spatial features are crucial towards developing a practical and robust non-invasive EEG-based brain-computer interface. Recently, due to the popularity of end-to-en...

Full description

Saved in:
Bibliographic Details
Main Authors: Ahmad Izzuddin, Tarmizi, Mat Safri, Norlaili, Othman, Mohd Afzan
Format: Article
Language:English
Published: Elsevier B.V. 2021
Online Access:http://eprints.utem.edu.my/id/eprint/25811/2/1-S2.0-S0208521621001200-MAIN.PDF
http://eprints.utem.edu.my/id/eprint/25811/
https://reader.elsevier.com/reader/sd/pii/S0208521621001200?token=A30143A7C366A5F537B16EAE993E2AC50295AE6028BD6DB1DBD7B0E9F406D619D54E273687490FFDE1D810B8D2F389A5&originRegion=eu-west-1&originCreation=20220310074616
https://doi.org/10.1016/j.bbe.2021.10.001
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Universiti Teknikal Malaysia Melaka
Language: English
id my.utem.eprints.25811
record_format eprints
spelling my.utem.eprints.258112022-04-11T12:05:12Z http://eprints.utem.edu.my/id/eprint/25811/ Compact Convolutional neural network (CNN) based on SincNet for end-to-end motor imagery decoding and analysis Ahmad Izzuddin, Tarmizi Mat Safri, Norlaili Othman, Mohd Afzan In the field of human-computer interaction, the detection, extraction and classification of the electroencephalogram (EEG) spectral and spatial features are crucial towards developing a practical and robust non-invasive EEG-based brain-computer interface. Recently, due to the popularity of end-to-end deep learning, the applicability of algorithms such as convolutional neural networks (CNN) has been explored to achieve the mentioned tasks. This paper presents an improved and compact CNN algorithm for motor imagery decoding based on the adaptation of SincNet, which was initially developed for speaker recognition task from the raw audio input. Such adaptation allows for a compact end-to-end neural network with state-of-the-art (SOTA) performances and enables network interpretability for neurophysiological validation in cortical rhythms and spatial analysis. In order to validate the performance of proposed algorithms, two datasets were used; the first is the publicly available BCI Competition IV dataset 2a, which was often used as a benchmark in validating motor imagery classification algorithms, and the second is a dataset consists of primary data initially collected to study the difference between motor imagery and mental-task associated motor imagery BCI and was used to test the plausibility of the proposed algorithm in highlighting the differences in terms of cortical rhythms. Competitive decoding performance was achieved in both datasets in comparisons with SOTA CNN models, albeit with the lowest number of trainable parameters. In addition, it was shown that the proposed architecture performs a cleaner band-pass, highlighting the necessary frequency bands that were crucial and neurophysiologically plausible in solving the classification tasks. Elsevier B.V. 2021-10 Article PeerReviewed text en http://eprints.utem.edu.my/id/eprint/25811/2/1-S2.0-S0208521621001200-MAIN.PDF Ahmad Izzuddin, Tarmizi and Mat Safri, Norlaili and Othman, Mohd Afzan (2021) Compact Convolutional neural network (CNN) based on SincNet for end-to-end motor imagery decoding and analysis. Biocybernetics And Biomedical Engineering, 41 (4). pp. 1629-1645. ISSN 0208-5216 https://reader.elsevier.com/reader/sd/pii/S0208521621001200?token=A30143A7C366A5F537B16EAE993E2AC50295AE6028BD6DB1DBD7B0E9F406D619D54E273687490FFDE1D810B8D2F389A5&originRegion=eu-west-1&originCreation=20220310074616 https://doi.org/10.1016/j.bbe.2021.10.001
institution Universiti Teknikal Malaysia Melaka
building UTEM Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Teknikal Malaysia Melaka
content_source UTEM Institutional Repository
url_provider http://eprints.utem.edu.my/
language English
description In the field of human-computer interaction, the detection, extraction and classification of the electroencephalogram (EEG) spectral and spatial features are crucial towards developing a practical and robust non-invasive EEG-based brain-computer interface. Recently, due to the popularity of end-to-end deep learning, the applicability of algorithms such as convolutional neural networks (CNN) has been explored to achieve the mentioned tasks. This paper presents an improved and compact CNN algorithm for motor imagery decoding based on the adaptation of SincNet, which was initially developed for speaker recognition task from the raw audio input. Such adaptation allows for a compact end-to-end neural network with state-of-the-art (SOTA) performances and enables network interpretability for neurophysiological validation in cortical rhythms and spatial analysis. In order to validate the performance of proposed algorithms, two datasets were used; the first is the publicly available BCI Competition IV dataset 2a, which was often used as a benchmark in validating motor imagery classification algorithms, and the second is a dataset consists of primary data initially collected to study the difference between motor imagery and mental-task associated motor imagery BCI and was used to test the plausibility of the proposed algorithm in highlighting the differences in terms of cortical rhythms. Competitive decoding performance was achieved in both datasets in comparisons with SOTA CNN models, albeit with the lowest number of trainable parameters. In addition, it was shown that the proposed architecture performs a cleaner band-pass, highlighting the necessary frequency bands that were crucial and neurophysiologically plausible in solving the classification tasks.
format Article
author Ahmad Izzuddin, Tarmizi
Mat Safri, Norlaili
Othman, Mohd Afzan
spellingShingle Ahmad Izzuddin, Tarmizi
Mat Safri, Norlaili
Othman, Mohd Afzan
Compact Convolutional neural network (CNN) based on SincNet for end-to-end motor imagery decoding and analysis
author_facet Ahmad Izzuddin, Tarmizi
Mat Safri, Norlaili
Othman, Mohd Afzan
author_sort Ahmad Izzuddin, Tarmizi
title Compact Convolutional neural network (CNN) based on SincNet for end-to-end motor imagery decoding and analysis
title_short Compact Convolutional neural network (CNN) based on SincNet for end-to-end motor imagery decoding and analysis
title_full Compact Convolutional neural network (CNN) based on SincNet for end-to-end motor imagery decoding and analysis
title_fullStr Compact Convolutional neural network (CNN) based on SincNet for end-to-end motor imagery decoding and analysis
title_full_unstemmed Compact Convolutional neural network (CNN) based on SincNet for end-to-end motor imagery decoding and analysis
title_sort compact convolutional neural network (cnn) based on sincnet for end-to-end motor imagery decoding and analysis
publisher Elsevier B.V.
publishDate 2021
url http://eprints.utem.edu.my/id/eprint/25811/2/1-S2.0-S0208521621001200-MAIN.PDF
http://eprints.utem.edu.my/id/eprint/25811/
https://reader.elsevier.com/reader/sd/pii/S0208521621001200?token=A30143A7C366A5F537B16EAE993E2AC50295AE6028BD6DB1DBD7B0E9F406D619D54E273687490FFDE1D810B8D2F389A5&originRegion=eu-west-1&originCreation=20220310074616
https://doi.org/10.1016/j.bbe.2021.10.001
_version_ 1731229665638481920