MIN2Net: end-to-end multi-task learning for subject-independent motor imagery EEG classification

Objective: Advances in the motor imagery (MI)-based brain-computer interfaces (BCIs) allow control of several applications by decoding neurophysiological phenomena, which are usually recorded by electroencephalography (EEG) using a non-invasive technique. Despite significant advances in MI-based BCI...

Full description

Saved in:
Bibliographic Details
Main Authors: Autthasan, Phairot, Chaisaen, Rattanaphon, Sudhawiyangkul, Thapanun, Rangpong, Phurin, Kiatthaveephong, Suktipol, Dilokthanakul, Nat, Bhakdisongkhram, Gun, Phan, Huy, Guan, Cuntai, Wilaiprasitporn, Theerawit
Other Authors: School of Computer Science and Engineering
Format: Article
Language:English
Published: 2022
Subjects:
Online Access:https://hdl.handle.net/10356/162519
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-162519
record_format dspace
spelling sg-ntu-dr.10356-1625192022-10-26T06:34:23Z MIN2Net: end-to-end multi-task learning for subject-independent motor imagery EEG classification Autthasan, Phairot Chaisaen, Rattanaphon Sudhawiyangkul, Thapanun Rangpong, Phurin Kiatthaveephong, Suktipol Dilokthanakul, Nat Bhakdisongkhram, Gun Phan, Huy Guan, Cuntai Wilaiprasitporn, Theerawit School of Computer Science and Engineering Engineering::Computer science and engineering Brain-Computer Interfaces Motor Imagery Objective: Advances in the motor imagery (MI)-based brain-computer interfaces (BCIs) allow control of several applications by decoding neurophysiological phenomena, which are usually recorded by electroencephalography (EEG) using a non-invasive technique. Despite significant advances in MI-based BCI, EEG rhythms are specific to a subject and various changes over time. These issues point to significant challenges to enhance the classification performance, especially in a subjectindependent manner. Methods: To overcome these challenges, we propose MIN2Net, a novel end-to-end multi-task learning to tackle this task. We integrate deep metric learning into a multi-task autoencoder to learn a compact and discriminative latent representation from EEG and perform classification simultaneously. Results: This approach reduces the complexity in pre-processing, results in significant performance improvement on EEG classification. Experimental results in a subject-independent manner show that MIN2Net outperforms the state-of-the-art techniques, achieving an F1-score improvement of 6.72% and 2.23% on the SMR-BCI and OpenBMI datasets, respectively. Conclusion: We demonstrate that MIN2Net improves discriminative information in the latent representation. Significance: This study indicates the possibility and practicality of using this model to develop MI-based BCI applications for new users without calibration. This work was supported in part by PTT Public Company Limited, in part by The SCB Public Company Limited, in part by Thailand Science Research, and Innovation under Grant SRI62W1501, in part by The Office of the Permanent Secretary of the Ministry of Higher Education, Science, Research, and Innovation, Thailand under Grant RGNS63-252, and in part by the National Research Council of Thailand under Grant N41A640131. 2022-10-26T06:31:33Z 2022-10-26T06:31:33Z 2021 Journal Article Autthasan, P., Chaisaen, R., Sudhawiyangkul, T., Rangpong, P., Kiatthaveephong, S., Dilokthanakul, N., Bhakdisongkhram, G., Phan, H., Guan, C. & Wilaiprasitporn, T. (2022). MIN2Net: end-to-end multi-task learning for subject-independent motor imagery EEG classification. IEEE Transactions On Bio-Medical Engineering, 69(6), 2105-2118. https://dx.doi.org/10.1109/TBME.2021.3137184 0018-9294 https://hdl.handle.net/10356/162519 10.1109/TBME.2021.3137184 34932469 2-s2.0-85122078918 6 69 2105 2118 en IEEE Transactions on Bio-Medical Engineering © 2021 IEEE. All rights reserved.
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering
Brain-Computer Interfaces
Motor Imagery
spellingShingle Engineering::Computer science and engineering
Brain-Computer Interfaces
Motor Imagery
Autthasan, Phairot
Chaisaen, Rattanaphon
Sudhawiyangkul, Thapanun
Rangpong, Phurin
Kiatthaveephong, Suktipol
Dilokthanakul, Nat
Bhakdisongkhram, Gun
Phan, Huy
Guan, Cuntai
Wilaiprasitporn, Theerawit
MIN2Net: end-to-end multi-task learning for subject-independent motor imagery EEG classification
description Objective: Advances in the motor imagery (MI)-based brain-computer interfaces (BCIs) allow control of several applications by decoding neurophysiological phenomena, which are usually recorded by electroencephalography (EEG) using a non-invasive technique. Despite significant advances in MI-based BCI, EEG rhythms are specific to a subject and various changes over time. These issues point to significant challenges to enhance the classification performance, especially in a subjectindependent manner. Methods: To overcome these challenges, we propose MIN2Net, a novel end-to-end multi-task learning to tackle this task. We integrate deep metric learning into a multi-task autoencoder to learn a compact and discriminative latent representation from EEG and perform classification simultaneously. Results: This approach reduces the complexity in pre-processing, results in significant performance improvement on EEG classification. Experimental results in a subject-independent manner show that MIN2Net outperforms the state-of-the-art techniques, achieving an F1-score improvement of 6.72% and 2.23% on the SMR-BCI and OpenBMI datasets, respectively. Conclusion: We demonstrate that MIN2Net improves discriminative information in the latent representation. Significance: This study indicates the possibility and practicality of using this model to develop MI-based BCI applications for new users without calibration.
author2 School of Computer Science and Engineering
author_facet School of Computer Science and Engineering
Autthasan, Phairot
Chaisaen, Rattanaphon
Sudhawiyangkul, Thapanun
Rangpong, Phurin
Kiatthaveephong, Suktipol
Dilokthanakul, Nat
Bhakdisongkhram, Gun
Phan, Huy
Guan, Cuntai
Wilaiprasitporn, Theerawit
format Article
author Autthasan, Phairot
Chaisaen, Rattanaphon
Sudhawiyangkul, Thapanun
Rangpong, Phurin
Kiatthaveephong, Suktipol
Dilokthanakul, Nat
Bhakdisongkhram, Gun
Phan, Huy
Guan, Cuntai
Wilaiprasitporn, Theerawit
author_sort Autthasan, Phairot
title MIN2Net: end-to-end multi-task learning for subject-independent motor imagery EEG classification
title_short MIN2Net: end-to-end multi-task learning for subject-independent motor imagery EEG classification
title_full MIN2Net: end-to-end multi-task learning for subject-independent motor imagery EEG classification
title_fullStr MIN2Net: end-to-end multi-task learning for subject-independent motor imagery EEG classification
title_full_unstemmed MIN2Net: end-to-end multi-task learning for subject-independent motor imagery EEG classification
title_sort min2net: end-to-end multi-task learning for subject-independent motor imagery eeg classification
publishDate 2022
url https://hdl.handle.net/10356/162519
_version_ 1749179174681051136