Decoding multi-class motor imagery from unilateral limbs using EEG signals

The EEG is a widely utilized neural signal source, particularly in motor imagery-based brain-computer interface (MI-BCI), offering distinct advantages in applications like stroke rehabilitation. Current research predominantly concentrates on the bilateral limbs paradigm and decoding, but the use sce...

Full description

Saved in:
Bibliographic Details
Main Authors: Rong, Fenqi, Yang, Banghua, Guan, Cuntai
Other Authors: College of Computing and Data Science
Format: Article
Language:English
Published: 2024
Subjects:
EEG
Online Access:https://hdl.handle.net/10356/181910
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-181910
record_format dspace
spelling sg-ntu-dr.10356-1819102024-12-30T07:47:56Z Decoding multi-class motor imagery from unilateral limbs using EEG signals Rong, Fenqi Yang, Banghua Guan, Cuntai College of Computing and Data Science Computer and Information Science EEG Motor direction The EEG is a widely utilized neural signal source, particularly in motor imagery-based brain-computer interface (MI-BCI), offering distinct advantages in applications like stroke rehabilitation. Current research predominantly concentrates on the bilateral limbs paradigm and decoding, but the use scenarios for stroke rehabilitation are typically for unilateral upper limbs. There is a significant challenge to decoding unilateral MI of multitasks due to the overlapped spatial neural activities of the tasks. This study aims to formulate a novel MI-BCI experimental paradigm for unilateral limbs with multitasks. The paradigm encompasses four imagined movement directions: top-bottom, left-right, top right-bottom left, and top left-bottom right. Forty-six healthy subjects participated in this experiment. Commonly used machine learning techniques, such as FBCSP, EEGNet, deepConvNet, and FBCNet, were employed for evaluation. To improve decoding accuracy, we propose an MVCA method that introduces temporal convolution and attention mechanism to effectively capture temporal features from multiple perspectives. With the MVCA model, we have achieved 40.6% and 64.89% classification accuracies for the four-class and two-class scenarios (top right-bottom left and top left-bottom right), respectively. Conclusion: This is the first study demonstrating that motor imagery of multiple directions in unilateral limbs can be decoded. In particular, decoding two directions, right top to left bottom and left top to right bottom, provides the best accuracy, which sheds light on future studies. This study advances the development of the MI-BCI paradigm, offering preliminary evidence for the feasibility of decoding multiple directional information from EEG. This, in turn, enhances the dimensions of MI control commands. Published version This work was supported in part by the National Key Research and Development Program of China under Grant 2022YFF1202500 and Grant 2022YFF1202504, in part by the National Natural Science Foundation of China under Grant 62376149, in part by Shanghai Major Science and Technology Project 2021SHZDZX, and in part by Shanghai Industrial Collaborative Technology Innovation Project XTCX-KJ-2022-2-14. 2024-12-30T07:47:56Z 2024-12-30T07:47:56Z 2024 Journal Article Rong, F., Yang, B. & Guan, C. (2024). Decoding multi-class motor imagery from unilateral limbs using EEG signals. IEEE Transactions On Neural Systems and Rehabilitation Engineering, 32, 3399-3409. https://dx.doi.org/10.1109/TNSRE.2024.3454088 1534-4320 https://hdl.handle.net/10356/181910 10.1109/TNSRE.2024.3454088 39236133 2-s2.0-85203541858 32 3399 3409 en IEEE Transactions on Neural Systems and Rehabilitation Engineering © 2024 The Authors. This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/ application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Computer and Information Science
EEG
Motor direction
spellingShingle Computer and Information Science
EEG
Motor direction
Rong, Fenqi
Yang, Banghua
Guan, Cuntai
Decoding multi-class motor imagery from unilateral limbs using EEG signals
description The EEG is a widely utilized neural signal source, particularly in motor imagery-based brain-computer interface (MI-BCI), offering distinct advantages in applications like stroke rehabilitation. Current research predominantly concentrates on the bilateral limbs paradigm and decoding, but the use scenarios for stroke rehabilitation are typically for unilateral upper limbs. There is a significant challenge to decoding unilateral MI of multitasks due to the overlapped spatial neural activities of the tasks. This study aims to formulate a novel MI-BCI experimental paradigm for unilateral limbs with multitasks. The paradigm encompasses four imagined movement directions: top-bottom, left-right, top right-bottom left, and top left-bottom right. Forty-six healthy subjects participated in this experiment. Commonly used machine learning techniques, such as FBCSP, EEGNet, deepConvNet, and FBCNet, were employed for evaluation. To improve decoding accuracy, we propose an MVCA method that introduces temporal convolution and attention mechanism to effectively capture temporal features from multiple perspectives. With the MVCA model, we have achieved 40.6% and 64.89% classification accuracies for the four-class and two-class scenarios (top right-bottom left and top left-bottom right), respectively. Conclusion: This is the first study demonstrating that motor imagery of multiple directions in unilateral limbs can be decoded. In particular, decoding two directions, right top to left bottom and left top to right bottom, provides the best accuracy, which sheds light on future studies. This study advances the development of the MI-BCI paradigm, offering preliminary evidence for the feasibility of decoding multiple directional information from EEG. This, in turn, enhances the dimensions of MI control commands.
author2 College of Computing and Data Science
author_facet College of Computing and Data Science
Rong, Fenqi
Yang, Banghua
Guan, Cuntai
format Article
author Rong, Fenqi
Yang, Banghua
Guan, Cuntai
author_sort Rong, Fenqi
title Decoding multi-class motor imagery from unilateral limbs using EEG signals
title_short Decoding multi-class motor imagery from unilateral limbs using EEG signals
title_full Decoding multi-class motor imagery from unilateral limbs using EEG signals
title_fullStr Decoding multi-class motor imagery from unilateral limbs using EEG signals
title_full_unstemmed Decoding multi-class motor imagery from unilateral limbs using EEG signals
title_sort decoding multi-class motor imagery from unilateral limbs using eeg signals
publishDate 2024
url https://hdl.handle.net/10356/181910
_version_ 1820027777501364224