Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning

Electroencephalogram (EEG) data are produced in quantity for measuring brain activity in response to external stimuli. With the rapid development of brain-inspired intelligence, spiking neural network (SNN) possesses the potential to handle EEG data by using spiking activity transmitted among spatia...

Full description

Saved in:
Bibliographic Details
Main Authors: Wu, Xuanyu, Feng, Yixiong, Lou, Shanhe, Zheng, Hao, Hu, Bingtao, Hong, Zhaoxi, Tan, Jianrong
Other Authors: School of Mechanical and Aerospace Engineering
Format: Article
Language:English
Published: 2023
Subjects:
Online Access:https://hdl.handle.net/10356/172866
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-172866
record_format dspace
spelling sg-ntu-dr.10356-1728662023-12-27T04:17:36Z Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning Wu, Xuanyu Feng, Yixiong Lou, Shanhe Zheng, Hao Hu, Bingtao Hong, Zhaoxi Tan, Jianrong School of Mechanical and Aerospace Engineering Engineering::Mechanical engineering NeuCube Spiking Neural Networks Electroencephalogram (EEG) data are produced in quantity for measuring brain activity in response to external stimuli. With the rapid development of brain-inspired intelligence, spiking neural network (SNN) possesses the potential to handle EEG data by using spiking activity transmitted among spatially located synapses and neurons. As an original and unifying SNN architecture, NeuCube, is developed to model, recognize and understand EEG data. However, the NeuCube still faces some challenges for EEG-based pattern recognition, such as few labeled data and changes of data probability distribution. Hence, this paper proposes a novel method to improve the performance of the NeuCube for EEG-based pattern recognition by transfer learning. In the first place, the covariance matrix alignment of EEG data is implemented for every subject in the Euclidean space, which reduces the probability distribution discrepancy of EEG data between different subjects. Different estimation methods for reference covariance matrix are tested and the optimal one is selected for different subjects. Secondly, spatio-temporal features of EEG data are extracted based on the NeuCube reservoir. Since hyper-parameters of the NeuCube reservoir have a great impact on its spatio-temporal representation, an improved cuckoo search algorithm is proposed to discover the optimal hyper-parameters for obtaining the optimal spatio-temporal features. Last but not least, a weighted transfer support vector machine is proposed to improve the original output classifier of the NeuCube in order to make the model adaptive to the cross-domain variability of EEG data. The proposed method is tested on open dataset 2a from BCI competition IV 2008 and achieves good spatio-temporal pattern recognition results. Furthermore, the neuron connectivity and activation level associated with the process of mental tasks are illustrated. This work was supported by the National Natural Science Foundation of China (Grant Nos. 52130501, 52105281 and 52205288) and the Key Research and Development Program of Zhejiang Province (Grant Nos. 2023C01214). 2023-12-27T04:17:36Z 2023-12-27T04:17:36Z 2023 Journal Article Wu, X., Feng, Y., Lou, S., Zheng, H., Hu, B., Hong, Z. & Tan, J. (2023). Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning. Neurocomputing, 529, 222-235. https://dx.doi.org/10.1016/j.neucom.2023.01.087 0925-2312 https://hdl.handle.net/10356/172866 10.1016/j.neucom.2023.01.087 2-s2.0-85148007311 529 222 235 en Neurocomputing © 2023 Elsevier B.V. All rights reserved.
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Mechanical engineering
NeuCube
Spiking Neural Networks
spellingShingle Engineering::Mechanical engineering
NeuCube
Spiking Neural Networks
Wu, Xuanyu
Feng, Yixiong
Lou, Shanhe
Zheng, Hao
Hu, Bingtao
Hong, Zhaoxi
Tan, Jianrong
Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning
description Electroencephalogram (EEG) data are produced in quantity for measuring brain activity in response to external stimuli. With the rapid development of brain-inspired intelligence, spiking neural network (SNN) possesses the potential to handle EEG data by using spiking activity transmitted among spatially located synapses and neurons. As an original and unifying SNN architecture, NeuCube, is developed to model, recognize and understand EEG data. However, the NeuCube still faces some challenges for EEG-based pattern recognition, such as few labeled data and changes of data probability distribution. Hence, this paper proposes a novel method to improve the performance of the NeuCube for EEG-based pattern recognition by transfer learning. In the first place, the covariance matrix alignment of EEG data is implemented for every subject in the Euclidean space, which reduces the probability distribution discrepancy of EEG data between different subjects. Different estimation methods for reference covariance matrix are tested and the optimal one is selected for different subjects. Secondly, spatio-temporal features of EEG data are extracted based on the NeuCube reservoir. Since hyper-parameters of the NeuCube reservoir have a great impact on its spatio-temporal representation, an improved cuckoo search algorithm is proposed to discover the optimal hyper-parameters for obtaining the optimal spatio-temporal features. Last but not least, a weighted transfer support vector machine is proposed to improve the original output classifier of the NeuCube in order to make the model adaptive to the cross-domain variability of EEG data. The proposed method is tested on open dataset 2a from BCI competition IV 2008 and achieves good spatio-temporal pattern recognition results. Furthermore, the neuron connectivity and activation level associated with the process of mental tasks are illustrated.
author2 School of Mechanical and Aerospace Engineering
author_facet School of Mechanical and Aerospace Engineering
Wu, Xuanyu
Feng, Yixiong
Lou, Shanhe
Zheng, Hao
Hu, Bingtao
Hong, Zhaoxi
Tan, Jianrong
format Article
author Wu, Xuanyu
Feng, Yixiong
Lou, Shanhe
Zheng, Hao
Hu, Bingtao
Hong, Zhaoxi
Tan, Jianrong
author_sort Wu, Xuanyu
title Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning
title_short Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning
title_full Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning
title_fullStr Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning
title_full_unstemmed Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning
title_sort improving neucube spiking neural network for eeg-based pattern recognition using transfer learning
publishDate 2023
url https://hdl.handle.net/10356/172866
_version_ 1787136426612097024