A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention

Decoding human action intention prior to motion onset with surface electromyograms (sEMG) is an emerging neuroengineering topic with interesting clinical applications such as intelligent control of powered prosthesis/exoskeleton devices. Despite extensive prior works in the related fields, it remain...

Full description

Saved in:
Bibliographic Details
Main Authors: Chen, Yongming, Zhang, Haihong, Wang, Chuanchu, Ang, Kai Keng, Ng, Soon Huat, Jin, Huiwen, Lin, Zhiping
Other Authors: School of Electrical and Electronic Engineering
Format: Article
Language:English
Published: 2023
Subjects:
Online Access:https://hdl.handle.net/10356/169382
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-169382
record_format dspace
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Electrical and electronic engineering
Bayes Theorem
Electromyography
spellingShingle Engineering::Electrical and electronic engineering
Bayes Theorem
Electromyography
Chen, Yongming
Zhang, Haihong
Wang, Chuanchu
Ang, Kai Keng
Ng, Soon Huat
Jin, Huiwen
Lin, Zhiping
A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention
description Decoding human action intention prior to motion onset with surface electromyograms (sEMG) is an emerging neuroengineering topic with interesting clinical applications such as intelligent control of powered prosthesis/exoskeleton devices. Despite extensive prior works in the related fields, it remains a technical challenge due to considerable variability of complex multi-muscle activation patterns in terms of volatile spatio-temporal characteristics. To address this issue, we first hypothesize that the inherent variability of the idle state immediately preceding the motion initiation needs to be addressed explicitly. We therefore design a hierarchical dynamic Bayesian learning network model that integrates an array of Gaussian mixture model - hidden Markov models (GMM-HMMs), where each GMM-HMM learns the multi-sEMG processes either during the idle state, or during the motion initiation phase of a particular motion task. To test the hypothesis and evaluate the new learning network, we design and build a upper-limb sEMG-joystick motion study system, and collect data from 11 healthy volunteers. The data collection protocol adapted from the psychomotor vigilance task includes repeated and randomized binary hand motion tasks (push or pull) starting from either of two designated idle states: relaxed (with minimal muscle tones), or prepared (with muscle tones). We run a series of cross-validation tests to examine the performance of the method in comparison with the conventional techniques. The results suggest that the idle state recognition favors the dynamic Bayesian model over a static classification model. The results also show a statistically significant improvement in motion prediction accuracy by the proposed method (93.83±6.41%) in comparison with the conventional GMM-HMM method (89.71±8.98%) that does not explicitly account for the idle state. Moreover, we examine the progress of prediction accuracy over the course of motion initiation and identify the important hidden states that warrant future research.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Chen, Yongming
Zhang, Haihong
Wang, Chuanchu
Ang, Kai Keng
Ng, Soon Huat
Jin, Huiwen
Lin, Zhiping
format Article
author Chen, Yongming
Zhang, Haihong
Wang, Chuanchu
Ang, Kai Keng
Ng, Soon Huat
Jin, Huiwen
Lin, Zhiping
author_sort Chen, Yongming
title A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention
title_short A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention
title_full A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention
title_fullStr A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention
title_full_unstemmed A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention
title_sort hierarchical dynamic bayesian learning network for emg-based early prediction of voluntary movement intention
publishDate 2023
url https://hdl.handle.net/10356/169382
_version_ 1773551366889799680
spelling sg-ntu-dr.10356-1693822023-07-21T15:36:42Z A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention Chen, Yongming Zhang, Haihong Wang, Chuanchu Ang, Kai Keng Ng, Soon Huat Jin, Huiwen Lin, Zhiping School of Electrical and Electronic Engineering School of Computer Science and Engineering Engineering::Electrical and electronic engineering Bayes Theorem Electromyography Decoding human action intention prior to motion onset with surface electromyograms (sEMG) is an emerging neuroengineering topic with interesting clinical applications such as intelligent control of powered prosthesis/exoskeleton devices. Despite extensive prior works in the related fields, it remains a technical challenge due to considerable variability of complex multi-muscle activation patterns in terms of volatile spatio-temporal characteristics. To address this issue, we first hypothesize that the inherent variability of the idle state immediately preceding the motion initiation needs to be addressed explicitly. We therefore design a hierarchical dynamic Bayesian learning network model that integrates an array of Gaussian mixture model - hidden Markov models (GMM-HMMs), where each GMM-HMM learns the multi-sEMG processes either during the idle state, or during the motion initiation phase of a particular motion task. To test the hypothesis and evaluate the new learning network, we design and build a upper-limb sEMG-joystick motion study system, and collect data from 11 healthy volunteers. The data collection protocol adapted from the psychomotor vigilance task includes repeated and randomized binary hand motion tasks (push or pull) starting from either of two designated idle states: relaxed (with minimal muscle tones), or prepared (with muscle tones). We run a series of cross-validation tests to examine the performance of the method in comparison with the conventional techniques. The results suggest that the idle state recognition favors the dynamic Bayesian model over a static classification model. The results also show a statistically significant improvement in motion prediction accuracy by the proposed method (93.83±6.41%) in comparison with the conventional GMM-HMM method (89.71±8.98%) that does not explicitly account for the idle state. Moreover, we examine the progress of prediction accuracy over the course of motion initiation and identify the important hidden states that warrant future research. Agency for Science, Technology and Research (A*STAR) Published version This study was supported in part by the National Robotics Programme, Singapore under Grant No. 1922500046 and Grant No. M22NBK0074, and in part by the Science and Engineering Research Council, Agency of Science, Technology and Research, Singapore, through the National Robotics Programme under Grant No. 1922500054. 2023-07-17T05:26:01Z 2023-07-17T05:26:01Z 2023 Journal Article Chen, Y., Zhang, H., Wang, C., Ang, K. K., Ng, S. H., Jin, H. & Lin, Z. (2023). A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention. Scientific Reports, 13(1), 4730-. https://dx.doi.org/10.1038/s41598-023-30716-7 2045-2322 https://hdl.handle.net/10356/169382 10.1038/s41598-023-30716-7 36959307 2-s2.0-85150924243 1 13 4730 en 1922500046 M22NBK0074 1922500054 Scientific Reports © 2023 The Author(s). This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. application/pdf