A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention
Decoding human action intention prior to motion onset with surface electromyograms (sEMG) is an emerging neuroengineering topic with interesting clinical applications such as intelligent control of powered prosthesis/exoskeleton devices. Despite extensive prior works in the related fields, it remain...
Saved in:
Main Authors: | , , , , , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2023
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/169382 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-169382 |
---|---|
record_format |
dspace |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Electrical and electronic engineering Bayes Theorem Electromyography |
spellingShingle |
Engineering::Electrical and electronic engineering Bayes Theorem Electromyography Chen, Yongming Zhang, Haihong Wang, Chuanchu Ang, Kai Keng Ng, Soon Huat Jin, Huiwen Lin, Zhiping A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention |
description |
Decoding human action intention prior to motion onset with surface electromyograms (sEMG) is an emerging neuroengineering topic with interesting clinical applications such as intelligent control of powered prosthesis/exoskeleton devices. Despite extensive prior works in the related fields, it remains a technical challenge due to considerable variability of complex multi-muscle activation patterns in terms of volatile spatio-temporal characteristics. To address this issue, we first hypothesize that the inherent variability of the idle state immediately preceding the motion initiation needs to be addressed explicitly. We therefore design a hierarchical dynamic Bayesian learning network model that integrates an array of Gaussian mixture model - hidden Markov models (GMM-HMMs), where each GMM-HMM learns the multi-sEMG processes either during the idle state, or during the motion initiation phase of a particular motion task. To test the hypothesis and evaluate the new learning network, we design and build a upper-limb sEMG-joystick motion study system, and collect data from 11 healthy volunteers. The data collection protocol adapted from the psychomotor vigilance task includes repeated and randomized binary hand motion tasks (push or pull) starting from either of two designated idle states: relaxed (with minimal muscle tones), or prepared (with muscle tones). We run a series of cross-validation tests to examine the performance of the method in comparison with the conventional techniques. The results suggest that the idle state recognition favors the dynamic Bayesian model over a static classification model. The results also show a statistically significant improvement in motion prediction accuracy by the proposed method (93.83±6.41%) in comparison with the conventional GMM-HMM method (89.71±8.98%) that does not explicitly account for the idle state. Moreover, we examine the progress of prediction accuracy over the course of motion initiation and identify the important hidden states that warrant future research. |
author2 |
School of Electrical and Electronic Engineering |
author_facet |
School of Electrical and Electronic Engineering Chen, Yongming Zhang, Haihong Wang, Chuanchu Ang, Kai Keng Ng, Soon Huat Jin, Huiwen Lin, Zhiping |
format |
Article |
author |
Chen, Yongming Zhang, Haihong Wang, Chuanchu Ang, Kai Keng Ng, Soon Huat Jin, Huiwen Lin, Zhiping |
author_sort |
Chen, Yongming |
title |
A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention |
title_short |
A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention |
title_full |
A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention |
title_fullStr |
A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention |
title_full_unstemmed |
A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention |
title_sort |
hierarchical dynamic bayesian learning network for emg-based early prediction of voluntary movement intention |
publishDate |
2023 |
url |
https://hdl.handle.net/10356/169382 |
_version_ |
1773551366889799680 |
spelling |
sg-ntu-dr.10356-1693822023-07-21T15:36:42Z A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention Chen, Yongming Zhang, Haihong Wang, Chuanchu Ang, Kai Keng Ng, Soon Huat Jin, Huiwen Lin, Zhiping School of Electrical and Electronic Engineering School of Computer Science and Engineering Engineering::Electrical and electronic engineering Bayes Theorem Electromyography Decoding human action intention prior to motion onset with surface electromyograms (sEMG) is an emerging neuroengineering topic with interesting clinical applications such as intelligent control of powered prosthesis/exoskeleton devices. Despite extensive prior works in the related fields, it remains a technical challenge due to considerable variability of complex multi-muscle activation patterns in terms of volatile spatio-temporal characteristics. To address this issue, we first hypothesize that the inherent variability of the idle state immediately preceding the motion initiation needs to be addressed explicitly. We therefore design a hierarchical dynamic Bayesian learning network model that integrates an array of Gaussian mixture model - hidden Markov models (GMM-HMMs), where each GMM-HMM learns the multi-sEMG processes either during the idle state, or during the motion initiation phase of a particular motion task. To test the hypothesis and evaluate the new learning network, we design and build a upper-limb sEMG-joystick motion study system, and collect data from 11 healthy volunteers. The data collection protocol adapted from the psychomotor vigilance task includes repeated and randomized binary hand motion tasks (push or pull) starting from either of two designated idle states: relaxed (with minimal muscle tones), or prepared (with muscle tones). We run a series of cross-validation tests to examine the performance of the method in comparison with the conventional techniques. The results suggest that the idle state recognition favors the dynamic Bayesian model over a static classification model. The results also show a statistically significant improvement in motion prediction accuracy by the proposed method (93.83±6.41%) in comparison with the conventional GMM-HMM method (89.71±8.98%) that does not explicitly account for the idle state. Moreover, we examine the progress of prediction accuracy over the course of motion initiation and identify the important hidden states that warrant future research. Agency for Science, Technology and Research (A*STAR) Published version This study was supported in part by the National Robotics Programme, Singapore under Grant No. 1922500046 and Grant No. M22NBK0074, and in part by the Science and Engineering Research Council, Agency of Science, Technology and Research, Singapore, through the National Robotics Programme under Grant No. 1922500054. 2023-07-17T05:26:01Z 2023-07-17T05:26:01Z 2023 Journal Article Chen, Y., Zhang, H., Wang, C., Ang, K. K., Ng, S. H., Jin, H. & Lin, Z. (2023). A hierarchical dynamic Bayesian learning network for EMG-based early prediction of voluntary movement intention. Scientific Reports, 13(1), 4730-. https://dx.doi.org/10.1038/s41598-023-30716-7 2045-2322 https://hdl.handle.net/10356/169382 10.1038/s41598-023-30716-7 36959307 2-s2.0-85150924243 1 13 4730 en 1922500046 M22NBK0074 1922500054 Scientific Reports © 2023 The Author(s). This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. application/pdf |