Learning-based motion-intention prediction for end-point control of upper-limb-assistive robots

• Main Authors: Yang, Sibo, Garg, Neha P., Gao, Ruobin, Yuan, Meng, Noronha, Bernardo, Ang, Wei Tech, Accoto, Dino
• Other Authors: School of Mechanical and Aerospace Engineering
• Format: Article
• Language: English
• Published: 2023
• Subjects: Engineering::Mechanical engineering; Engineering::Computer science and engineering; Upper Limb Assistive Robots; Wearable Sensors
• Online Access: https://hdl.handle.net/10356/169537
• Institution: Nanyang Technological University

The lack of intuitive and active human-robot interaction makes it difficult to use upper-limb-assistive devices. In this paper, we propose a novel learning-based controller that intuitively uses onset motion to predict the desired end-point position for an assistive robot. A multi-modal sensing system comprising inertial measurement units (IMUs), electromyographic (EMG) sensors, and mechanomyography (MMG) sensors was implemented. This system was used to acquire kinematic and physiological signals during reaching and placing tasks performed by five healthy subjects. The onset motion data of each motion trial were extracted to input into traditional regression models and deep learning models for training and testing. The models can predict the position of the hand in planar space, which is the reference position for low-level position controllers. The results show that using IMU sensor with the proposed prediction model is sufficient for motion intention detection, which can provide almost the same prediction performance compared with adding EMG or MMG. Additionally, recurrent neural network (RNN)-based models can predict target positions over a short onset time window for reaching motions and are suitable for predicting targets over a longer horizon for placing tasks. This study's detailed analysis can improve the usability of the assistive/rehabilitation robots.