Distal-end force prediction of tendon-sheath mechanisms for flexible endoscopic surgical robots using deep learning

• Main Authors: Li, Xiaoguo, Cao, Lin, Tiong, Anthony Meng Huat, Phan, Phuoc Thien, Phee, Soo Jay
• Other Authors: School of Mechanical and Aerospace Engineering
• Format: Article
• Language: English
• Published: 2020
• Subjects: Engineering::Mechanical engineering::Robots; Haptic Feedback; Surgical Robot
• Online Access: https://hdl.handle.net/10356/137858
• Institution: Nanyang Technological University

Accurate haptic feedback is highly challenging for flexible endoscopic surgical robots due to space limitation for sensors on small end-effectors and critical force hysteresis of their tendon-sheath mechanisms (TSMs). This paper proposes a deep learning approach to predicting the distal force of TSMs when manipulating a biological tissue based on only proximal-end measurements. Both Multilayer Perceptron (MLP) and Recurrent Neural Network (RNN) were investigated to study their capabilities of making sequential distal force predictions. The results were compared with those of the conventional modelling approach. It was observed that, when sufficient data was provided for training, RNN achieved the most accurate prediction (RMSE = 0.0219 N) in experiments with constant system velocity. The effects of insufficient training data, varying system velocity and irregular motion trajectories on the performance of RNN were further studied. Notably, RNN could precisely identify the current system phase in the force hysteresis profile and can be applied to TSMs with realistic non-periodic movement such as manual manipulation trajectory (RSME = 0.2287 N). The proposed approach can be applied to any TSM-driven robotic systems for accurate haptic feedback without requiring sensors at the distal ends of the robots.