Calibrating hand gesture recognition for stroke Rehabilitation Internet-of-Things (RIOT) using MediaPipe in smart healthcare systems

• Main Authors: Zainuddin, Ahmad Anwar, Mohd Dhuzuki, Nurul Hanis, Ahmad Puzi, Asmarani, Johar, Mohd Naqiuddin, Yazid, Maslina
• Format: Article
• Language: English
• Published: Science and Information (SAI) Organization 2024
• Subjects: T10.5 Communication of technical information
• Online Access: http://irep.iium.edu.my/113578/1/113578_Calibrating%20hand%20gesture%20recognition.pdf; http://irep.iium.edu.my/113578/; https://thesai.org/Publications/ViewPaper?Volume=15&Issue=7&Code=IJACSA&SerialNo=56
• Institution: Universiti Islam Antarabangsa Malaysia

Stroke rehabilitation is fraught with challenges, particularly regarding patient mobility, imprecise assessment scoring during the therapy session, and the security of healthcare data shared online. This work aims to address these issues by calibrating hand gesture recognition systems using the Rehabilitation Internet-of-Things (RIOT) framework and examining the effectiveness of machine learning algorithms in conjunction with the MediaPipe framework for gesture recognition calibration. RIOT represents an IoT system developed for the purpose of facilitating remote rehabilitation, with a particular focus on individuals recovering from strokes and residing in geographically distant regions, in addition to healthcare professionals specialising in physical therapy. The Design of Experiment (DoE) methodology allows physiotherapists and researchers to systematically explore the relationship between RIOT and accurate hand gesture recognition using Python's MediaPipe library, by addressing possible factors that may affect the reliability of patients’ scoring results while emphasising data security consideration. To ensure precise rehabilitation assessments, this initiative seeks to enhance accessible home-based stroke rehabilitation by producing optimal and secure calibrated hand gesture recognition with practical recognition techniques. These solutions will be able to benefit both physiotherapists and patients, especially stroke patients who require themselves to be monitored remotely while prioritising security measures within the smart healthcare context.