Smartphone-based memory training game using physical gestures

• Main Author: Wijaya, Angelin Grace
• Other Authors: Goh Wooi Boon
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2024
• Subjects: Computer and Information Science; Game; Memory; Memory training; Memory game; Gestures; Physical gestures
• Online Access: https://hdl.handle.net/10356/174871
• Institution: Nanyang Technological University

Memory is pivotal in human life, serving as the foundation upon which our experiences, interactions, and personalities are built and preserved. Unfortunately, memory deteriorates with age, and it may lead to severe cognitive impairments, such as dementia, affecting millions each year. To mitigate this concerning trend, it is crucial to provide regular cognitive exercises. Traditional memory games engage multiple cognitive processes, yet recent studies suggest integrating physical gestures enhances memory recall. The aim of the project is to develop a memory game application that utilizes visual, auditory cues, and hand gestures to reinforce memory recall and enhance engagement in memory training. Two types of games were created, Gesture Build-Up and Gesture Rhythm, and then evaluated through a user study. Gesture BuildUp challenges users to memorize a gradually increasing sequence of gestures, while Gesture Rhythm challenges users to memorize a fixed sequence of gestures and replicate it in sync with the beat. Feedback from the participants indicated that both games were not only engaging, fun, and challenging but also deemed effective in enhancing memory. Moreover, participants were able to recognize the benefits of gesture-integrated memory games and majority were in favor of incorporating hand gestures into future memory games.