Object recognition-based mnemonics mobile app for senior adults communication

• Main Authors: Pang, Natalie, Foo, Schubert, Sesagiri Raamkumar, Aravind, Zhang, Xue, Vu, Samantha
• Other Authors: Wee Kim Wee School of Communication and Information
• Format: Conference or Workshop Item
• Language: English
• Published: 2016
• Subjects: DRNTU::Engineering::Computer science and engineering::Information systems::Information interfaces and presentation
• Online Access: https://hdl.handle.net/10356/82350; http://hdl.handle.net/10220/39953
• Institution: Nanyang Technological University

There has been an exponential increase in smartphone usage across the globe due to decreasing production costs and a competitive marketplace. Smartphones and mobile internet services have thrived together to create virtual connections between people. However, there have been very few successful mobile apps developed for assisting senior adults in their day-to-day activities. Our research center has been developing artifacts for helping older adults. In this paper, we present the design and features of an android-based mobile app that has been developed as a mnemonics app. The app utilizes image recognition technology to trigger events using the options of calling phone numbers, sending short message service (SMS) and tweets. Caregivers and family members can map images of everyday target objects to events in the app. Subsequently, seniors can use the app to scan these objects for automatically triggering the pre-defined events, thereby saving time and effort.