Learning ADL daily routines with spatiotemporal neural networks

• Main Authors: GAO, Shan, TAN, Ah-hwee, SETCHI, Rossi
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2021
• Subjects: ADL sequence; fusion ART; activity pattern; spatiotemporal features; Databases and Information Systems; Digital Communications and Networking
• Online Access: https://ink.library.smu.edu.sg/sis_research/5177; https://ink.library.smu.edu.sg/context/sis_research/article/6180/viewcontent/NimbusRomNo9L_Regu.pdf
• Institution: Singapore Management University

The activities of daily living (ADLs) refer to the activities performed by individuals on a daily basis and are the indicators of a person’s habits, lifestyle, and wellbeing. Learning an individual’s ADL daily routines has significant value in the healthcare domain. Specifically, ADL recognition and inter-ADL pattern learning problems have been studied extensively in the past couple of decades. However, discovering the patterns performed in a day and clustering them into ADL daily routines has been a relatively unexplored research area. In this paper, a self-organizing neural network model, called the Spatiotemporal ADL Adaptive Resonance Theory (STADLART), is proposed for learning ADL daily routines. STADLART integrates multimodal contextual information that involves the time and space wherein the ADL is performed. By encoding spatiotemporal information explicitly as input features, STADLART enables the learning of time-sensitive knowledge. Moreover, a STADLART variation named STADLART-NC is proposed to normalize and customize ADL weighting for daily routine learning. A weighting assignment scheme is developed that facilitates the assignment of weighting according to ADL importance in specific domains. Empirical experiments using both synthetic and real-world public data sets validate the performance of STADLART and STADLART-NC when compared with alternative pattern discovery methods. The results show STADLART could cluster ADL routines with better performance than baseline algorithms.