Multimodal mobile sensing systems for physiological and psychological assessment

Sensing systems for monitoring physiological and psychological states have been studied extensively in both academic and industry research for different applications across various domains. However, most of the studies have been done in the lab environment with controlled and complicated sensor setu...

Full description

Saved in:
Bibliographic Details
Main Author: HUYNH, Nguyen Phan Sinh
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2019
Subjects:
Online Access:https://ink.library.smu.edu.sg/etd_coll/249
https://ink.library.smu.edu.sg/cgi/viewcontent.cgi?article=1249&context=etd_coll
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
id sg-smu-ink.etd_coll-1249
record_format dspace
spelling sg-smu-ink.etd_coll-12492020-03-13T08:13:33Z Multimodal mobile sensing systems for physiological and psychological assessment HUYNH, Nguyen Phan Sinh Sensing systems for monitoring physiological and psychological states have been studied extensively in both academic and industry research for different applications across various domains. However, most of the studies have been done in the lab environment with controlled and complicated sensor setup, which is only suitable for serious healthcare applications in which the obtrusiveness and immobility can be compromised in a trade-off for accurate clinical screening or diagnosing. The recent substantial development of mobile devices with embedded miniaturized sensors are now allowing new opportunities to adapt and develop such sensing systems in the mobile context. The ability to sense physiological and psychological state using mobile (and wearable) sensors would make its applications much more feasible and accessible for daily use in different domains such as healthcare, education, security, media and entertainment. Still, there are several research challenges remain in order to develop mobile sensing systems that can monitor users’ physiological signals and psychological conditions accurately and effectively. This thesis will address three key aspects related to realizing the multimodal mobile sensing systems for physiological and psychological state assessment. First, as the mobile embedded sensors are not designed exclusively for physiological sensing purpose, we attempt to improve the sensing capabilities of mobile devices to acquire the vital physiological signals. Specifically, we study the feasibility of using mobile sensors to measure a set of vital physiological signals, in particular, the cardiovascular metrics including blood volume, heartbeat-to-heart beat interval, heart rate, and heart rate variability. The changes in those physiological signals are essential in detecting many psychological states. Second, we validate the importance of assessing the physiological and psychological states in mobile context across various domains. Lastly, we develop and evaluate a multimodal sensing system to measure engagement level of mobile gamers. While the focus of our study was on mobile gaming scenario, we believe the concept of such sensing system is applicable to improve user experience in other mobile activities, including playing games, watching advertisements, or studying using their mobile devices. 2019-12-01T08:00:00Z text application/pdf https://ink.library.smu.edu.sg/etd_coll/249 https://ink.library.smu.edu.sg/cgi/viewcontent.cgi?article=1249&context=etd_coll http://creativecommons.org/licenses/by-nc-nd/4.0/ Dissertations and Theses Collection (Open Access) eng Institutional Knowledge at Singapore Management University Mobile sensing physiological sensing Programming Languages and Compilers Software Engineering
institution Singapore Management University
building SMU Libraries
continent Asia
country Singapore
Singapore
content_provider SMU Libraries
collection InK@SMU
language English
topic Mobile sensing
physiological sensing
Programming Languages and Compilers
Software Engineering
spellingShingle Mobile sensing
physiological sensing
Programming Languages and Compilers
Software Engineering
HUYNH, Nguyen Phan Sinh
Multimodal mobile sensing systems for physiological and psychological assessment
description Sensing systems for monitoring physiological and psychological states have been studied extensively in both academic and industry research for different applications across various domains. However, most of the studies have been done in the lab environment with controlled and complicated sensor setup, which is only suitable for serious healthcare applications in which the obtrusiveness and immobility can be compromised in a trade-off for accurate clinical screening or diagnosing. The recent substantial development of mobile devices with embedded miniaturized sensors are now allowing new opportunities to adapt and develop such sensing systems in the mobile context. The ability to sense physiological and psychological state using mobile (and wearable) sensors would make its applications much more feasible and accessible for daily use in different domains such as healthcare, education, security, media and entertainment. Still, there are several research challenges remain in order to develop mobile sensing systems that can monitor users’ physiological signals and psychological conditions accurately and effectively. This thesis will address three key aspects related to realizing the multimodal mobile sensing systems for physiological and psychological state assessment. First, as the mobile embedded sensors are not designed exclusively for physiological sensing purpose, we attempt to improve the sensing capabilities of mobile devices to acquire the vital physiological signals. Specifically, we study the feasibility of using mobile sensors to measure a set of vital physiological signals, in particular, the cardiovascular metrics including blood volume, heartbeat-to-heart beat interval, heart rate, and heart rate variability. The changes in those physiological signals are essential in detecting many psychological states. Second, we validate the importance of assessing the physiological and psychological states in mobile context across various domains. Lastly, we develop and evaluate a multimodal sensing system to measure engagement level of mobile gamers. While the focus of our study was on mobile gaming scenario, we believe the concept of such sensing system is applicable to improve user experience in other mobile activities, including playing games, watching advertisements, or studying using their mobile devices.
format text
author HUYNH, Nguyen Phan Sinh
author_facet HUYNH, Nguyen Phan Sinh
author_sort HUYNH, Nguyen Phan Sinh
title Multimodal mobile sensing systems for physiological and psychological assessment
title_short Multimodal mobile sensing systems for physiological and psychological assessment
title_full Multimodal mobile sensing systems for physiological and psychological assessment
title_fullStr Multimodal mobile sensing systems for physiological and psychological assessment
title_full_unstemmed Multimodal mobile sensing systems for physiological and psychological assessment
title_sort multimodal mobile sensing systems for physiological and psychological assessment
publisher Institutional Knowledge at Singapore Management University
publishDate 2019
url https://ink.library.smu.edu.sg/etd_coll/249
https://ink.library.smu.edu.sg/cgi/viewcontent.cgi?article=1249&context=etd_coll
_version_ 1712300935402749952