Psychological state monitoring via web gaming

• Main Author: Zhang, Wei
• Other Authors: Wesley Tan Chee Wah
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2024
• Subjects: Computer and Information Science; AI; Unity
• Online Access: https://hdl.handle.net/10356/177327
• Institution: Nanyang Technological University

Adolescent mental health is a critical concern globally, with significant implications to their well-being and development. Despite increased awareness and efforts from parents and educators, many adolescents still struggle with mental health issues due to limitations in current diagnostic and treatment methods. This project aims to address this gap by developing an objective assessment tool using artificial intelligence (AI) technology to identify and assess adolescents' mental health status. The tool collects various behavioral data, including facial expressions, eye movements, and speech, through a web-based game interface. Leveraging AI models trained on these indicators, the tool provides dynamic assessment and tailored support for monitoring mental health conditions. This paper starts with a brief introduction about the background, motivation, objectives and scope of this application. For the AI model part, this paper mainly explains the facial expressions recognition model, the pipeline of implementing face expressions analysis, the comparison and analysis of different models. Moreover, the paper introduces the game design and development. Finally, it concludes with suggestions for future work.