AI for social good

This study explores the effectiveness of diverse machine learning architectures in detecting depression, with an emphasis on postpartum depression identification and advanced sentiment analysis. We evaluated various Transformer-based models and identified RoBERTa as particularly adept at identifying...

Full description

Saved in:
Bibliographic Details
Main Author: Wong, Kelly Jie Yin
Other Authors: Erik Cambria
Format: Final Year Project
Language:English
Published: Nanyang Technological University 2024
Subjects:
Online Access:https://hdl.handle.net/10356/175028
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-175028
record_format dspace
spelling sg-ntu-dr.10356-1750282024-04-19T15:46:35Z AI for social good Wong, Kelly Jie Yin Erik Cambria School of Computer Science and Engineering cambria@ntu.edu.sg Computer and Information Science This study explores the effectiveness of diverse machine learning architectures in detecting depression, with an emphasis on postpartum depression identification and advanced sentiment analysis. We evaluated various Transformer-based models and identified RoBERTa as particularly adept at identifying depression, outperforming others across accuracy, precision, recall, and F1 metrics. Employing multi-task learning strategies, including hard and soft parameter sharing, we improved our models' diagnostic accuracy. Further, we utilized Large Language Models (LLMs) with zero-shot learning, few-shot prompting, and fine-tuning with LoRA adapters on targeted datasets, achieving notable performance enhancements. A practical application of our research is the fine-tuned chatbot we developed, which has shown potential as a mental health support tool. Our experiments also extended to multimodal approaches that combined textual, visual, and temporal data using Transformer Encoders. These multimodal models surpassed the performance of text-only models and text-image hybrid models. Our results demonstrate that integrating and optimizing various computational techniques significantly boosts the detection of depression indicators. Additionally, we conducted a basic analysis utilizing explainable AI methods such as the LIME explainer to contrast the performance between the postpartum depression (PPD) model and the general depression detection model. This research confirms the promise of multimodal data in improving AI's role in mental health diagnostics and support, offering a pathway to more comprehensive solutions. Bachelor's degree 2024-04-18T08:41:18Z 2024-04-18T08:41:18Z 2024 Final Year Project (FYP) Wong, K. J. Y. (2024). AI for social good. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/175028 https://hdl.handle.net/10356/175028 en SCSE23-0147 application/pdf Nanyang Technological University
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Computer and Information Science
spellingShingle Computer and Information Science
Wong, Kelly Jie Yin
AI for social good
description This study explores the effectiveness of diverse machine learning architectures in detecting depression, with an emphasis on postpartum depression identification and advanced sentiment analysis. We evaluated various Transformer-based models and identified RoBERTa as particularly adept at identifying depression, outperforming others across accuracy, precision, recall, and F1 metrics. Employing multi-task learning strategies, including hard and soft parameter sharing, we improved our models' diagnostic accuracy. Further, we utilized Large Language Models (LLMs) with zero-shot learning, few-shot prompting, and fine-tuning with LoRA adapters on targeted datasets, achieving notable performance enhancements. A practical application of our research is the fine-tuned chatbot we developed, which has shown potential as a mental health support tool. Our experiments also extended to multimodal approaches that combined textual, visual, and temporal data using Transformer Encoders. These multimodal models surpassed the performance of text-only models and text-image hybrid models. Our results demonstrate that integrating and optimizing various computational techniques significantly boosts the detection of depression indicators. Additionally, we conducted a basic analysis utilizing explainable AI methods such as the LIME explainer to contrast the performance between the postpartum depression (PPD) model and the general depression detection model. This research confirms the promise of multimodal data in improving AI's role in mental health diagnostics and support, offering a pathway to more comprehensive solutions.
author2 Erik Cambria
author_facet Erik Cambria
Wong, Kelly Jie Yin
format Final Year Project
author Wong, Kelly Jie Yin
author_sort Wong, Kelly Jie Yin
title AI for social good
title_short AI for social good
title_full AI for social good
title_fullStr AI for social good
title_full_unstemmed AI for social good
title_sort ai for social good
publisher Nanyang Technological University
publishDate 2024
url https://hdl.handle.net/10356/175028
_version_ 1814047018291560448