AI for social good
This study explores the effectiveness of diverse machine learning architectures in detecting depression, with an emphasis on postpartum depression identification and advanced sentiment analysis. We evaluated various Transformer-based models and identified RoBERTa as particularly adept at identifying...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Final Year Project |
Language: | English |
Published: |
Nanyang Technological University
2024
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/175028 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-175028 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1750282024-04-19T15:46:35Z AI for social good Wong, Kelly Jie Yin Erik Cambria School of Computer Science and Engineering cambria@ntu.edu.sg Computer and Information Science This study explores the effectiveness of diverse machine learning architectures in detecting depression, with an emphasis on postpartum depression identification and advanced sentiment analysis. We evaluated various Transformer-based models and identified RoBERTa as particularly adept at identifying depression, outperforming others across accuracy, precision, recall, and F1 metrics. Employing multi-task learning strategies, including hard and soft parameter sharing, we improved our models' diagnostic accuracy. Further, we utilized Large Language Models (LLMs) with zero-shot learning, few-shot prompting, and fine-tuning with LoRA adapters on targeted datasets, achieving notable performance enhancements. A practical application of our research is the fine-tuned chatbot we developed, which has shown potential as a mental health support tool. Our experiments also extended to multimodal approaches that combined textual, visual, and temporal data using Transformer Encoders. These multimodal models surpassed the performance of text-only models and text-image hybrid models. Our results demonstrate that integrating and optimizing various computational techniques significantly boosts the detection of depression indicators. Additionally, we conducted a basic analysis utilizing explainable AI methods such as the LIME explainer to contrast the performance between the postpartum depression (PPD) model and the general depression detection model. This research confirms the promise of multimodal data in improving AI's role in mental health diagnostics and support, offering a pathway to more comprehensive solutions. Bachelor's degree 2024-04-18T08:41:18Z 2024-04-18T08:41:18Z 2024 Final Year Project (FYP) Wong, K. J. Y. (2024). AI for social good. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/175028 https://hdl.handle.net/10356/175028 en SCSE23-0147 application/pdf Nanyang Technological University |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Computer and Information Science |
spellingShingle |
Computer and Information Science Wong, Kelly Jie Yin AI for social good |
description |
This study explores the effectiveness of diverse machine learning architectures in detecting depression, with an emphasis on postpartum depression identification and advanced sentiment analysis. We evaluated various Transformer-based models and identified RoBERTa as particularly adept at identifying depression, outperforming others across accuracy, precision, recall, and F1 metrics. Employing multi-task learning strategies, including hard and soft parameter sharing, we improved our models' diagnostic accuracy. Further, we utilized Large Language Models (LLMs) with zero-shot learning, few-shot prompting, and fine-tuning with LoRA adapters on targeted datasets, achieving notable performance enhancements. A practical application of our research is the fine-tuned chatbot we developed, which has shown potential as a mental health support tool. Our experiments also extended to multimodal approaches that combined textual, visual, and temporal data using Transformer Encoders. These multimodal models surpassed the performance of text-only models and text-image hybrid models. Our results demonstrate that integrating and optimizing various computational techniques significantly boosts the detection of depression indicators. Additionally, we conducted a basic analysis utilizing explainable AI methods such as the LIME explainer to contrast the performance between the postpartum depression (PPD) model and the general depression detection model. This research confirms the promise of multimodal data in improving AI's role in mental health diagnostics and support, offering a pathway to more comprehensive solutions. |
author2 |
Erik Cambria |
author_facet |
Erik Cambria Wong, Kelly Jie Yin |
format |
Final Year Project |
author |
Wong, Kelly Jie Yin |
author_sort |
Wong, Kelly Jie Yin |
title |
AI for social good |
title_short |
AI for social good |
title_full |
AI for social good |
title_fullStr |
AI for social good |
title_full_unstemmed |
AI for social good |
title_sort |
ai for social good |
publisher |
Nanyang Technological University |
publishDate |
2024 |
url |
https://hdl.handle.net/10356/175028 |
_version_ |
1814047018291560448 |