AI for social good

The objective of this project is to create a data pipeline system for identifying racist text, with the intention of promoting social good. The proposed system follows a pipelined approach, capable of collecting real-time tweets from Twitter and utilizing natural language processing (NLP) tech...

Full description

Saved in:
Bibliographic Details
Main Author: Ruan, Yang
Other Authors: Erik Cambria
Format: Final Year Project
Language:English
Published: Nanyang Technological University 2023
Subjects:
Online Access:https://hdl.handle.net/10356/166012
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:The objective of this project is to create a data pipeline system for identifying racist text, with the intention of promoting social good. The proposed system follows a pipelined approach, capable of collecting real-time tweets from Twitter and utilizing natural language processing (NLP) techniques to assign multiple labels such as subjectivity, polarity and intensity score and then identifying if the tweet is racist. Racism score can be obtained by a custom-built model based on transformers techniques with extra few features from knowledge base (SenticNet). The resulting data will be stored in a database for further analysis