AI for social good
The objective of this project is to create a data pipeline system for identifying racist text, with the intention of promoting social good. The proposed system follows a pipelined approach, capable of collecting real-time tweets from Twitter and utilizing natural language processing (NLP) tech...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Final Year Project |
Language: | English |
Published: |
Nanyang Technological University
2023
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/166012 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
Summary: | The objective of this project is to create a data pipeline system for identifying racist text, with
the intention of promoting social good. The proposed system follows a pipelined approach,
capable of collecting real-time tweets from Twitter and utilizing natural language processing
(NLP) techniques to assign multiple labels such as subjectivity, polarity and intensity score
and then identifying if the tweet is racist. Racism score can be obtained by a custom-built
model based on transformers techniques with extra few features from knowledge base
(SenticNet). The resulting data will be stored in a database for further analysis |
---|