Polarity and subjectivity detection with multitask learning and BERT embedding

In recent years, deep learning-based sentiment analysis has received attention mainly because of the rise of social media and e-commerce. In this paper, we showcase the fact that the polarity detection and subjectivity detection subtasks of sentiment analysis are inter-related. To this end, we propo...

Full description

Saved in:
Bibliographic Details
Main Authors: Satapathy, Ranjan, Pardeshi, Shweta Rajesh, Cambria, Erik
Other Authors: School of Computer Science and Engineering
Format: Article
Language:English
Published: 2023
Subjects:
Online Access:https://hdl.handle.net/10356/168631
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-168631
record_format dspace
spelling sg-ntu-dr.10356-1686312023-06-16T15:36:18Z Polarity and subjectivity detection with multitask learning and BERT embedding Satapathy, Ranjan Pardeshi, Shweta Rajesh Cambria, Erik School of Computer Science and Engineering Engineering::Computer science and engineering Multitask Learning Polarity Detection In recent years, deep learning-based sentiment analysis has received attention mainly because of the rise of social media and e-commerce. In this paper, we showcase the fact that the polarity detection and subjectivity detection subtasks of sentiment analysis are inter-related. To this end, we propose a knowledge-sharing-based multitask learning framework. To ensure high-quality knowledge sharing between the tasks, we use the Neural Tensor Network, which consists of a bilinear tensor layer that links the two entity vectors. We show that BERT-based embedding with our MTL framework outperforms the baselines and achieves a new state-of-the-art status in multitask learning. Our framework shows that the information across datasets for related tasks can be helpful for understanding task-specific features. Published version 2023-06-12T08:19:07Z 2023-06-12T08:19:07Z 2022 Journal Article Satapathy, R., Pardeshi, S. R. & Cambria, E. (2022). Polarity and subjectivity detection with multitask learning and BERT embedding. Future Internet, 14(7), 191-. https://dx.doi.org/10.3390/fi14070191 1999-5903 https://hdl.handle.net/10356/168631 10.3390/fi14070191 2-s2.0-85133200897 7 14 191 en Future Internet © 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering
Multitask Learning
Polarity Detection
spellingShingle Engineering::Computer science and engineering
Multitask Learning
Polarity Detection
Satapathy, Ranjan
Pardeshi, Shweta Rajesh
Cambria, Erik
Polarity and subjectivity detection with multitask learning and BERT embedding
description In recent years, deep learning-based sentiment analysis has received attention mainly because of the rise of social media and e-commerce. In this paper, we showcase the fact that the polarity detection and subjectivity detection subtasks of sentiment analysis are inter-related. To this end, we propose a knowledge-sharing-based multitask learning framework. To ensure high-quality knowledge sharing between the tasks, we use the Neural Tensor Network, which consists of a bilinear tensor layer that links the two entity vectors. We show that BERT-based embedding with our MTL framework outperforms the baselines and achieves a new state-of-the-art status in multitask learning. Our framework shows that the information across datasets for related tasks can be helpful for understanding task-specific features.
author2 School of Computer Science and Engineering
author_facet School of Computer Science and Engineering
Satapathy, Ranjan
Pardeshi, Shweta Rajesh
Cambria, Erik
format Article
author Satapathy, Ranjan
Pardeshi, Shweta Rajesh
Cambria, Erik
author_sort Satapathy, Ranjan
title Polarity and subjectivity detection with multitask learning and BERT embedding
title_short Polarity and subjectivity detection with multitask learning and BERT embedding
title_full Polarity and subjectivity detection with multitask learning and BERT embedding
title_fullStr Polarity and subjectivity detection with multitask learning and BERT embedding
title_full_unstemmed Polarity and subjectivity detection with multitask learning and BERT embedding
title_sort polarity and subjectivity detection with multitask learning and bert embedding
publishDate 2023
url https://hdl.handle.net/10356/168631
_version_ 1772826279587872768