Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating

This dissertation explores feature fusion by combining RoBERTa and Knowledge Graph (KG) techniques using Gated Units to improve the accuracy of fake news detection. In text processing, RoBERTa model is able to understand and classify false content effectively due to its pre-training advantage. On th...

Full description

Saved in:
Bibliographic Details
Main Author: Fang, Zhuohao
Other Authors: Na Jin Cheon
Format: Thesis-Master by Coursework
Language:English
Published: Nanyang Technological University 2024
Subjects:
Online Access:https://hdl.handle.net/10356/181597
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-181597
record_format dspace
spelling sg-ntu-dr.10356-1815972024-12-15T15:36:30Z Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating Fang, Zhuohao Na Jin Cheon Wee Kim Wee School of Communication and Information TJCNa@ntu.edu.sg Computer and Information Science Fake news detection RoBERTa Knowledge graph Feature fusion Gated units This dissertation explores feature fusion by combining RoBERTa and Knowledge Graph (KG) techniques using Gated Units to improve the accuracy of fake news detection. In text processing, RoBERTa model is able to understand and classify false content effectively due to its pre-training advantage. On the other hand, knowledge graphs provide rich semantic information in revealing the entities and relationships behind news content, which is crucial for verifying news authenticity. Firstly, this study trains and evaluates the model using the PHEME dataset, and compares the effects of using RoBERTa alone, the knowledge graph alone (processed by TF-IDF and graph neural network (GNN) methods), and their fusion effects. The results show that RoBERTa has the highest accuracy when used alone, emphasizing the power of the pre-trained model for textual semantic understanding. However, when knowledge graph processing is introduced, especially through the GNN approach, it is able to provide a deeper understanding of entity relationships despite longer processing times, which in some cases contributes to improved detection accuracy. Through comparative experiments, this paper confirms the effectiveness of feature fusion strategies in fake news detection and explores the trade-offs between different feature processing methods. In addition, this study points out the limitations of the current approach in terms of data diversity and model generalization, providing directions for improvement in future research. Overall, This dissertation proposes an innovative feature fusion framework that combines features from the text after processing by a pre-trained model (Roberta) and external knowledge from the Knowledge Graph to improve the performance of fake news detection; investigates the Knowledge Graph feature extraction method and improves the utilization of external knowledge by constructing a new graph structure; explores feature fusion strategies and uses the gating unit to improve the ability of model feature fusion. Through these contributions, this research provides new ideas and directions for the field of fake news detection. Master's degree 2024-12-10T07:23:41Z 2024-12-10T07:23:41Z 2024 Thesis-Master by Coursework Fang, Z. (2024). Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/181597 https://hdl.handle.net/10356/181597 en application/pdf Nanyang Technological University
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Computer and Information Science
Fake news detection
RoBERTa
Knowledge graph
Feature fusion
Gated units
spellingShingle Computer and Information Science
Fake news detection
RoBERTa
Knowledge graph
Feature fusion
Gated units
Fang, Zhuohao
Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating
description This dissertation explores feature fusion by combining RoBERTa and Knowledge Graph (KG) techniques using Gated Units to improve the accuracy of fake news detection. In text processing, RoBERTa model is able to understand and classify false content effectively due to its pre-training advantage. On the other hand, knowledge graphs provide rich semantic information in revealing the entities and relationships behind news content, which is crucial for verifying news authenticity. Firstly, this study trains and evaluates the model using the PHEME dataset, and compares the effects of using RoBERTa alone, the knowledge graph alone (processed by TF-IDF and graph neural network (GNN) methods), and their fusion effects. The results show that RoBERTa has the highest accuracy when used alone, emphasizing the power of the pre-trained model for textual semantic understanding. However, when knowledge graph processing is introduced, especially through the GNN approach, it is able to provide a deeper understanding of entity relationships despite longer processing times, which in some cases contributes to improved detection accuracy. Through comparative experiments, this paper confirms the effectiveness of feature fusion strategies in fake news detection and explores the trade-offs between different feature processing methods. In addition, this study points out the limitations of the current approach in terms of data diversity and model generalization, providing directions for improvement in future research. Overall, This dissertation proposes an innovative feature fusion framework that combines features from the text after processing by a pre-trained model (Roberta) and external knowledge from the Knowledge Graph to improve the performance of fake news detection; investigates the Knowledge Graph feature extraction method and improves the utilization of external knowledge by constructing a new graph structure; explores feature fusion strategies and uses the gating unit to improve the ability of model feature fusion. Through these contributions, this research provides new ideas and directions for the field of fake news detection.
author2 Na Jin Cheon
author_facet Na Jin Cheon
Fang, Zhuohao
format Thesis-Master by Coursework
author Fang, Zhuohao
author_sort Fang, Zhuohao
title Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating
title_short Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating
title_full Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating
title_fullStr Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating
title_full_unstemmed Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating
title_sort fake news detection through feature fusion: leveraging roberta and knowledge graphs with gating
publisher Nanyang Technological University
publishDate 2024
url https://hdl.handle.net/10356/181597
_version_ 1819113069094109184