Towards low-resource rumor detection: Unified contrastive transfer with propagation structure

The truth is significantly hampered by massive rumors that spread along with breaking news or popular topics. Since there is sufficient corpus gathered from the same domain for model training, existing rumor detection algorithms show promising performance on yesterday's news. However, due to a...

Full description

Saved in:
Bibliographic Details
Main Authors: LIN, Hongzhan, MA, Jing, YANG, Ruichao, YANG, Zhiwei, CHENG, Mingfei
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2024
Subjects:
Online Access:https://ink.library.smu.edu.sg/sis_research/8731
https://ink.library.smu.edu.sg/context/sis_research/article/9734/viewcontent/Low_resourceRumourDetection_av.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
id sg-smu-ink.sis_research-9734
record_format dspace
spelling sg-smu-ink.sis_research-97342024-04-18T07:27:28Z Towards low-resource rumor detection: Unified contrastive transfer with propagation structure LIN, Hongzhan MA, Jing YANG, Ruichao YANG, Zhiwei CHENG, Mingfei The truth is significantly hampered by massive rumors that spread along with breaking news or popular topics. Since there is sufficient corpus gathered from the same domain for model training, existing rumor detection algorithms show promising performance on yesterday's news. However, due to a lack of substantial training data and prior expert knowledge, they are poor at spotting rumors concerning unforeseen events, especially those propagated in different languages (i.e., low-resource regimes). In this paper, we propose a simple yet effective framework with unified contrastive transfer learning, to detect rumors by adapting the features learned from well-resourced rumor data to that of the low-resourced with only few-shot annotations. More specifically, we first represent rumor circulated on social media as an undirected topology for enhancing the interaction of user opinions, and then train the propagation-structured model via a unified contrastive paradigm to mine effective clues simultaneously from both post semantics and propagation structure. Our model explicitly breaks the barriers of the domain and/or language issues, via language alignment and a novel domain-adaptive contrastive learning mechanism. To well-generalize the representation learning using a small set of annotated target events, we reveal that rumor-indicative signal is closely correlated with the uniformity of the distribution of these events. We design a target-wise contrastive training mechanism with three event-level data augmentation strategies, capable of unifying the representations by distinguishing target events. Extensive experiments conducted on four low-resource datasets collected from real-world microblog platforms demonstrate that our framework achieves much better performance than state-of-the-art methods and exhibits a superior capacity for detecting rumors at early stages. 2024-04-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/8731 info:doi/10.1016/j.neucom.2024.127438 https://ink.library.smu.edu.sg/context/sis_research/article/9734/viewcontent/Low_resourceRumourDetection_av.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Contrastive learning Few-shot transfer Low resource Propagation structure Rumor detection Theory and Algorithms
institution Singapore Management University
building SMU Libraries
continent Asia
country Singapore
Singapore
content_provider SMU Libraries
collection InK@SMU
language English
topic Contrastive learning
Few-shot transfer
Low resource
Propagation structure
Rumor detection
Theory and Algorithms
spellingShingle Contrastive learning
Few-shot transfer
Low resource
Propagation structure
Rumor detection
Theory and Algorithms
LIN, Hongzhan
MA, Jing
YANG, Ruichao
YANG, Zhiwei
CHENG, Mingfei
Towards low-resource rumor detection: Unified contrastive transfer with propagation structure
description The truth is significantly hampered by massive rumors that spread along with breaking news or popular topics. Since there is sufficient corpus gathered from the same domain for model training, existing rumor detection algorithms show promising performance on yesterday's news. However, due to a lack of substantial training data and prior expert knowledge, they are poor at spotting rumors concerning unforeseen events, especially those propagated in different languages (i.e., low-resource regimes). In this paper, we propose a simple yet effective framework with unified contrastive transfer learning, to detect rumors by adapting the features learned from well-resourced rumor data to that of the low-resourced with only few-shot annotations. More specifically, we first represent rumor circulated on social media as an undirected topology for enhancing the interaction of user opinions, and then train the propagation-structured model via a unified contrastive paradigm to mine effective clues simultaneously from both post semantics and propagation structure. Our model explicitly breaks the barriers of the domain and/or language issues, via language alignment and a novel domain-adaptive contrastive learning mechanism. To well-generalize the representation learning using a small set of annotated target events, we reveal that rumor-indicative signal is closely correlated with the uniformity of the distribution of these events. We design a target-wise contrastive training mechanism with three event-level data augmentation strategies, capable of unifying the representations by distinguishing target events. Extensive experiments conducted on four low-resource datasets collected from real-world microblog platforms demonstrate that our framework achieves much better performance than state-of-the-art methods and exhibits a superior capacity for detecting rumors at early stages.
format text
author LIN, Hongzhan
MA, Jing
YANG, Ruichao
YANG, Zhiwei
CHENG, Mingfei
author_facet LIN, Hongzhan
MA, Jing
YANG, Ruichao
YANG, Zhiwei
CHENG, Mingfei
author_sort LIN, Hongzhan
title Towards low-resource rumor detection: Unified contrastive transfer with propagation structure
title_short Towards low-resource rumor detection: Unified contrastive transfer with propagation structure
title_full Towards low-resource rumor detection: Unified contrastive transfer with propagation structure
title_fullStr Towards low-resource rumor detection: Unified contrastive transfer with propagation structure
title_full_unstemmed Towards low-resource rumor detection: Unified contrastive transfer with propagation structure
title_sort towards low-resource rumor detection: unified contrastive transfer with propagation structure
publisher Institutional Knowledge at Singapore Management University
publishDate 2024
url https://ink.library.smu.edu.sg/sis_research/8731
https://ink.library.smu.edu.sg/context/sis_research/article/9734/viewcontent/Low_resourceRumourDetection_av.pdf
_version_ 1814047496343650304