Multimodal misinformation detection by learning from synthetic data with multimodal LLMs

• Main Authors: ZENG, Fengzhu, LI, Wenqian, GAO, Wei, PANG, Yan
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2024
• Subjects: Databases and Information Systems
• Online Access: https://ink.library.smu.edu.sg/sis_research/9879; https://ink.library.smu.edu.sg/context/sis_research/article/10879/viewcontent/2024.findings_emnlp.613.pdf
• Institution: Singapore Management University

Detecting multimodal misinformation, especially in the form of image-text pairs, is crucial. Obtaining large-scale, high-quality real-world fact-checking datasets for training detectors is costly, leading researchers to use synthetic datasets generated by AI technologies. However, the generalizabili...