Large Language Models for Multimodal Fact-Checking: Methodological Advances and Persistent Challenges
Fact-checking aims to assign truth values to claims within a specified context. Unimodal fact-checking methods, due to modality fragmentation and inadequate adaptiveness, struggle in complex scenarios where multimodal misinformation is interconnected. The rapid advancement of generative large language models (LLMs) has provided a novel technological paradigm for multimodal fact-checking. With their capabilities in deep semantic understanding and cross-modal alignment, LLMs can significantly enhance the accuracy, interpretability, and generalizability of misinformation detection. Synthesizing representative studies from 2018 to 2026 retrieved via a multi-dimensional keyword search, two-step screening, and citation chaining, we comprehensively survey the subtask arrangements, LLM-based methodologies, and relevant datasets for both unimodal and multimodal fact-checking tasks. Following the standard fact-checking pipeline, we comprehensively review existing methods across four key stages, namely Claim Detection and Extraction, Evidence Retrieval, Verdict Prediction, and Justification Production, providing a structured perspective for method comparison and evaluation. Our synthesis indicates that while multimodal large language models (MLLMs) enhance cross-modal understanding and verification flexibility, fine-grained visual–textual consistency and evidential sufficiency remain critical challenges. We provide a comprehensive survey of fact-checking research and offer insights into the development of next-generation fact-checking systems expected to be more robust, scalable, and adaptable across diverse information environments.
Authors
- Zongzhe Wang (ORCID: https://orcid.org/0009-0000-1883-7237)
- Zexuan Zhu (ORCID: https://orcid.org/0000-0001-8479-6904)
- Xiongnan Jin (ORCID: https://orcid.org/0000-0001-5080-1883)
- Qingcai Chen (ORCID: https://orcid.org/0000-0001-8473-7293)
- Tiantian Zhu (ORCID: https://orcid.org/0000-0002-5470-8309)
- Yumeng Liu
- Jianqiang Li
- Jun Zhang
Institutions
- Shenzhen University (CN)
- Harbin Institute of Technology (CN)
- Shenzhen Technology University (CN)
Publication Details
- Journal
- Mathematics
- Published
- 2026-11-18
- DOI
- https://doi.org/10.3390/math14224243
- Primary Topic
- Misinformation and Its Impacts
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Basic and Applied Basic Research Foundation of Guangdong Province