Large Language Models for Multimodal Fact-Checking: Methodological Advances and Persistent Challenges

Fact-checking aims to assign truth values to claims within a specified context. Unimodal fact-checking methods, due to modality fragmentation and inadequate adaptiveness, struggle in complex scenarios where multimodal misinformation is interconnected. The rapid advancement of generative large language models (LLMs) has provided a novel technological paradigm for multimodal fact-checking. With their capabilities in deep semantic understanding and cross-modal alignment, LLMs can significantly enhance the accuracy, interpretability, and generalizability of misinformation detection. Synthesizing representative studies from 2018 to 2026 retrieved via a multi-dimensional keyword search, two-step screening, and citation chaining, we comprehensively survey the subtask arrangements, LLM-based methodologies, and relevant datasets for both unimodal and multimodal fact-checking tasks. Following the standard fact-checking pipeline, we comprehensively review existing methods across four key stages, namely Claim Detection and Extraction, Evidence Retrieval, Verdict Prediction, and Justification Production, providing a structured perspective for method comparison and evaluation. Our synthesis indicates that while multimodal large language models (MLLMs) enhance cross-modal understanding and verification flexibility, fine-grained visual–textual consistency and evidential sufficiency remain critical challenges. We provide a comprehensive survey of fact-checking research and offer insights into the development of next-generation fact-checking systems expected to be more robust, scalable, and adaptable across diverse information environments.

Authors

Institutions

Publication Details

Journal
Mathematics
Published
2026-11-18
DOI
https://doi.org/10.3390/math14224243
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Large Language Models for Multimodal Fact-Checking: Methodological Advances and Persistent Challenges

Zongzhe Wang, Zexuan Zhu, Xiongnan Jin, Qingcai Chen et al.
1 links
Mathematics
Misinformation and Its Impacts
article

Large Language Models for Multimodal Fact-Checking: Methodological Advances and Persistent Challenges

Zongzhe Wang, Zexuan Zhu, Xiongnan Jin, Qingcai Chen, Tiantian Zhu, Yumeng Liu, Jianqiang Li, Jun Zhang
article en

Abstract

Fact-checking aims to assign truth values to claims within a specified context. Unimodal fact-checking methods, due to modality fragmentation and inadequate adaptiveness, struggle in complex scenarios where multimodal misinformation is interconnected. The rapid advancement of generative large language models (LLMs) has provided a novel technological paradigm for multimodal fact-checking. With their capabilities in deep semantic understanding and cross-modal alignment, LLMs can significantly enhance the accuracy, interpretability, and generalizability of misinformation detection. Synthesizing representative studies from 2018 to 2026 retrieved via a multi-dimensional keyword search, two-step screening, and citation chaining, we comprehensively survey the subtask arrangements, LLM-based methodologies, and relevant datasets for both unimodal and multimodal fact-checking tasks. Following the standard fact-checking pipeline, we comprehensively review existing methods across four key stages, namely Claim Detection and Extraction, Evidence Retrieval, Verdict Prediction, and Justification Production, providing a structured perspective for method comparison and evaluation. Our synthesis indicates that while multimodal large language models (MLLMs) enhance cross-modal understanding and verification flexibility, fine-grained visual–textual consistency and evidential sufficiency remain critical challenges. We provide a comprehensive survey of fact-checking research and offer insights into the development of next-generation fact-checking systems expected to be more robust, scalable, and adaptable across diverse information environments.

MathematicsVol. 14(22)
Shenzhen University (CN), Harbin Institute of Technology (CN), Shenzhen Technology University (CN)
National Natural Science Foundation of China, Basic and Applied Basic Research Foundation of Guangdong Province
Misinformation and Its Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon