GraphCheck: Breaking Long-Term Text Barriers with Extracted Knowledge Graph-Powered Fact-Checking
Large language models (LLMs) are widely used, but they often generate subtle factual errors, especially in long-form text. These errors are fatal in some specialized domains such as medicine. Existing fact-checking with grounding documents methods face two main challenges: (1) they struggle to understand complex multihop relations in long documents, often overlooking subtle factual errors; (2) most specialized methods rely on pairwise comparisons, requiring multiple model calls, leading to high resource and computational costs. To address these challenges, we propose <b><i>GraphCheck</i></b> , a fact-checking framework that uses extracted knowledge graphs to enhance text representation. Graph Neural Networks further process these graphs as a soft prompt, enabling LLMs to incorporate structured knowledge more effectively. Enhanced with graph-based reasoning, GraphCheck captures multihop reasoning chains that are often overlooked by existing methods, enabling precise and efficient fact-checking in a single inference call. Experimental results on seven benchmarks spanning both general and medical domains demonstrate up to a 7.1% overall improvement over baseline models. Notably, GraphCheck outperforms existing specialized fact-checkers and achieves comparable performance with state-of-the-art LLMs, such as DeepSeek-V3 and OpenAI-o1, with significantly fewer parameters.
Authors
- Pengyuan Zhou (ORCID: https://orcid.org/0000-0002-7909-4059)
- Yinhong Liu (ORCID: https://orcid.org/0009-0006-6723-0558)
- Ying Fu (ORCID: https://orcid.org/0000-0003-1177-0871)
- Qingyu Chen (ORCID: https://orcid.org/0000-0002-6036-1516)
- Jingyi Xie (ORCID: https://orcid.org/0000-0002-2753-2360)
- Han Yuan (ORCID: https://orcid.org/0000-0003-2842-9725)
- James Caverlee (ORCID: https://orcid.org/0000-0001-8350-8528)
- Haoran Liu (ORCID: https://orcid.org/0000-0003-0729-4526)
- Irene Li (ORCID: https://orcid.org/0000-0002-1851-5390)
- Rui Yang (ORCID: https://orcid.org/0009-0006-0597-7197)
- Yingjian Chen (ORCID: https://orcid.org/0000-0001-7605-357X)
Institutions
- Aarhus University (DK)
- University of Cambridge (GB)
- Mitchell Institute (US)
- Yale University (US)
- Duke-NUS Medical School (SG)
- The University of Tokyo (JP)
- Texas A&M University (US)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.729
- Citations
- 1
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 2.48
Funders
- Nvidia
- National Institutes of Health
- Japan Society for the Promotion of Science
- U.S. National Library of Medicine
- ACT-X