SANCTUARY: An Efficient Evidence-based Automated Fact Checking System

With the growing volume of misinformation online, automated fact-checking systems are becoming increasingly important.This paper presents SANCTUARY, an efficient pipeline for evidence-based verification of real-world claims.Our approach consists of three stages: Hypothetical Question & Passage Generation, a two-step Retrieval-Augmented Generation (RAG) hybrid evidence retrieval, and structured reasoning and prediction, which leverages two lightweight Large Language Models (LLMs).On the challenging AVeriTeC benchmark, our system achieves 25.27 points on the new AVeriTeC score (Ev2R recall), outperforming the previous state-of-the-art baseline by 5 absolute points (1.25 relative improvement).Sanctuary demonstrates that careful retrieval, reasoning strategies and well-integrated language models can substantially advance automated fact-checking performance.

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.fever-1.19
Citations
1
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
2.48

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SANCTUARY: An Efficient Evidence-based Automated Fact Checking System

Arbaaz Dharmavaram, Saqib Hakak
1 citations
Topic Modeling
2.48
article

SANCTUARY: An Efficient Evidence-based Automated Fact Checking System

Arbaaz Dharmavaram, Saqib Hakak
article en
1 citations

Abstract

With the growing volume of misinformation online, automated fact-checking systems are becoming increasingly important.This paper presents SANCTUARY, an efficient pipeline for evidence-based verification of real-world claims.Our approach consists of three stages: Hypothetical Question & Passage Generation, a two-step Retrieval-Augmented Generation (RAG) hybrid evidence retrieval, and structured reasoning and prediction, which leverages two lightweight Large Language Models (LLMs).On the challenging AVeriTeC benchmark, our system achieves 25.27 points on the new AVeriTeC score (Ev2R recall), outperforming the previous state-of-the-art baseline by 5 absolute points (1.25 relative improvement).Sanctuary demonstrates that careful retrieval, reasoning strategies and well-integrated language models can substantially advance automated fact-checking performance.

University of New Brunswick (CA)
Natural Sciences and Engineering Research Council of Canada
Climate action
Openalex Percentile: Top 9%
Topic Modeling
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

SANCTUARY: An Efficient Evidence-based Automated Fact Checking System — Arbaaz Dharmavaram, Saqib Hakak · (2025) | TGRS Research Map | TGRS