CARAG: A Context-Aware Retrieval Framework for Fact Verification, Integrating Local and Global Perspectives of Explainable AI
This study introduces an explainable framework for Automated Fact Verification (AFV) systems, integrating a novel Context-Aware Retrieval and Explanation Generation (CARAG) methodology. CARAG enhances evidence retrieval by leveraging thematic embeddings derived from a Subset of Interest (SOI, a focused subset of the fact-verification dataset) to integrate local and global perspectives. The retrieval process combines these thematic embeddings with claim-specific vectors to refine evidence selection. Retrieved evidence is integrated into an explanation-generation pipeline employing a Large Language Model (LLM) in a zero-shot paradigm, ensuring alignment with topic-based thematic contexts. The SOI and its derived thematic embeddings, supported by a visualized SOI graph, provide transparency into the retrieval process and promote explainability in AI by outlining evidence-selection rationale. CARAG is evaluated using FactVer, a novel explanation-focused dataset curated to enhance AFV transparency. Comparative analysis with standard Retrieval-Augmented Generation (RAG) demonstrates CARAG’s effectiveness in generating contextually aligned explanations, underscoring its potential to advance explainable AFV frameworks.
Authors
- Héctor Allende‐Cid (ORCID: https://orcid.org/0000-0003-3047-8817)
- Weiqi Yan (ORCID: https://orcid.org/0000-0002-7443-3285)
- Parma Nand (ORCID: https://orcid.org/0000-0001-6853-017X)
- Manju Vallayil (ORCID: https://orcid.org/0000-0003-1962-8837)
- Thamilini Vamathevan
Institutions
- Pontificia Universidad Católica de Valparaíso (CL)
- Auckland University of Technology (NZ)
- Fraunhofer Institute for Intelligent Analysis and Information Systems (DE)
- Lamarr Institute for Machine Learning and Artificial Intelligence
Publication Details
- Journal
- Applied Sciences
- Published
- 2025-02-13
- DOI
- https://doi.org/10.3390/app15041970
- Citations
- 2
- Primary Topic
- Explainable Artificial Intelligence (XAI)
- Type
- article
- Field-Weighted Citation Impact
- 4.96
Funders
- Auckland University of Technology, New Zealand
- Division of Mathematical Sciences