AN EXPLAINABLE AI FRAMEWORK FOR RELIABLE DETECTION AND MITIGATION OF HALLUCINATIONS IN LARGE LANGUAGE MODELS

Large Language Models (LLMs) have demonstrated remarkable capabilities in text generation, yet their tendency to produce hallucinated content-factually incorrect, unverifiable, or inconsistent information-poses a critical barrier to deployment in high-stakes domains.Existing detection methods often operate as black boxes, providing binary labels without interpretable evidence, which undermines trust and corrective action.This paper proposes XAI-HalluGuard, a five-layer explainable AI framework for reliable detection and mitigation of hallucinations.The framework integrates self-consistency sampling, natural language inference-based entailment checking, semantic entropy estimation, retrieval-augmented verification, and token-level explainability using SHAP and attention attribution.We evaluate the system on four benchmarks: TruthfulQA, HaluEval, FEVER, and WikiBio, covering both intrinsic and extrinsic hallucinations.Experimental results show that our framework achieves 89.3% F1-score in detection and reduces hallucination rate by 62.4% relative to baseline LLMs, outperforming SelfCheckGPT, CoVe, and retrieval-only methods.Ablation studies confirm that each layer contributes uniquely, with entailment and entropy being most critical.Furthermore, explainability analysis reveals that hallucinated spans exhibit higher attribution variance and low grounding scores, enabling human-interpretable mitigation.Our work advances trustworthy AI by bridging detection accuracy with transparent reasoning.

Publication Details

Journal
International Journal of Progressive Research in Engineering Management and Science
Published
2026-11-06
DOI
https://doi.org/10.58257/ijprems55019
Primary Topic
Explainable Artificial Intelligence (XAI)
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

AN EXPLAINABLE AI FRAMEWORK FOR RELIABLE DETECTION AND MITIGATION OF HALLUCINATIONS IN LARGE LANGUAGE MODELS

2 links
International Journal of Progressive Research in Engineering Management and Science
Explainable Artificial Intelligence (XAI)
article

AN EXPLAINABLE AI FRAMEWORK FOR RELIABLE DETECTION AND MITIGATION OF HALLUCINATIONS IN LARGE LANGUAGE MODELS

article en

Abstract

Large Language Models (LLMs) have demonstrated remarkable capabilities in text generation, yet their tendency to produce hallucinated content-factually incorrect, unverifiable, or inconsistent information-poses a critical barrier to deployment in high-stakes domains.Existing detection methods often operate as black boxes, providing binary labels without interpretable evidence, which undermines trust and corrective action.This paper proposes XAI-HalluGuard, a five-layer explainable AI framework for reliable detection and mitigation of hallucinations.The framework integrates self-consistency sampling, natural language inference-based entailment checking, semantic entropy estimation, retrieval-augmented verification, and token-level explainability using SHAP and attention attribution.We evaluate the system on four benchmarks: TruthfulQA, HaluEval, FEVER, and WikiBio, covering both intrinsic and extrinsic hallucinations.Experimental results show that our framework achieves 89.3% F1-score in detection and reduces hallucination rate by 62.4% relative to baseline LLMs, outperforming SelfCheckGPT, CoVe, and retrieval-only methods.Ablation studies confirm that each layer contributes uniquely, with entailment and entropy being most critical.Furthermore, explainability analysis reveals that hallucinated spans exhibit higher attribution variance and low grounding scores, enabling human-interpretable mitigation.Our work advances trustworthy AI by bridging detection accuracy with transparent reasoning.

International Journal of Progressive Research in Engineering Management and Science
Openalex Percentile: Top 19%
Explainable Artificial Intelligence (XAI)
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon