Mitigating Hallucinations in Large Language Models Using Retrieval-Augmented Generation and Knowledge Graphs: A Review

Large Language Models (LLMs) can produce fluent but factually incorrect statements, known as hallucinations, which limits their reliability in healthcare, law, education and other critical domains. This paper reviews methods that reduce hallucination by grounding generation in external knowledge. Retrieval-Augmented Generation (RAG) retrieves relevant passages at query time and conditions the model on them, while Knowledge Graphs (KGs) provide structured, verifiable facts and explicit relations that support multi-hop reasoning. The review explains dense passage retrieval, retrieval-augmented pre-training, graph-based RAG that summarizes communities of related entities, and reasoning that walks over knowledge-graph paths. It also covers evaluation, including truthfulness benchmarks and metrics for faithfulness, context relevance and answer relevance. A hybrid architecture is proposed that combines vector retrieval with knowledge-graph lookup, assembles grounded context, generates answers with citations and verifies claims before responding. Research gaps, objectives, a comparison of grounding strategies and challenges such as retrieval errors, outdated knowledge, graph construction cost and latency are discussed. The review concludes that combining unstructured retrieval with structured knowledge offers a practical route to more accurate and transparent LLM applications.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-07
DOI
https://doi.org/10.5281/zenodo.24037456
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Mitigating Hallucinations in Large Language Models Using Retrieval-Augmented Generation and Knowledge Graphs: A Review

Prof. S. K. Said, Prof. M. C. Kolse, Bankar Akshada Santosh
3 links
Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
article

Mitigating Hallucinations in Large Language Models Using Retrieval-Augmented Generation and Knowledge Graphs: A Review

Prof. S. K. Said, Prof. M. C. Kolse, Bankar Akshada Santosh
article en

Abstract

Large Language Models (LLMs) can produce fluent but factually incorrect statements, known as hallucinations, which limits their reliability in healthcare, law, education and other critical domains. This paper reviews methods that reduce hallucination by grounding generation in external knowledge. Retrieval-Augmented Generation (RAG) retrieves relevant passages at query time and conditions the model on them, while Knowledge Graphs (KGs) provide structured, verifiable facts and explicit relations that support multi-hop reasoning. The review explains dense passage retrieval, retrieval-augmented pre-training, graph-based RAG that summarizes communities of related entities, and reasoning that walks over knowledge-graph paths. It also covers evaluation, including truthfulness benchmarks and metrics for faithfulness, context relevance and answer relevance. A hybrid architecture is proposed that combines vector retrieval with knowledge-graph lookup, assembles grounded context, generates answers with citations and verifies claims before responding. Research gaps, objectives, a comparison of grounding strategies and challenges such as retrieval errors, outdated knowledge, graph construction cost and latency are discussed. The review concludes that combining unstructured retrieval with structured knowledge offers a practical route to more accurate and transparent LLM applications.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 19%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon