Beyond Isolated Fixes: A Comprehensive Survey on Hallucination Mitigation with a Three-Dimensional Taxonomy and Integrative Framework

Hallucinations in large language and vision–language models constitute a persistent and systemic failure mode that fundamentally undermines their reliability in high-stakes applications. Rather than framing hallucination as a localized generation error, this paper reconceptualizes it as a lifecycle phenomenon—emerging from upstream deficiencies in data collection, reinforced by training-time biases, and exacerbated by inference-time decoding pathologies. To address this challenge, we propose a unified framework for hallucination mitigation grounded in a structured three-dimensional taxonomy that spans mechanism-based strategies, phase-specific interventions, and cross-phase integrative approaches. This taxonomy elucidates how technical solutions, knowledge-enhanced methods, and framework-level designs can be systematically orchestrated across pre-, in-, and post-generation stages to support more robust, interpretable, and auditable model behavior. Within this paradigm, detection is positioned not as a terminal task, but as a diagnostic backbone that enables adaptive and multi-stage mitigation workflows. Building on this foundation, we introduce an integrative hybrid framework that consolidates previously fragmented techniques into coherent pipelines, demonstrating how cross-phase synergy and iterative refinement can enhance reliability in real-world deployment. This framework further reveals latent connections across diverse strands of research, facilitating the identification of underexplored intersections and the development of synergistic method combinations. By reframing hallucination mitigation as a system-level challenge rather than a set of isolated fixes, this work offers both a theoretical lens and a practical roadmap for advancing the trustworthiness of generative AI systems.

Institutions

Publication Details

Published
2024-10-19
DOI
https://doi.org/10.1109/uv63228.2024.11189154
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Beyond Isolated Fixes: A Comprehensive Survey on Hallucination Mitigation with a Three-Dimensional Taxonomy and Integrative Framework

Adversarial Robustness in Machine Learning
article

Beyond Isolated Fixes: A Comprehensive Survey on Hallucination Mitigation with a Three-Dimensional Taxonomy and Integrative Framework

article en

Abstract

Hallucinations in large language and vision–language models constitute a persistent and systemic failure mode that fundamentally undermines their reliability in high-stakes applications. Rather than framing hallucination as a localized generation error, this paper reconceptualizes it as a lifecycle phenomenon—emerging from upstream deficiencies in data collection, reinforced by training-time biases, and exacerbated by inference-time decoding pathologies. To address this challenge, we propose a unified framework for hallucination mitigation grounded in a structured three-dimensional taxonomy that spans mechanism-based strategies, phase-specific interventions, and cross-phase integrative approaches. This taxonomy elucidates how technical solutions, knowledge-enhanced methods, and framework-level designs can be systematically orchestrated across pre-, in-, and post-generation stages to support more robust, interpretable, and auditable model behavior. Within this paradigm, detection is positioned not as a terminal task, but as a diagnostic backbone that enables adaptive and multi-stage mitigation workflows. Building on this foundation, we introduce an integrative hybrid framework that consolidates previously fragmented techniques into coherent pipelines, demonstrating how cross-phase synergy and iterative refinement can enhance reliability in real-world deployment. This framework further reveals latent connections across diverse strands of research, facilitating the identification of underexplored intersections and the development of synergistic method combinations. By reframing hallucination mitigation as a system-level challenge rather than a set of isolated fixes, this work offers both a theoretical lens and a practical roadmap for advancing the trustworthiness of generative AI systems.

Stevenson University (US), Amherst College (US), Chinese University of Hong Kong (HK), University of Massachusetts Amherst (US), Fudan University (CN), University of California San Diego (US), NIHR Imperial Biomedical Research Centre (GB), Imperial College London (GB), New York University (US)
Openalex Percentile: Top 42%
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.