Hallucinations in Large Language Models: Challenges and Mitigation Approaches

Large language models - like GPT-3.5, GPT-4, LLaMA, or PaLM - have changed artificial intelligence fast; they write smooth, contextsensitive text now. They power things such as chatbots, school helpers, writing aids, legal review tools, even health advice apps. Still, these systems face a big flaw: hallucination - that’s when they say false stuff, make up facts, or give illogical answers but sound sure about it. Because of this, people can’t always rely on them, particularly where mistakes matter most - say, medicine, classrooms, courts. This paper looks into what hallucinations are, along with different kinds you might see. It digs into why they happen - like skewed data, guesswork in predictions, or missing real-world ties. A range of fixes gets reviewed, including pulling facts during output (RAG), learning from user feedback (RLHF), checking claims before sharing, and adjusting models for specific topics. In the end, it’s clear we won’t wipe them out entirely, though mixing methods helps a lot - tapping outside info, tweaking prompts smartly, using people in the loop, plus solid testing standards.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-10
DOI
https://doi.org/10.5281/zenodo.22685479
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Hallucinations in Large Language Models: Challenges and Mitigation Approaches

Pranav RH, Thanmay HT
Zenodo (CERN European Organization for Nuclear Research)
Artificial Intelligence in Healthcare and Education
article

Hallucinations in Large Language Models: Challenges and Mitigation Approaches

Pranav RH, Thanmay HT
article en

Abstract

Large language models - like GPT-3.5, GPT-4, LLaMA, or PaLM - have changed artificial intelligence fast; they write smooth, contextsensitive text now. They power things such as chatbots, school helpers, writing aids, legal review tools, even health advice apps. Still, these systems face a big flaw: hallucination - that’s when they say false stuff, make up facts, or give illogical answers but sound sure about it. Because of this, people can’t always rely on them, particularly where mistakes matter most - say, medicine, classrooms, courts. This paper looks into what hallucinations are, along with different kinds you might see. It digs into why they happen - like skewed data, guesswork in predictions, or missing real-world ties. A range of fixes gets reviewed, including pulling facts during output (RAG), learning from user feedback (RLHF), checking claims before sharing, and adjusting models for specific topics. In the end, it’s clear we won’t wipe them out entirely, though mixing methods helps a lot - tapping outside info, tweaking prompts smartly, using people in the loop, plus solid testing standards.

Zenodo (CERN European Organization for Nuclear Research)
Quality Education
Openalex Percentile: Top 14%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.