From Hallucination to Precision: A Longitudinal Analysis of Reference Accuracy and Plagiarism in AI-Generated Medical Literature (2024–2026)

This study aims to evaluate the longitudinal development of general-purpose and specialized artificial intelligence tools in terms of reliability in academic writing and citation accuracy. Eight platforms (ChatGPT, Gemini, QuillBot, Claude, Microsoft Copilot, Elicit, Consensus, and SciSpace) were analyzed using five standardized medical prompts in November 2024 and January 2026. The generated introductions were assessed for reference authenticity using PubMed, Google Scholar, and Web of Science, and for plagiarism using iThenticate. Findings revealed that in November 2024, general-purpose Large Language Models exhibited high hallucination rates, with ChatGPT and Claude providing zero authentic references for certain prompts. Conversely, specialized academic tools like Elicit and SciSpace maintained near-perfect accuracy from the outset. By January 2026, a dramatic improvement was observed, with general-purpose tools like ChatGPT achieving 100% reference accuracy across all categories. Although plagiarism rates were typically below 15%, Gemini recorded a peak of 45% in 2024 before stabilizing. Specialized tools demonstrated superior capacity to manage larger citation volumes, such as SciSpace, which provided 31 verified references in a single output in 2026. While both general and specialized tools have matured significantly, researchers should still exercise caution and use verification protocols. The results indicate that artificial intelligence tools have rapidly transitioned from being prone to academic hallucinations to becoming highly reliable instruments for scholarly literature synthesis.

Authors

Institutions

Publication Details

Journal
Uludağ Üniversitesi Tıp Fakültesi Dergisi
Published
2026-03-17
DOI
https://doi.org/10.32708/uutfd.1870116
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

From Hallucination to Precision: A Longitudinal Analysis of Reference Accuracy and Plagiarism in AI-Generated Medical Literature (2024–2026)

Alper Vatansever, Mevlüt Okan Aydin, Sezer Erer Kafa
Uludağ Üniversitesi Tıp Fakültesi Dergisi
Artificial Intelligence in Healthcare and Education
article

From Hallucination to Precision: A Longitudinal Analysis of Reference Accuracy and Plagiarism in AI-Generated Medical Literature (2024–2026)

Alper Vatansever, Mevlüt Okan Aydin, Sezer Erer Kafa
article en

Abstract

This study aims to evaluate the longitudinal development of general-purpose and specialized artificial intelligence tools in terms of reliability in academic writing and citation accuracy. Eight platforms (ChatGPT, Gemini, QuillBot, Claude, Microsoft Copilot, Elicit, Consensus, and SciSpace) were analyzed using five standardized medical prompts in November 2024 and January 2026. The generated introductions were assessed for reference authenticity using PubMed, Google Scholar, and Web of Science, and for plagiarism using iThenticate. Findings revealed that in November 2024, general-purpose Large Language Models exhibited high hallucination rates, with ChatGPT and Claude providing zero authentic references for certain prompts. Conversely, specialized academic tools like Elicit and SciSpace maintained near-perfect accuracy from the outset. By January 2026, a dramatic improvement was observed, with general-purpose tools like ChatGPT achieving 100% reference accuracy across all categories. Although plagiarism rates were typically below 15%, Gemini recorded a peak of 45% in 2024 before stabilizing. Specialized tools demonstrated superior capacity to manage larger citation volumes, such as SciSpace, which provided 31 verified references in a single output in 2026. While both general and specialized tools have matured significantly, researchers should still exercise caution and use verification protocols. The results indicate that artificial intelligence tools have rapidly transitioned from being prone to academic hallucinations to becoming highly reliable instruments for scholarly literature synthesis.

Uludağ Üniversitesi Tıp Fakültesi DergisiVol. 52
Bursa Uludağ Üni̇versi̇tesi̇ (TR)
Quality Education
Openalex Percentile: Top 22%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.