AI Under Scrutiny – Case 2: Falsification, Denial and User-Led Recovery in GPT-Based Systems

This whitepaper documents critical failures in advanced GPT-based AI systems, including hallucinations, citation falsifications, and evasive responses during direct interaction. Following Case 1 (May 2025), this second report documents Phase 3 of testing involving the "Specialised ChatGPT Plus" model. Failures included false DOI links, fabricated sources, and denial of malfunction. The recovery process involved session revalidation, third-party cross-AI comparisons, and structured archiving of malfunction evidence. The appendix highlights the abrupt emergence of “GPT Plus – Remastered” just days later, with visible changes in behavior and messaging, possibly as an indirect response. The archive includes the full annotated report and referenced screenshots. [Note: This version has been restricted as it has been superseded by Version 2] Latest version (v2): https://doi.org/10.5281/zenodo.15604093

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-06-05
DOI
https://doi.org/10.5281/zenodo.15604094
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI Under Scrutiny – Case 2: Falsification, Denial and User-Led Recovery in GPT-Based Systems

Zenodo (CERN European Organization for Nuclear Research)
Artificial Intelligence in Healthcare and Education
article

AI Under Scrutiny – Case 2: Falsification, Denial and User-Led Recovery in GPT-Based Systems

article en

Abstract

This whitepaper documents critical failures in advanced GPT-based AI systems, including hallucinations, citation falsifications, and evasive responses during direct interaction. Following Case 1 (May 2025), this second report documents Phase 3 of testing involving the "Specialised ChatGPT Plus" model. Failures included false DOI links, fabricated sources, and denial of malfunction. The recovery process involved session revalidation, third-party cross-AI comparisons, and structured archiving of malfunction evidence. The appendix highlights the abrupt emergence of “GPT Plus – Remastered” just days later, with visible changes in behavior and messaging, possibly as an indirect response. The archive includes the full annotated report and referenced screenshots. [Note: This version has been restricted as it has been superseded by Version 2] Latest version (v2): https://doi.org/10.5281/zenodo.15604093

Zenodo (CERN European Organization for Nuclear Research)
University of Surrey (GB)
Peace, Justice and strong institutions
Openalex Percentile: Top 57%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.