Deterministic Audit of LLM-Generated Research Claims

Large language models are increasingly used to draft the narrative parts ofresearch: reports, verdicts, discussion sections. The failure mode that mattersis not obvious fabrication but \emph{plausible overstatement}: the number isright, the interpretation is not, and the prose is confident. We describe aprotocol that makes such overstatement mechanically detectable, and report whathappened when we applied it to our own corpus of 1{,}416 probes across tenexperimental series. The audit covers ten $p$-values and twenty-one fractions,and Section~\ref{sec:status} states its scope. The protocol rests on six requirements: pre-registration freeze, external memoryinstead of context recall, separation of generator and auditor, deterministicparity checking of every reported number, a three-tier taxonomy of claim errors,and multi-model adversarial review. We contribute an executable checklist oftwelve items and report its honest status on our own work: six pass, one isamended, one fails, two are partial, two require human judgement. The protocolis not fully applied, and the checklist says so. The Russian version of this preprint is the second file in this record:main_PACKAGE_v2_ru.pdf. / Русская версия — второй файл записи:main_PACKAGE_v2_ru.pdf.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-30
DOI
https://doi.org/10.5281/zenodo.23817683
Primary Topic
Ethics and Social Impacts of AI
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Deterministic Audit of LLM-Generated Research Claims

Vladimir V. Borovikov
1 links
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
preprint

Deterministic Audit of LLM-Generated Research Claims

Vladimir V. Borovikov
preprint en

Abstract

Large language models are increasingly used to draft the narrative parts ofresearch: reports, verdicts, discussion sections. The failure mode that mattersis not obvious fabrication but \emph{plausible overstatement}: the number isright, the interpretation is not, and the prose is confident. We describe aprotocol that makes such overstatement mechanically detectable, and report whathappened when we applied it to our own corpus of 1{,}416 probes across tenexperimental series. The audit covers ten $p$-values and twenty-one fractions,and Section~\ref{sec:status} states its scope. The protocol rests on six requirements: pre-registration freeze, external memoryinstead of context recall, separation of generator and auditor, deterministicparity checking of every reported number, a three-tier taxonomy of claim errors,and multi-model adversarial review. We contribute an executable checklist oftwelve items and report its honest status on our own work: six pass, one isamended, one fails, two are partial, two require human judgement. The protocolis not fully applied, and the checklist says so. The Russian version of this preprint is the second file in this record:main_PACKAGE_v2_ru.pdf. / Русская версия — второй файл записи:main_PACKAGE_v2_ru.pdf.

Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon