Provenance of AI-assisted analysis: a disclosure and reproduction protocol for research involving language models

Preprint, 24 August 2026. A version of this manuscript is under consideration at a peer-reviewed journal of academic ethics. This record carries no peer-review status. Abstract. Language models entered research practice faster than the rules for disclosing them. The typical declaration today is a single sentence — “a language model was used in preparing this manuscript” — from which a reader can determine nothing: not where the model was applied, not what it did, not whether it touched the result, not whether any of it can be repeated. Alongside this sits a requirement nobody disputes, that human authors bear responsibility and a model cannot be an author. That requirement is satisfiable, and it does not help a reader check the work. This paper argues that the impasse rests on a conflated notion of reproducibility, and separates it into two: audit reproducibility — that a stated result was in fact obtained in the manner and at the time claimed — and procedural reproducibility — that the procedure can be re-run to yield a substantively comparable result. Bit-identical output is the wrong demand for a generative step and the right demand for a computation; the consequence is a division of labour in which published quantities are never produced by generation. On that basis the paper proposes a disclosure ladder (L0–L5) with working thresholds, a step log whose fields make audit possible, a contribution classification (presentation, search, construction) requiring authors to name the highest class reached, and a rule that rejected steps are retained on equal footing with accepted ones. Limits are stated plainly: provenance does not make a result correct, and the disappearance of a model version destroys procedural reproducibility while leaving audit reproducibility intact.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-08-24
DOI
https://doi.org/10.5281/zenodo.22077698
Primary Topic
Scientific Computing and Data Management
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Provenance of AI-assisted analysis: a disclosure and reproduction protocol for research involving language models

Vadim V. Kovalev
Zenodo (CERN European Organization for Nuclear Research)
Scientific Computing and Data Management
preprint

Provenance of AI-assisted analysis: a disclosure and reproduction protocol for research involving language models

Vadim V. Kovalev
preprint en

Abstract

Preprint, 24 August 2026. A version of this manuscript is under consideration at a peer-reviewed journal of academic ethics. This record carries no peer-review status. Abstract. Language models entered research practice faster than the rules for disclosing them. The typical declaration today is a single sentence — “a language model was used in preparing this manuscript” — from which a reader can determine nothing: not where the model was applied, not what it did, not whether it touched the result, not whether any of it can be repeated. Alongside this sits a requirement nobody disputes, that human authors bear responsibility and a model cannot be an author. That requirement is satisfiable, and it does not help a reader check the work. This paper argues that the impasse rests on a conflated notion of reproducibility, and separates it into two: audit reproducibility — that a stated result was in fact obtained in the manner and at the time claimed — and procedural reproducibility — that the procedure can be re-run to yield a substantively comparable result. Bit-identical output is the wrong demand for a generative step and the right demand for a computation; the consequence is a division of labour in which published quantities are never produced by generation. On that basis the paper proposes a disclosure ladder (L0–L5) with working thresholds, a step log whose fields make audit possible, a contribution classification (presentation, search, construction) requiring authors to name the highest class reached, and a rule that rejected steps are retained on equal footing with accepted ones. Limits are stated plainly: provenance does not make a result correct, and the disappearance of a model version destroys procedural reproducibility while leaving audit reproducibility intact.

Zenodo (CERN European Organization for Nuclear Research)
Centre for Self Managed Learning (GB)
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Provenance of AI-assisted analysis: a disclosure and reproduction protocol for research involving language models — Vadim V. Kovalev · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS