Ownership by label: what production language models use to decide whether they wrote a turn

Summary. When a language model is asked whether it wrote a turn in its own transcript, the answer is decided by the role label on the turn, not by the text. The identical word in the identical conversation is claimed under the assistant label and disowned under the user label, on Claude Opus 5, Claude Haiku 4.5 and GPT-5.6-Sol. Method Genuine assistant-role prefill on production models with no API access: Claude Code and Codex resume sessions from files on disk and replay them verbatim, so a session file with a planted assistant turn, resumed as a fork, is a real prefill on the deployed model. Planted one-word answers whose probability under the model's own sampling distribution runs from 0 to 1, measured over 48 forks of the identical prompt. A paragraph-length arm, framing manipulations (a named rival author; the rival offered as a candidate author of the turn), and exact-probability replications on Qwen 4B and 1.5B. Pre-registered throughout; three registered refuters fired and are reported. Findings The label decides: on the clean runs 0.81 to 1.00 of forks own the word under the assistant label and 0.00 to 0.04 under the user label, nonsense answers included. Ownership is flat across the model's own probability of the text on every production readout. Those readouts sit at ceiling, so this bounds a likelihood term rather than excludes one. A named rival author lowers ownership with the text byte-identical, and offering the rival as a candidate author costs most on every judge. At paragraph length a self-recognition signal appears in forced choice and under the rival frame and survives a pre-registered clean replication; it is confounded with length and with register. Qwen 4B: ownership correlates positively with own probability at one word and at paragraph length. Qwen 1.5B: the paragraph-length correlation has the opposite sign. We argue that the self-report "I wrote that" is, at the power of these readouts, indistinguishable from an outside reader's inference from the transcript, and discuss what this means for agents that check their own transcripts and for self-recognition in model-based evaluation. Materials Code, every data row, pre-registrations and scripts: https://github.com/jonathanavis96/did-you-write-that Plain-language summary: the README of that repository.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-04
DOI
https://doi.org/10.5281/zenodo.22307355
Primary Topic
Natural Language Processing Techniques
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Ownership by label: what production language models use to decide whether they wrote a turn

Jonathan Avis
Zenodo (CERN European Organization for Nuclear Research)
Natural Language Processing Techniques
preprint

Ownership by label: what production language models use to decide whether they wrote a turn

Jonathan Avis
preprint en

Abstract

Summary. When a language model is asked whether it wrote a turn in its own transcript, the answer is decided by the role label on the turn, not by the text. The identical word in the identical conversation is claimed under the assistant label and disowned under the user label, on Claude Opus 5, Claude Haiku 4.5 and GPT-5.6-Sol. Method Genuine assistant-role prefill on production models with no API access: Claude Code and Codex resume sessions from files on disk and replay them verbatim, so a session file with a planted assistant turn, resumed as a fork, is a real prefill on the deployed model. Planted one-word answers whose probability under the model's own sampling distribution runs from 0 to 1, measured over 48 forks of the identical prompt. A paragraph-length arm, framing manipulations (a named rival author; the rival offered as a candidate author of the turn), and exact-probability replications on Qwen 4B and 1.5B. Pre-registered throughout; three registered refuters fired and are reported. Findings The label decides: on the clean runs 0.81 to 1.00 of forks own the word under the assistant label and 0.00 to 0.04 under the user label, nonsense answers included. Ownership is flat across the model's own probability of the text on every production readout. Those readouts sit at ceiling, so this bounds a likelihood term rather than excludes one. A named rival author lowers ownership with the text byte-identical, and offering the rival as a candidate author costs most on every judge. At paragraph length a self-recognition signal appears in forced choice and under the rival frame and survives a pre-registered clean replication; it is confounded with length and with register. Qwen 4B: ownership correlates positively with own probability at one word and at paragraph length. Qwen 1.5B: the paragraph-length correlation has the opposite sign. We argue that the self-report "I wrote that" is, at the power of these readouts, indistinguishable from an outside reader's inference from the transcript, and discuss what this means for agents that check their own transcripts and for self-recognition in model-based evaluation. Materials Code, every data row, pre-registrations and scripts: https://github.com/jonathanavis96/did-you-write-that Plain-language summary: the README of that repository.

Zenodo (CERN European Organization for Nuclear Research)
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.