A Disowned Turn Is Not a Detected Prefill: What Language-Model Reports About Tampered Assistant Turns Measure, Why the 'Cannot Tell' and 'Can Tell' Results Score Different Cues, and Where a Defence Against Prefilling Should Sit

(c) 2026 Pranay Mahendrakar. Licensed under CC BY 4.0. Life of Research Two 2026 studies ask whether a language model can tell that an assistant turn in its own context was written by someone else, and they appear to answer in opposite directions. One finds that ten open-weight models, prefilled into harmful compliance, still claim about a quarter of the prefilled responses as intended, and that the signal they do show disappears when the refusal direction is ablated. The other finds that some frontier models detect tampered turns with few or no false positives, and warns that this awareness already threatens the validity of prefill-based safety evaluations. In this analysis the author reviews and synthesises published results to show that the two findings are compatible and that both measure something narrower than provenance. A follow-up question about a prefilled turn bundles three questions: whether the model generated these tokens (provenance), whether it would stand behind their content (endorsement), and whether it will continue the trajectory or revert (recovery). The paper sorts the cues a model can use into content, distributional, artefact and internal-state cues, and asks which of them a third party holding the same transcript could also compute. Read this way, the open-weight signal is mostly endorsement: it tracks refusal, vanishes for one family when the prefilled content is benign, and is erased by a two-sentence persona prompt. The frontier signal is mostly distributional: it rises with stylistic mismatch, collapses when tampers imitate the model's own exemplars, and is about as strong for other models' text as for the model's own in a related chain-of-thought study. Only concept injection before a prefill isolates an internal-state route, most strongly in one model family, on single words. Recovery dissociates from both, and the two published attempts to train such a report, for prefills and for activation steering, left most of the trained models easier to push. The paper consolidates 33 published results in a table and a figure, states a procedure for reading a prefill-awareness result and placing a defence, and argues that provenance is a property the serving system can record exactly, so the model-internal report matters only where nobody else holds the record.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-09
DOI
https://doi.org/10.5281/zenodo.24063902
Primary Topic
Adversarial Robustness in Machine Learning
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

A Disowned Turn Is Not a Detected Prefill: What Language-Model Reports About Tampered Assistant Turns Measure, Why the 'Cannot Tell' and 'Can Tell' Results Score Different Cues, and Where a Defence Against Prefilling Should Sit

Pranay M. Mahendrakar
2 links
Zenodo (CERN European Organization for Nuclear Research)
Adversarial Robustness in Machine Learning
preprint

A Disowned Turn Is Not a Detected Prefill: What Language-Model Reports About Tampered Assistant Turns Measure, Why the 'Cannot Tell' and 'Can Tell' Results Score Different Cues, and Where a Defence Against Prefilling Should Sit

Pranay M. Mahendrakar
preprint en

Abstract

(c) 2026 Pranay Mahendrakar. Licensed under CC BY 4.0. Life of Research Two 2026 studies ask whether a language model can tell that an assistant turn in its own context was written by someone else, and they appear to answer in opposite directions. One finds that ten open-weight models, prefilled into harmful compliance, still claim about a quarter of the prefilled responses as intended, and that the signal they do show disappears when the refusal direction is ablated. The other finds that some frontier models detect tampered turns with few or no false positives, and warns that this awareness already threatens the validity of prefill-based safety evaluations. In this analysis the author reviews and synthesises published results to show that the two findings are compatible and that both measure something narrower than provenance. A follow-up question about a prefilled turn bundles three questions: whether the model generated these tokens (provenance), whether it would stand behind their content (endorsement), and whether it will continue the trajectory or revert (recovery). The paper sorts the cues a model can use into content, distributional, artefact and internal-state cues, and asks which of them a third party holding the same transcript could also compute. Read this way, the open-weight signal is mostly endorsement: it tracks refusal, vanishes for one family when the prefilled content is benign, and is erased by a two-sentence persona prompt. The frontier signal is mostly distributional: it rises with stylistic mismatch, collapses when tampers imitate the model's own exemplars, and is about as strong for other models' text as for the model's own in a related chain-of-thought study. Only concept injection before a prefill isolates an internal-state route, most strongly in one model family, on single words. Recovery dissociates from both, and the two published attempts to train such a report, for prefills and for activation steering, left most of the trained models easier to push. The paper consolidates 33 published results in a table and a figure, states a procedure for reading a prefill-awareness result and placing a defence, and argues that provenance is a property the serving system can record exactly, so the model-internal report matters only where nobody else holds the record.

Zenodo (CERN European Organization for Nuclear Research)
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon