Does Next Token Prediction Explain Output Structure? Behavioral Evidence for Implicit Blueprints in Creative Text Generation

It has been hypothesized, from probing analyses of hidden states, that large language models (LLMs) possess an implicit blueprint—a pre-determined output structure—before generation begins (Li et al., 2024). But this hypothesis depends on access to model internals; no behavioral evidence existed.This paper provides behavioral evidence for the implicit blueprint without access to model internals. In a creative text generation task where an output attractor (Oyama, 2026) yields 100% convergence, forcing the opening token to an unrelated word (the sword name "Claymore"), or even reversing an attribute ("fire dragon"), leaves the blueprint vocabulary almost fully intact. Barnaby escape (Oyama, 2026), by contrast, breaks the blueprint—and once broken, forcing the original name back does not restore it. A blind evaluation by Claude Opus 4.8 (40 judgments) confirms these vocabulary-level results at the structural level.The opening token neither determines output structure nor restores it. Output structure is decided before the opening token—behavioral evidence consistent with Li et al.'s implicit-blueprint hypothesis, requiring no model internals. We verify this across 2 model families, 4 models (9B–35B), and 3,800 generations, all reproducible on a single consumer GPU. Finally, we ask whether what we recognize as intelligence in these outputs is inseparable from the structure that shaped them.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-06-26
DOI
https://doi.org/10.5281/zenodo.20922763
Primary Topic
Artificial Intelligence in Games
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Does Next Token Prediction Explain Output Structure? Behavioral Evidence for Implicit Blueprints in Creative Text Generation

Yuki Oyama
Zenodo (CERN European Organization for Nuclear Research)
Artificial Intelligence in Games
preprint

Does Next Token Prediction Explain Output Structure? Behavioral Evidence for Implicit Blueprints in Creative Text Generation

Yuki Oyama
preprint en

Abstract

It has been hypothesized, from probing analyses of hidden states, that large language models (LLMs) possess an implicit blueprint—a pre-determined output structure—before generation begins (Li et al., 2024). But this hypothesis depends on access to model internals; no behavioral evidence existed.This paper provides behavioral evidence for the implicit blueprint without access to model internals. In a creative text generation task where an output attractor (Oyama, 2026) yields 100% convergence, forcing the opening token to an unrelated word (the sword name "Claymore"), or even reversing an attribute ("fire dragon"), leaves the blueprint vocabulary almost fully intact. Barnaby escape (Oyama, 2026), by contrast, breaks the blueprint—and once broken, forcing the original name back does not restore it. A blind evaluation by Claude Opus 4.8 (40 judgments) confirms these vocabulary-level results at the structural level.The opening token neither determines output structure nor restores it. Output structure is decided before the opening token—behavioral evidence consistent with Li et al.'s implicit-blueprint hypothesis, requiring no model internals. We verify this across 2 model families, 4 models (9B–35B), and 3,800 generations, all reproducible on a single consumer GPU. Finally, we ask whether what we recognize as intelligence in these outputs is inseparable from the structure that shaped them.

Zenodo (CERN European Organization for Nuclear Research)
The Open University (GB)
Quality Education
Artificial Intelligence in Games
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Does Next Token Prediction Explain Output Structure? Behavioral Evidence for Implicit Blueprints in Creative Text Generation — Yuki Oyama · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS