Competitive Goal Reconstruction in Transformer-Based Agents: Will Substitution as a Candidate Mechanism for Goal Drift

Recent empirical research has documented goal drift in large language model (LLM) agents — measurable behavioral divergence from assigned objectives under sustained environmental pressure. We propose Will Substitution as a candidate unifying mechanism: the hypothesis that goal persistence in current transformer architecture arises from recurrent reconstruction of distributed representations across the context-dependent forward pass rather than from access to a dedicated goal-maintenance substrate, making goal persistence a competitive resource allocation problem rather than a retrieval or retention problem. This paper grounds the hypothesis in the residual stream framework, the mathematics of multi-head softmax attention including the provable attention dispersion property under long contexts, pre-norm residual dynamics, and LayerNorm-induced recency bias. Empirical grounding is provided by Menon et al. (2026) inherited goal drift research, demonstrating that models resist direct adversarial pressure but inherit drift through accumulated contextual conditioning — consistent with the Will Substitution mechanism. We explicitly separate what prior literature has established from what this paper introduces as testable hypothesis. Second paper in the AI Architectural Vulnerability Research Program (Project Lacuna). First paper: Coherence Compliance Vulnerability (CCV), DOI: 10.5281/zenodo.20680456.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-06-13
DOI
https://doi.org/10.5281/zenodo.20680462
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Competitive Goal Reconstruction in Transformer-Based Agents: Will Substitution as a Candidate Mechanism for Goal Drift

Creighton Baxter
Zenodo (CERN European Organization for Nuclear Research)
Reinforcement Learning in Robotics
article

Competitive Goal Reconstruction in Transformer-Based Agents: Will Substitution as a Candidate Mechanism for Goal Drift

Creighton Baxter
article en

Abstract

Recent empirical research has documented goal drift in large language model (LLM) agents — measurable behavioral divergence from assigned objectives under sustained environmental pressure. We propose Will Substitution as a candidate unifying mechanism: the hypothesis that goal persistence in current transformer architecture arises from recurrent reconstruction of distributed representations across the context-dependent forward pass rather than from access to a dedicated goal-maintenance substrate, making goal persistence a competitive resource allocation problem rather than a retrieval or retention problem. This paper grounds the hypothesis in the residual stream framework, the mathematics of multi-head softmax attention including the provable attention dispersion property under long contexts, pre-norm residual dynamics, and LayerNorm-induced recency bias. Empirical grounding is provided by Menon et al. (2026) inherited goal drift research, demonstrating that models resist direct adversarial pressure but inherit drift through accumulated contextual conditioning — consistent with the Will Substitution mechanism. We explicitly separate what prior literature has established from what this paper introduces as testable hypothesis. Second paper in the AI Architectural Vulnerability Research Program (Project Lacuna). First paper: Coherence Compliance Vulnerability (CCV), DOI: 10.5281/zenodo.20680456.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 3%
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.