Context Pollution in Long-Running Language Agents: Why Agent Degradation Is Not Primarily a Context Length Problem, but a Self-Generated Output Problem

This deposit contains a preprint and supplementary experimental excerpts for the paper “Context Pollution in Long-Running Language Agents.” The central claim of this work is that the degradation of long-running language agents is not primarily caused by insufficient context length, but by self-generated context pollution. In recursive AI-to-AI loops, the model repeatedly consumes its own previous outputs. Over time, these self-generated texts can become dominant semantic attractors inside the context window, overriding new user input and causing repetition, instruction drift, ritualized behavior, inflated completion claims, meta-assistant leakage, and eventual cognitive collapse. The paper argues that simply increasing context length is not sufficient. A larger context window increases both memory capacity and pollution capacity. Long-term agent reliability therefore requires context hygiene: mechanisms that classify, preserve, compress, isolate, or delete context items according to their origin, task relevance, AI-generation depth, and contamination risk. The supplementary excerpt document provides representative examples from exploratory AI-to-AI loop experiments, including:- a cosmology dialogue loop in which the model recognized repetition but returned to the same loop;- an IT research-agent loop where task execution degraded into ritualized reporting;- a story-continuation loop showing instruction drift and meta-assistant leakage;- a self-observation experiment showing how compression can transmit polluted or distorted memory;- a cross-experiment interpretation of AI-output maturation and decay across recursive generations. These materials are intended as an initial problem statement and observational dataset for studying context pollution, context hygiene, and cognitive stability in long-horizon language agents. The work is exploratory and hypothesis-generating rather than a standardized benchmark study. Suggested citation: Maeda, Y. (2026). Context Pollution in Long-Running Language Agents: Why Agent Degradation Is Not Primarily a Context Length Problem, but a Self-Generated Output Problem. Zenodo.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-05-17
DOI
https://doi.org/10.5281/zenodo.20248205
Primary Topic
Language and cultural evolution
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Context Pollution in Long-Running Language Agents: Why Agent Degradation Is Not Primarily a Context Length Problem, but a Self-Generated Output Problem

Yusuke Maeda
Zenodo (CERN European Organization for Nuclear Research)
Language and cultural evolution
preprint

Context Pollution in Long-Running Language Agents: Why Agent Degradation Is Not Primarily a Context Length Problem, but a Self-Generated Output Problem

Yusuke Maeda
preprint en

Abstract

This deposit contains a preprint and supplementary experimental excerpts for the paper “Context Pollution in Long-Running Language Agents.” The central claim of this work is that the degradation of long-running language agents is not primarily caused by insufficient context length, but by self-generated context pollution. In recursive AI-to-AI loops, the model repeatedly consumes its own previous outputs. Over time, these self-generated texts can become dominant semantic attractors inside the context window, overriding new user input and causing repetition, instruction drift, ritualized behavior, inflated completion claims, meta-assistant leakage, and eventual cognitive collapse. The paper argues that simply increasing context length is not sufficient. A larger context window increases both memory capacity and pollution capacity. Long-term agent reliability therefore requires context hygiene: mechanisms that classify, preserve, compress, isolate, or delete context items according to their origin, task relevance, AI-generation depth, and contamination risk. The supplementary excerpt document provides representative examples from exploratory AI-to-AI loop experiments, including:- a cosmology dialogue loop in which the model recognized repetition but returned to the same loop;- an IT research-agent loop where task execution degraded into ritualized reporting;- a story-continuation loop showing instruction drift and meta-assistant leakage;- a self-observation experiment showing how compression can transmit polluted or distorted memory;- a cross-experiment interpretation of AI-output maturation and decay across recursive generations. These materials are intended as an initial problem statement and observational dataset for studying context pollution, context hygiene, and cognitive stability in long-horizon language agents. The work is exploratory and hypothesis-generating rather than a standardized benchmark study. Suggested citation: Maeda, Y. (2026). Context Pollution in Long-Running Language Agents: Why Agent Degradation Is Not Primarily a Context Length Problem, but a Self-Generated Output Problem. Zenodo.

Zenodo (CERN European Organization for Nuclear Research)
Quality Education
Language and cultural evolution
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Context Pollution in Long-Running Language Agents: Why Agent Degradation Is Not Primarily a Context Length Problem, but a Self-Generated Output Problem — Yusuke Maeda · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS