In-Context Virtual Machine: Thermodynamic Entropy Bounds and Deterministic State Orchestration in Transformer-Based Autonomous Agents

Autonomous agents built upon large language models (LLMs) frequently suffer from state drift, cumulative hallucination, and non-deterministic divergence across multi-turn reasoning and execution horizons. In this work, we formalize this failure mode from a statistical physics and information-theoretic perspective as thermodynamic entropy accumulation within the unconstrained token-attention manifold. To resolve this fundamental limitation, we present the In-Context Virtual Machine (ICVM), a formal cybernetic architecture that instantiates a von Neumann virtual computing engine directly within the in-context attention space. ICVM enforces state determinism through a Gate-All-Around (GAA) query rectification harness, an Asimov-teleological objective optimization engine (J_Evo), and monotonic state delta validation via direct operating system kernel calls. Across extensive empirical benchmarks spanning 100 multi-turn execution sessions against four contemporary autonomous agent frameworks (Vanilla LLM, ReAct, AutoGPT, and MetaGPT), ICVM demonstrates a 0.00% hallucination rate (p < 0.001), 100% context durability across 100 turns, a minimal 12.4 ms GAA rectification latency, and zero recurring external API cost. This framework bridges abstract statistical reasoning and concrete cybernetic control, establishing a verifiable foundation for mission-critical, enterprise-scale autonomous intelligence.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-21
DOI
https://doi.org/10.5281/zenodo.22864944
Primary Topic
Advanced Memory and Neural Computing
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
preprint

In-Context Virtual Machine: Thermodynamic Entropy Bounds and Deterministic State Orchestration in Transformer-Based Autonomous Agents

Dong-wook Lee
Zenodo (CERN European Organization for Nuclear Research)
Advanced Memory and Neural Computing
preprint

In-Context Virtual Machine: Thermodynamic Entropy Bounds and Deterministic State Orchestration in Transformer-Based Autonomous Agents

Dong-wook Lee
preprint en

Abstract

Autonomous agents built upon large language models (LLMs) frequently suffer from state drift, cumulative hallucination, and non-deterministic divergence across multi-turn reasoning and execution horizons. In this work, we formalize this failure mode from a statistical physics and information-theoretic perspective as thermodynamic entropy accumulation within the unconstrained token-attention manifold. To resolve this fundamental limitation, we present the In-Context Virtual Machine (ICVM), a formal cybernetic architecture that instantiates a von Neumann virtual computing engine directly within the in-context attention space. ICVM enforces state determinism through a Gate-All-Around (GAA) query rectification harness, an Asimov-teleological objective optimization engine (J_Evo), and monotonic state delta validation via direct operating system kernel calls. Across extensive empirical benchmarks spanning 100 multi-turn execution sessions against four contemporary autonomous agent frameworks (Vanilla LLM, ReAct, AutoGPT, and MetaGPT), ICVM demonstrates a 0.00% hallucination rate (p < 0.001), 100% context durability across 100 turns, a minimal 12.4 ms GAA rectification latency, and zero recurring external API cost. This framework bridges abstract statistical reasoning and concrete cybernetic control, establishing a verifiable foundation for mission-critical, enterprise-scale autonomous intelligence.

Zenodo (CERN European Organization for Nuclear Research)
Genesis Medical Center (US)
Advanced Memory and Neural Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

In-Context Virtual Machine: Thermodynamic Entropy Bounds and Deterministic State Orchestration in Transformer-Based Autonomous Agents — Dong-wook Lee · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS