NeuOS: Discovering and Exploiting the Neural Von Neumann Architecture Inside Pre-Trained Language Models

I present NeuOS, a systematic investigation revealing that pre-trained transformer language models internally implement a Von Neumann-like computational architecture with identifiable registers, swappable memory, executable programs, and a decompilable instruction set. Through 76 experimental phases on Qwen2.5-0.5B, I demonstrate that: Complete ISA mapping: Each transformer layer functions as a specialized CPU register (OPCODE at L0, MIN at L16, MAX at L22) with accuracies from 74% to 100%. Self-healing OS: Dynamic register reallocation achieves 100% recovery from simulated hardware damage. Homoiconic execution: Programs execute without any textual instructions via Direct Memory Access (66.7% accuracy), and a single computation forks into multiple parallel paths (100% differentiation). Neural decompiler: Running programs are identified from register state alone with 100% accuracy across 5 operations. Autopoietic kernel: The system writes its own programs without external gradients, achieving 100% accuracy through self-compilation. Artificial life: Program vectors exhibit ecosystem dynamics including a Cambrian Explosion (19 unique phenotypes), parasitism, developmental metamorphosis, and aging with rejuvenation. These findings establish that transformers are not black-box function approximators but structured computers whose internal state can be observed, modified, and controlled at the register level. Changes in v2: Expanded from 26 to 76 experimental phases, adding Seasons 5–12 covering autopoiesis, polymorphic hot swapping, program compression (896→10 dimensions), neural ecosystems, developmental biology, parasitism/symbiosis, and program aging. Includes a comprehensive appendix summarizing all 76 phases. Code: https://github.com/hafufu-stack/NeuOS Acknowledgments This research was conducted entirely independently, without institutional affiliation or corporate funding. The author currently faces financial constraints that make it increasingly difficult to maintain subscriptions to AI services essential for this line of research. To sustain and improve the quality of future work, the author is actively seeking community sponsorship. Details are available at https://github.com/sponsors/hafufu-stack.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-05-19
DOI
https://doi.org/10.5281/zenodo.20278519
Primary Topic
Ferroelectric and Negative Capacitance Devices
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

NeuOS: Discovering and Exploiting the Neural Von Neumann Architecture Inside Pre-Trained Language Models

Hiroto Funasaki
Zenodo (CERN European Organization for Nuclear Research)
Ferroelectric and Negative Capacitance Devices
preprint

NeuOS: Discovering and Exploiting the Neural Von Neumann Architecture Inside Pre-Trained Language Models

Hiroto Funasaki
preprint en

Abstract

I present NeuOS, a systematic investigation revealing that pre-trained transformer language models internally implement a Von Neumann-like computational architecture with identifiable registers, swappable memory, executable programs, and a decompilable instruction set. Through 76 experimental phases on Qwen2.5-0.5B, I demonstrate that: Complete ISA mapping: Each transformer layer functions as a specialized CPU register (OPCODE at L0, MIN at L16, MAX at L22) with accuracies from 74% to 100%. Self-healing OS: Dynamic register reallocation achieves 100% recovery from simulated hardware damage. Homoiconic execution: Programs execute without any textual instructions via Direct Memory Access (66.7% accuracy), and a single computation forks into multiple parallel paths (100% differentiation). Neural decompiler: Running programs are identified from register state alone with 100% accuracy across 5 operations. Autopoietic kernel: The system writes its own programs without external gradients, achieving 100% accuracy through self-compilation. Artificial life: Program vectors exhibit ecosystem dynamics including a Cambrian Explosion (19 unique phenotypes), parasitism, developmental metamorphosis, and aging with rejuvenation. These findings establish that transformers are not black-box function approximators but structured computers whose internal state can be observed, modified, and controlled at the register level. Changes in v2: Expanded from 26 to 76 experimental phases, adding Seasons 5–12 covering autopoiesis, polymorphic hot swapping, program compression (896→10 dimensions), neural ecosystems, developmental biology, parasitism/symbiosis, and program aging. Includes a comprehensive appendix summarizing all 76 phases. Code: https://github.com/hafufu-stack/NeuOS Acknowledgments This research was conducted entirely independently, without institutional affiliation or corporate funding. The author currently faces financial constraints that make it increasingly difficult to maintain subscriptions to AI services essential for this line of research. To sustain and improve the quality of future work, the author is actively seeking community sponsorship. Details are available at https://github.com/sponsors/hafufu-stack.

Zenodo (CERN European Organization for Nuclear Research)
Ferroelectric and Negative Capacitance Devices
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.