NeuOS: Discovering and Exploiting the Neural Von Neumann Architecture Inside Pre-Trained Language Models
I present NeuOS, a systematic investigation revealing that pre-trained transformer language models internally implement a Von Neumann-like computational architecture with identifiable registers, swappable memory, executable programs, and a decompilable instruction set. Through 76 experimental phases on Qwen2.5-0.5B, I demonstrate that: Complete ISA mapping: Each transformer layer functions as a specialized CPU register (OPCODE at L0, MIN at L16, MAX at L22) with accuracies from 74% to 100%. Self-healing OS: Dynamic register reallocation achieves 100% recovery from simulated hardware damage. Homoiconic execution: Programs execute without any textual instructions via Direct Memory Access (66.7% accuracy), and a single computation forks into multiple parallel paths (100% differentiation). Neural decompiler: Running programs are identified from register state alone with 100% accuracy across 5 operations. Autopoietic kernel: The system writes its own programs without external gradients, achieving 100% accuracy through self-compilation. Artificial life: Program vectors exhibit ecosystem dynamics including a Cambrian Explosion (19 unique phenotypes), parasitism, developmental metamorphosis, and aging with rejuvenation. These findings establish that transformers are not black-box function approximators but structured computers whose internal state can be observed, modified, and controlled at the register level. Changes in v2: Expanded from 26 to 76 experimental phases, adding Seasons 5–12 covering autopoiesis, polymorphic hot swapping, program compression (896→10 dimensions), neural ecosystems, developmental biology, parasitism/symbiosis, and program aging. Includes a comprehensive appendix summarizing all 76 phases. Code: https://github.com/hafufu-stack/NeuOS Acknowledgments This research was conducted entirely independently, without institutional affiliation or corporate funding. The author currently faces financial constraints that make it increasingly difficult to maintain subscriptions to AI services essential for this line of research. To sustain and improve the quality of future work, the author is actively seeking community sponsorship. Details are available at https://github.com/sponsors/hafufu-stack.
Authors
- Hiroto Funasaki (ORCID: https://orcid.org/0009-0004-2517-0177)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-05-19
- DOI
- https://doi.org/10.5281/zenodo.20278519
- Primary Topic
- Ferroelectric and Negative Capacitance Devices
- Type
- preprint