Engram: Episodic Composition of Certified Computation. Abstention, Observability and Auditability in Looping Transformer Decoders

Long algorithmic computations tolerate wrong guesses, but not wrong commitments: an error that is kept breaks everything built on it. This paper reports Engram, a single-layer looping transformer decoder, and the pedagogy it demonstrates: training step by step on targets an oracle (an exact solver) has verified, prioritising abstention, observability and auditability; it holds a promise that next-token approximation does not make by construction. Training is for near-perfect precision, which makes recall a function of compute. Abstention is recoverable whereas commitment is not, and composition makes that asymmetry exponential: precision fixed at zero is what turns compute into recall instead of kept errors. The model's latent iterative window is short and never grows: the episode is bound and long problems are solved by composing episodes. The problem is held in its written partial solution, which every episode reads and extends; the window never needs to hold more than one episode's work. Trained on 8-bit parity episodes, the model reaches 256-bit instances by composition; trained on compositions of two permutations in the alternating and symmetric groups of degree five, it composes ten thousand permutations: zero errors in both, on inputs far longer than any the window ever held. On Sudoku-Extreme, served inside a certified search that opens hypotheses on its behalf, it solves exactly or abstains: 1,635 of 2,000 unseen puzzles, zero wrong, with coverage rising from 27.8% at 800 compute episodes per puzzle to 81.8% at 51,200. Across every experiment reported here, over fifty-two million episodes, it has never kept an error. Every step is emitted as ordinary tokens, checkable against the rules of the task the moment it appears. What these results support is a claim about training rather than about architecture: supervising every step against an oracle, and training abstention wherever no verified step exists, is what makes computation safe to compose, and it is this regime, more than the model, that produced the record above.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-27
DOI
https://doi.org/10.5281/zenodo.23696701
Primary Topic
Formal Methods in Verification
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Engram: Episodic Composition of Certified Computation. Abstention, Observability and Auditability in Looping Transformer Decoders

Alexandros Giokas
2 links
Zenodo (CERN European Organization for Nuclear Research)
Formal Methods in Verification
preprint

Engram: Episodic Composition of Certified Computation. Abstention, Observability and Auditability in Looping Transformer Decoders

Alexandros Giokas
preprint en

Abstract

Long algorithmic computations tolerate wrong guesses, but not wrong commitments: an error that is kept breaks everything built on it. This paper reports Engram, a single-layer looping transformer decoder, and the pedagogy it demonstrates: training step by step on targets an oracle (an exact solver) has verified, prioritising abstention, observability and auditability; it holds a promise that next-token approximation does not make by construction. Training is for near-perfect precision, which makes recall a function of compute. Abstention is recoverable whereas commitment is not, and composition makes that asymmetry exponential: precision fixed at zero is what turns compute into recall instead of kept errors. The model's latent iterative window is short and never grows: the episode is bound and long problems are solved by composing episodes. The problem is held in its written partial solution, which every episode reads and extends; the window never needs to hold more than one episode's work. Trained on 8-bit parity episodes, the model reaches 256-bit instances by composition; trained on compositions of two permutations in the alternating and symmetric groups of degree five, it composes ten thousand permutations: zero errors in both, on inputs far longer than any the window ever held. On Sudoku-Extreme, served inside a certified search that opens hypotheses on its behalf, it solves exactly or abstains: 1,635 of 2,000 unseen puzzles, zero wrong, with coverage rising from 27.8% at 800 compute episodes per puzzle to 81.8% at 51,200. Across every experiment reported here, over fifty-two million episodes, it has never kept an error. Every step is emitted as ordinary tokens, checkable against the rules of the task the moment it appears. What these results support is a claim about training rather than about architecture: supervising every step against an oracle, and training abstention wherever no verified step exists, is what makes computation safe to compose, and it is this regime, more than the model, that produced the record above.

Zenodo (CERN European Organization for Nuclear Research)
Formal Methods in Verification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
Engram: Episodic Composition of Certified Computation. Abstention, Observability and Auditability in Looping Transformer Decoders — Alexandros Giokas · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS