From Connectome Wiring to Counted Memory and Recurrent Depth: Pre-Registered Tests of Drosophila Mushroom-Body Principles in Small Language Models

Across 16 pre-registered stages (101 production training and evaluation runs, 25 registered predictions P1-P25, and a 218-mutant automated test audit), we systematically test where Drosophila mushroom-body principles help and where they fail in small language models (5M-29M parameters trained on 200M tokens of FineWeb-Edu). We test literal FlyWire v783 mushroom-body connectome wiring (Stages 1 & 2T), counted host-RAM n-gram memory (COUNT) with online leave-one-out subtraction and Kenyon similarity hash backoffs (Stages 2.0-2B, 2E-2K2), gradient-free one-shot associative count writes with context-gated overlays (GatedOverlay) and memory-on KL consistency consolidation (Stages 2C, 2C-2, 2C-3), and recurrent looped depth (LoopGPT) with learned per-pass residual gains and a 2x2 factorial isolating why unembedding head.weight at AdamW 64e-3 explodes 8x in L2 norm and kills recurrent depth (Stages 2D, 2H-2I, 2L-2N).

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-17
DOI
https://doi.org/10.5281/zenodo.24296167
Primary Topic
Topic Modeling
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

From Connectome Wiring to Counted Memory and Recurrent Depth: Pre-Registered Tests of Drosophila Mushroom-Body Principles in Small Language Models

Nate Farrow
3 links
Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
preprint

From Connectome Wiring to Counted Memory and Recurrent Depth: Pre-Registered Tests of Drosophila Mushroom-Body Principles in Small Language Models

Nate Farrow
preprint en

Abstract

Across 16 pre-registered stages (101 production training and evaluation runs, 25 registered predictions P1-P25, and a 218-mutant automated test audit), we systematically test where Drosophila mushroom-body principles help and where they fail in small language models (5M-29M parameters trained on 200M tokens of FineWeb-Edu). We test literal FlyWire v783 mushroom-body connectome wiring (Stages 1 & 2T), counted host-RAM n-gram memory (COUNT) with online leave-one-out subtraction and Kenyon similarity hash backoffs (Stages 2.0-2B, 2E-2K2), gradient-free one-shot associative count writes with context-gated overlays (GatedOverlay) and memory-on KL consistency consolidation (Stages 2C, 2C-2, 2C-3), and recurrent looped depth (LoopGPT) with learned per-pass residual gains and a 2x2 factorial isolating why unembedding head.weight at AdamW 64e-3 explodes 8x in L2 norm and kills recurrent depth (Stages 2D, 2H-2I, 2L-2N).

Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon