DNA-Kernel Plexus: A Bio-Inspired Architecture for Growing, Self-Correcting Language Models with Bounded Forgetting

We present Berna R5, a language model architecture in which knowledge is stored in dynamic weighted cells that are born, split, and interconnect according to a 6-dimensional knowledge state space. Unlike Mixture-of-Experts, our cells are not fixed at initialization; they grow in response to knowledge saturation and interconnect via a co-activation plexus. We present two mathematical theorems (plexus connectivity convergence and balanced growth equilibrium), two design invariants (transactional incorporation and protected retention), and two empirical hypotheses (saturation-triggered splitting and bounded forgetting on continual tasks). We empirically evaluate the associated predictions on a 50M-parameter Proof-of-Concept trained on 800M tokens. The architecture is positioned relative to Transformer, MoE, EWC, and PackNet; baseline comparison is planned for the full-scale run. In our PoC, Berna R5 achieves competitive loss while showing reduced forgetting under the tested protocol. The architecture is open-source, reproducible, and hardware-adaptive on consumer GPUs; a single RTX 5090 was used in this work.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-28
DOI
https://doi.org/10.5281/zenodo.23014665
Primary Topic
Ferroelectric and Negative Capacitance Devices
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
preprint

DNA-Kernel Plexus: A Bio-Inspired Architecture for Growing, Self-Correcting Language Models with Bounded Forgetting

Mohammed Kamil Muhammed
Zenodo (CERN European Organization for Nuclear Research)
Ferroelectric and Negative Capacitance Devices
preprint

DNA-Kernel Plexus: A Bio-Inspired Architecture for Growing, Self-Correcting Language Models with Bounded Forgetting

Mohammed Kamil Muhammed
preprint en

Abstract

We present Berna R5, a language model architecture in which knowledge is stored in dynamic weighted cells that are born, split, and interconnect according to a 6-dimensional knowledge state space. Unlike Mixture-of-Experts, our cells are not fixed at initialization; they grow in response to knowledge saturation and interconnect via a co-activation plexus. We present two mathematical theorems (plexus connectivity convergence and balanced growth equilibrium), two design invariants (transactional incorporation and protected retention), and two empirical hypotheses (saturation-triggered splitting and bounded forgetting on continual tasks). We empirically evaluate the associated predictions on a 50M-parameter Proof-of-Concept trained on 800M tokens. The architecture is positioned relative to Transformer, MoE, EWC, and PackNet; baseline comparison is planned for the full-scale run. In our PoC, Berna R5 achieves competitive loss while showing reduced forgetting under the tested protocol. The architecture is open-source, reproducible, and hardware-adaptive on consumer GPUs; a single RTX 5090 was used in this work.

Zenodo (CERN European Organization for Nuclear Research)
Ferroelectric and Negative Capacitance Devices
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

DNA-Kernel Plexus: A Bio-Inspired Architecture for Growing, Self-Correcting Language Models with Bounded Forgetting — Mohammed Kamil Muhammed · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS