Individual Synaptic Morphogenesis as a Replacement for Low-Rank Adaptation

Propose of individual synaptic morphogenesis ("SyMa"), a method for specializing language models by growing new MLP tissue instead of training a low-rank adapter. On a frozen host, Hebbian co-activation of neuron pairs (co ∈ [0, 1]) sets three individual growth laws: birth 2 + 14·co, dendrite 128 + 896·co, write 0.10 + 0.25·co. New neurons are born with zero output so the host cannot become worse; finished tissue is merged into the layer matrices and inherited by later generations. Night result on Intel Core i3-1115G4, no GPU, 7-hour budget:• SyMa — 31/40 in 32.4 minutes, 89,088 parameters, 8.99 Wh, 2644 MB peak RAM; stopped itself (reason: control)• LoRA r=16 — 30/40 in 7.01 hours, 4,399,104 parameters, 116.08 Wh, 3038 MB; control loss unchanged (1.0032 → 1.0032) v1 preprint, English. Author: Rauf Pashabayli. Host: Qwen2.5-0.5B-Instruct. Run: 20261102-234611-s20261024.Sites: syma-lab · syma-fleet · syma-lab-archive

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-04
DOI
https://doi.org/10.5281/zenodo.23934247
Primary Topic
Domain Adaptation and Few-Shot Learning
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Individual Synaptic Morphogenesis as a Replacement for Low-Rank Adaptation

Rauf Pashabayli
Zenodo (CERN European Organization for Nuclear Research)
Domain Adaptation and Few-Shot Learning
preprint

Individual Synaptic Morphogenesis as a Replacement for Low-Rank Adaptation

Rauf Pashabayli
preprint en

Abstract

Propose of individual synaptic morphogenesis ("SyMa"), a method for specializing language models by growing new MLP tissue instead of training a low-rank adapter. On a frozen host, Hebbian co-activation of neuron pairs (co ∈ [0, 1]) sets three individual growth laws: birth 2 + 14·co, dendrite 128 + 896·co, write 0.10 + 0.25·co. New neurons are born with zero output so the host cannot become worse; finished tissue is merged into the layer matrices and inherited by later generations. Night result on Intel Core i3-1115G4, no GPU, 7-hour budget:• SyMa — 31/40 in 32.4 minutes, 89,088 parameters, 8.99 Wh, 2644 MB peak RAM; stopped itself (reason: control)• LoRA r=16 — 30/40 in 7.01 hours, 4,399,104 parameters, 116.08 Wh, 3038 MB; control loss unchanged (1.0032 → 1.0032) v1 preprint, English. Author: Rauf Pashabayli. Host: Qwen2.5-0.5B-Instruct. Run: 20261102-234611-s20261024.Sites: syma-lab · syma-fleet · syma-lab-archive

Zenodo (CERN European Organization for Nuclear Research)
Domain Adaptation and Few-Shot Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon