Thalamo-koniocortical simulations reveal hardware-oriented principles for Transformer-like architectures

Abstract Transformer architectures process distributed representations through explicit matrix operations, whereas biological circuits compute through local electrical and synaptic dynamics. We ask whether Transformer-like functions can emerge in three separately simulated phenomenological models of a thalamo-koniocortical pathway. The thalamic model converts overlapping sensory activity into less-overlapping components and reconstructs incomplete inputs; the koniocortical model transforms these components into sparse, stable, pattern-selective events; and the cortical model binds ordered events into frame-like representations and temporal sequences. Mathematical analysis links Hebbian retrieval and Transformer attention through similarity-dependent weighting. These correspondences suggest that algorithmic operations may arise from the physical dynamics of interacting units, motivating hardware-oriented and neuromorphic alternatives. Although simulated separately, the models define a testable pathway from sensory recoding to sparse representation, temporal binding and competitive selection.

Authors

Institutions

Publication Details

Journal
Research Square
Published
2026-11-17
DOI
https://doi.org/10.21203/rs.3.rs-11751492/v1
Primary Topic
Neural dynamics and brain function
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Thalamo-koniocortical simulations reveal hardware-oriented principles for Transformer-like architectures

Diego Andina, Ricardo Tiosso Panassiol, Carlos Fellip Rabadan Braga, Francisco Javier Peláez
3 links
Research Square
Neural dynamics and brain function
preprint

Thalamo-koniocortical simulations reveal hardware-oriented principles for Transformer-like architectures

Diego Andina, Ricardo Tiosso Panassiol, Carlos Fellip Rabadan Braga, Francisco Javier Peláez
preprint en

Abstract

Abstract Transformer architectures process distributed representations through explicit matrix operations, whereas biological circuits compute through local electrical and synaptic dynamics. We ask whether Transformer-like functions can emerge in three separately simulated phenomenological models of a thalamo-koniocortical pathway. The thalamic model converts overlapping sensory activity into less-overlapping components and reconstructs incomplete inputs; the koniocortical model transforms these components into sparse, stable, pattern-selective events; and the cortical model binds ordered events into frame-like representations and temporal sequences. Mathematical analysis links Hebbian retrieval and Transformer attention through similarity-dependent weighting. These correspondences suggest that algorithmic operations may arise from the physical dynamics of interacting units, motivating hardware-oriented and neuromorphic alternatives. Although simulated separately, the models define a testable pathway from sensory recoding to sparse representation, temporal binding and competitive selection.

Research Square
Universidade de São Paulo (BR), Universidade Federal do ABC (BR), Universidad Politécnica de Madrid (ES)
Neural dynamics and brain function
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon