Thalamo-koniocortical simulations reveal hardware-oriented principles for Transformer-like architectures
Abstract Transformer architectures process distributed representations through explicit matrix operations, whereas biological circuits compute through local electrical and synaptic dynamics. We ask whether Transformer-like functions can emerge in three separately simulated phenomenological models of a thalamo-koniocortical pathway. The thalamic model converts overlapping sensory activity into less-overlapping components and reconstructs incomplete inputs; the koniocortical model transforms these components into sparse, stable, pattern-selective events; and the cortical model binds ordered events into frame-like representations and temporal sequences. Mathematical analysis links Hebbian retrieval and Transformer attention through similarity-dependent weighting. These correspondences suggest that algorithmic operations may arise from the physical dynamics of interacting units, motivating hardware-oriented and neuromorphic alternatives. Although simulated separately, the models define a testable pathway from sensory recoding to sparse representation, temporal binding and competitive selection.
Authors
- Diego Andina (ORCID: https://orcid.org/0000-0001-7036-2646)
- Ricardo Tiosso Panassiol (ORCID: https://orcid.org/0000-0002-3614-2735)
- Carlos Fellip Rabadan Braga
- Francisco Javier Peláez
Institutions
- Universidade de São Paulo (BR)
- Universidade Federal do ABC (BR)
- Universidad Politécnica de Madrid (ES)
Publication Details
- Journal
- Research Square
- Published
- 2026-11-17
- DOI
- https://doi.org/10.21203/rs.3.rs-11751492/v1
- Primary Topic
- Neural dynamics and brain function
- Type
- preprint