Data-driven ANN-based visual decoding enables unsupervised functional alignment
Artificial neural networks (ANNs) offer a data-driven approach to reveal brain regional functions without explicit supervision. Here, we demonstrate that an ANN trained to decode visual stimuli from multi-unit spiking activity in monkeys, can not only reconstruct complex and dynamic scenes, but also spontaneously align with canonical cortical visual functions. Without any region-specific functional priors, the model identifies key brain areas associated with shape, color, and motion processing. We provide strong evidence that, despite low train-test dataset correlation at the recording-site level, the ANN-based model is able to learn task-relevant representations embedded at a high-dimensional population level and achieve reliable decoding performance. Furthermore, by inverting the architecture and retraining, we show that the same network can predict region-specific spiking patterns from visual input, indicating a reciprocal relationship between encoding and decoding. These findings shed light on ANN-based visual decoding as a powerful framework for unsupervised functional alignment in neural systems.
Authors
- Hang Lin (ORCID: https://orcid.org/0000-0001-5664-3345)
- Markus Siegel (ORCID: https://orcid.org/0000-0001-5115-936X)
- Zeyu Deng (ORCID: https://orcid.org/0000-0001-6421-7768)
- Xin-Ya Zhang (ORCID: https://orcid.org/0000-0002-7826-3076)
- E. K. Miller
- Gang Yan
Institutions
- Tongji University (CN)
- Southern Methodist University (US)
- Westlake University (CN)
- Intelligent Systems Research (United States) (US)
- Bernstein Center for Computational Neuroscience Tübingen (DE)
- Hertie Institute for Clinical Brain Research (DE)
- German Center for Diabetes Research (DE)
- Massachusetts Institute of Technology (US)
- University of Tübingen (DE)
Publication Details
- Journal
- Communications Biology
- Published
- 2026-01-08
- DOI
- https://doi.org/10.1038/s42003-025-09486-7
- Primary Topic
- Face Recognition and Perception
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation