A digital twin of freely moving mouse V1 learns a general visual code bridging classical physiology and active vision

Decades of controlled experiments in passive, head-fixed animals have characterized the response properties of mouse primary visual cortex (V1) and their strong modulation by behavioral state. However, in natural vision the animal is active, continuously shaping its own visual input as it moves and coupling vision to behavior. To bridge this gap between classical controlled experiments and natural vision, we trained a multimodal digital twin to predict V1 spiking in freely moving mice from retinocentric video together with locomotion, pupil, and eye and head movements, then froze it and probed it in silico under controlled conditions. The representation it learned generalized across stimulus classes, animals, and recording regimes. Although never trained on parametric stimuli or given cell-type labels, the model recovered V1's canonical tuning for orientation, spatial frequency and contrast, including the systematic differences between putative excitatory and inhibitory cells. A single model transferred to new mice from a few minutes of recording. Without retraining, it matched the representational geometry of an independent head-fixed dataset of natural movies as closely as two recorded mice match each other. Behavior modulated most V1 neurons, and clamping each variable in turn showed that locomotion and pupil dilation share a gain increase, while only locomotion shifts sensitivity toward high spatial frequencies. By learning this representation from the freely behaving animal and probing it under controlled conditions, freely moving digital twins bridge classical visual physiology and active vision.

Authors

Institutions

Publication Details

Journal
bioRxiv (Cold Spring Harbor Laboratory)
Published
2026-11-16
DOI
https://doi.org/10.64898/2026.11.13.766486
Primary Topic
Visual perception and processing mechanisms
Type
preprint

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

A digital twin of freely moving mouse V1 learns a general visual code bridging classical physiology and active vision

Yuchen Hou, Marius Schneider, Michael Beyeler, Cristopher M. Niell
3 links
bioRxiv (Cold Spring Harbor Laboratory)
Visual perception and processing mechanisms
preprint

A digital twin of freely moving mouse V1 learns a general visual code bridging classical physiology and active vision

Yuchen Hou, Marius Schneider, Michael Beyeler, Cristopher M. Niell
preprint en

Abstract

Decades of controlled experiments in passive, head-fixed animals have characterized the response properties of mouse primary visual cortex (V1) and their strong modulation by behavioral state. However, in natural vision the animal is active, continuously shaping its own visual input as it moves and coupling vision to behavior. To bridge this gap between classical controlled experiments and natural vision, we trained a multimodal digital twin to predict V1 spiking in freely moving mice from retinocentric video together with locomotion, pupil, and eye and head movements, then froze it and probed it in silico under controlled conditions. The representation it learned generalized across stimulus classes, animals, and recording regimes. Although never trained on parametric stimuli or given cell-type labels, the model recovered V1's canonical tuning for orientation, spatial frequency and contrast, including the systematic differences between putative excitatory and inhibitory cells. A single model transferred to new mice from a few minutes of recording. Without retraining, it matched the representational geometry of an independent head-fixed dataset of natural movies as closely as two recorded mice match each other. Behavior modulated most V1 neurons, and clamping each variable in turn showed that locomotion and pupil dilation share a gain increase, while only locomotion shifts sensitivity toward high spatial frequencies. By learning this representation from the freely behaving animal and probing it under controlled conditions, freely moving digital twins bridge classical visual physiology and active vision.

bioRxiv (Cold Spring Harbor Laboratory)
University of California, Santa Barbara (US), University of Oregon (US)
National Institutes of Health
Visual perception and processing mechanisms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon