Late cross-modal biases in neural spatial representations revealed by EEG decoding

During audiovisual perception, spatial information from vision and audition is combined, often producing biases such as the ventriloquist effect. While these interactions are well documented behaviourally, it remains unclear when cross-modal information begins to alter modality-specific spatial representations in the brain. Here we used cross-generalised inverted encoding modelling of electroencephalography (EEG) data to track the temporal evolution of spatial representations during a spatial ventriloquist task. Human participants (both sexes) localised audiovisual stimuli with horizontally offset auditory and visual components. Decoders trained on unisensory EEG responses were applied to audiovisual trials to estimate whether and when spatial representations of one modality were biased toward the other. Behaviourally, participants integrated cues but showed slight visual over-weighting. Neural decoding revealed robust spatial representations for both modalities, with early unisensory encoding remaining unaffected by cross-modal input. Cross-modal biases emerged only later (from ∼200 ms onwards), within a generalised representational window, and occurred sequentially: auditory representations were biased earlier than visual. These findings indicate that multisensory spatial integration arises via recurrent feedback during later processing stages, while early sensory-specific representations remain independent, providing a neural basis for the temporal dynamics underlying the ventriloquist effect. Significance statement Understanding how the brain integrates spatial information across the senses is central to theories of perception, yet the timing of cross-modal influences on modality-specific neural representations remains unclear. Using EEG and cross-generalised inverted encoding models, we tracked auditory and visual spatial representations with millisecond precision. Early spatial representations remained unisensory despite synchronous audiovisual stimulation. A shared, generalised spatial representation emerged at ∼200 ms, after which cross-modal biases appeared-first in auditory and later in visual codes. These results show that spatial integration is implemented through late, feedback-driven processes operating on initially independent sensory estimates, resolving a long-standing discrepancy between early multisensory interactions and late spatial ventriloquism.

Authors

Institutions

Publication Details

Journal
Journal of Neuroscience
Published
2026-09-04
DOI
https://doi.org/10.1523/jneurosci.0242-26.2026
Primary Topic
Multisensory perception and integration
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Late cross-modal biases in neural spatial representations revealed by EEG decoding

Jason B. Mattingley, Amanda K. Robinson, Reuben Rideaux, Zak Buhmann
Journal of Neuroscience
Multisensory perception and integration
article

Late cross-modal biases in neural spatial representations revealed by EEG decoding

Jason B. Mattingley, Amanda K. Robinson, Reuben Rideaux, Zak Buhmann
article en

Abstract

During audiovisual perception, spatial information from vision and audition is combined, often producing biases such as the ventriloquist effect. While these interactions are well documented behaviourally, it remains unclear when cross-modal information begins to alter modality-specific spatial representations in the brain. Here we used cross-generalised inverted encoding modelling of electroencephalography (EEG) data to track the temporal evolution of spatial representations during a spatial ventriloquist task. Human participants (both sexes) localised audiovisual stimuli with horizontally offset auditory and visual components. Decoders trained on unisensory EEG responses were applied to audiovisual trials to estimate whether and when spatial representations of one modality were biased toward the other. Behaviourally, participants integrated cues but showed slight visual over-weighting. Neural decoding revealed robust spatial representations for both modalities, with early unisensory encoding remaining unaffected by cross-modal input. Cross-modal biases emerged only later (from ∼200 ms onwards), within a generalised representational window, and occurred sequentially: auditory representations were biased earlier than visual. These findings indicate that multisensory spatial integration arises via recurrent feedback during later processing stages, while early sensory-specific representations remain independent, providing a neural basis for the temporal dynamics underlying the ventriloquist effect. Significance statement Understanding how the brain integrates spatial information across the senses is central to theories of perception, yet the timing of cross-modal influences on modality-specific neural representations remains unclear. Using EEG and cross-generalised inverted encoding models, we tracked auditory and visual spatial representations with millisecond precision. Early spatial representations remained unisensory despite synchronous audiovisual stimulation. A shared, generalised spatial representation emerged at ∼200 ms, after which cross-modal biases appeared-first in auditory and later in visual codes. These results show that spatial integration is implemented through late, feedback-driven processes operating on initially independent sensory estimates, resolving a long-standing discrepancy between early multisensory interactions and late spatial ventriloquism.

Journal of Neuroscience
The University of Sydney (AU), The University of Queensland (AU)
Medical Research Council, National Health and Medical Research Council
Openalex Percentile: Top 7%
Multisensory perception and integration
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.