The role of expectations in visual spatial coding across the visual hierarchy

Predictive processing theorizes that the brain predicts events based on prior experiences. Mismatches between the predictions and input lead to prediction errors (PEs). Despite the theory's popularity, our understanding of the role of PEs in visual spatial perception remains limited. Here, we investigated predicted and unpredicted coding of visual locations across the visual hierarchy, utilizing the predictability of the standard population receptive field (pRF) mapping paradigm while sampling BOLD responses at ultra-high field fMRI. Our experiment featured different conditions in which unpredictable stimulus omissions and/or violations (different bar location and orientation) were either embedded in the standard stimulus sequence, or presented separately. These conditions serve to produce prediction errors, both of stimulus presence and of stimulus location. For all conditions, we first calculated test-retest reliability of BOLD responses to identical stimulus sequences in different brain regions. We reasoned that if PEs drive BOLD responses, this should increase test-retest reliability across runs relative to a fully predictable stimulus design. We indeed find this pattern of results selectively in higher-level and not lower level visual cortex. Next, we fit a spatial divisive normalisation (DN-pRF) model to the BOLD timecourses in the standard pRF stimulus sequence, and tested whether bold timecourses in conditions with unexpected stimuli follow this model, which is linear in time. This analysis also indicates that PEs drive high-level visual cortex responses more than low-level visual cortex. These findings suggest that prediction error responses in visual cortex follow the evolution of temporal scales of integration, from fast to slow, along the visual hierarchy. This hints at a tight relationship between temporal divisive normalization and predictive processing.

Authors

Institutions

Publication Details

Journal
Journal of Vision
Published
2024-09-15
DOI
https://doi.org/10.1167/jov.24.10.1164
Primary Topic
Aesthetic Perception and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The role of expectations in visual spatial coding across the visual hierarchy

Jan Theeuwes, Gilles de Hollander, Tomas Knapen, Jurjen Heij et al.
Journal of Vision
Aesthetic Perception and Analysis
article

The role of expectations in visual spatial coding across the visual hierarchy

Jan Theeuwes, Gilles de Hollander, Tomas Knapen, Jurjen Heij, Ningkai Wang, Ralph Wientjens
article en

Abstract

Predictive processing theorizes that the brain predicts events based on prior experiences. Mismatches between the predictions and input lead to prediction errors (PEs). Despite the theory's popularity, our understanding of the role of PEs in visual spatial perception remains limited. Here, we investigated predicted and unpredicted coding of visual locations across the visual hierarchy, utilizing the predictability of the standard population receptive field (pRF) mapping paradigm while sampling BOLD responses at ultra-high field fMRI. Our experiment featured different conditions in which unpredictable stimulus omissions and/or violations (different bar location and orientation) were either embedded in the standard stimulus sequence, or presented separately. These conditions serve to produce prediction errors, both of stimulus presence and of stimulus location. For all conditions, we first calculated test-retest reliability of BOLD responses to identical stimulus sequences in different brain regions. We reasoned that if PEs drive BOLD responses, this should increase test-retest reliability across runs relative to a fully predictable stimulus design. We indeed find this pattern of results selectively in higher-level and not lower level visual cortex. Next, we fit a spatial divisive normalisation (DN-pRF) model to the BOLD timecourses in the standard pRF stimulus sequence, and tested whether bold timecourses in conditions with unexpected stimuli follow this model, which is linear in time. This analysis also indicates that PEs drive high-level visual cortex responses more than low-level visual cortex. These findings suggest that prediction error responses in visual cortex follow the evolution of temporal scales of integration, from fast to slow, along the visual hierarchy. This hints at a tight relationship between temporal divisive normalization and predictive processing.

Journal of VisionVol. 24(10)
University of Zurich (CH), Spinoza Centre for Neuroimaging (NL), Vrije Universiteit Amsterdam (NL)
Reduced inequalities
Openalex Percentile: Top 83%
Aesthetic Perception and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.