Common representational format in object-selective visual cortex for photographs and dynamic sketches

Object recognition is a central function of the brain’s ventral visual pathway. Many experiments have identified putative category-specific processing areas within human ventral temporal cortex. In particular, multivariate pattern analysis has revealed distributed representations of objects in Ventral Temporal (VT) cortex and Lateral Occipital Complex (LOC). Previous object recognition experiments have employed photographic images or photo-realistic line drawings as stimuli. However, humans also readily identify rough, quickly rendered, hand-drawn sketches of objects. Here, we selected stimuli from photographs and sketch drawings (collected from Google’s “Quick, Draw!” dataset) in animate (faces and body parts) and inanimate (natural and artificial objects) categories. Participants viewed static images of the photographs and dynamically drawn sketches in separate runs while brain responses were recorded via fMRI. Consistent with past research, multivariate pattern classification methods distinguished representations of different objects in photographic images in VT/LOC. Furthermore, above-chance performance of the classifier in decoding brain activity corresponding to rough sketches indicated the presence of information about their categories in object-processing areas. Cross-decoding between formats also yielded significant positive results, and the representational similarity followed previously reported structure of similarity in these regions. Together, we find shared representations of static photos and dynamically drawn sketches of objects, indicating a high-level representation of object category in the visual hierarchy that is largely feature-independent with respect to the presented stimulus format.

Authors

Institutions

Publication Details

Journal
Journal of Vision
Published
2024-09-15
DOI
https://doi.org/10.1167/jov.24.10.962
Primary Topic
Visual Attention and Saliency Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Common representational format in object-selective visual cortex for photographs and dynamic sketches

Sharif Saleki, Kevin Hartstein, Peter U. Tse
Journal of Vision
Visual Attention and Saliency Detection
article

Common representational format in object-selective visual cortex for photographs and dynamic sketches

Sharif Saleki, Kevin Hartstein, Peter U. Tse
article en

Abstract

Object recognition is a central function of the brain’s ventral visual pathway. Many experiments have identified putative category-specific processing areas within human ventral temporal cortex. In particular, multivariate pattern analysis has revealed distributed representations of objects in Ventral Temporal (VT) cortex and Lateral Occipital Complex (LOC). Previous object recognition experiments have employed photographic images or photo-realistic line drawings as stimuli. However, humans also readily identify rough, quickly rendered, hand-drawn sketches of objects. Here, we selected stimuli from photographs and sketch drawings (collected from Google’s “Quick, Draw!” dataset) in animate (faces and body parts) and inanimate (natural and artificial objects) categories. Participants viewed static images of the photographs and dynamically drawn sketches in separate runs while brain responses were recorded via fMRI. Consistent with past research, multivariate pattern classification methods distinguished representations of different objects in photographic images in VT/LOC. Furthermore, above-chance performance of the classifier in decoding brain activity corresponding to rough sketches indicated the presence of information about their categories in object-processing areas. Cross-decoding between formats also yielded significant positive results, and the representational similarity followed previously reported structure of similarity in these regions. Together, we find shared representations of static photos and dynamically drawn sketches of objects, indicating a high-level representation of object category in the visual hierarchy that is largely feature-independent with respect to the presented stimulus format.

Journal of VisionVol. 24(10)
Dartmouth Hospital (GB)
Openalex Percentile: Top 84%
Visual Attention and Saliency Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Common representational format in object-selective visual cortex for photographs and dynamic sketches — Sharif Saleki, Kevin Hartstein, et al. · Journal of Vision (2024) | TGRS Research Map | TGRS