Categorical object properties outweigh local visual information in object recognition

Certain parts of an object are more critical for recognition than others. Despite decades of research, it is not well understood what these parts are and how they interact with each other. This study investigates if and to which extent categorical object properties interact with local visual information in object recognition. Fifty participants classified fragmented objects from 12 categories, each consisting of 4 unique exemplars (48 objects in total). Exemplars differed in orientation and shape. Their outlines were presented as either curved segments or dots, providing high and low local visual information respectively. Spatial frequencies and fragment’s size were comparable. We gradually increased the number of fragments to quantify the minimum number of fragments necessary to recognize objects. A linear mixed model indicates that participants required significantly fewer curved segments than dots to recognize objects (F(1,48) = 248.05, p<0.001, partial η2 = 0.12). Additionally, the number of fragments necessary for recognition varied across different categories (F(11,38) = 5.93, p<0.001, partial η2 = 0.65). There was only a weak interaction between fragment type and object category indicating independence between these factors (F(11,38) = 3.66, p<0.001, partial η2 = 0.02). As a consequence, when examining object categories individually, differences in exemplars’ recognition were remarkably stable across the two types of fragmentation (r = 0.75, p < 0.01). The effect sizes observed indicate that the minimum visual information needed to recognize object primarily depends on object category, while local visual information plays a secondary role. Thus, we argue that studying the complexity of object categories is key to determine the minimum visual information needed for object recognition. Our results will help to identify the objects’ parts that are crucial for object recognition in visual prostheses where the number of electrodes is restricted.

Authors

Institutions

Publication Details

Journal
Journal of Vision
Published
2024-09-15
DOI
https://doi.org/10.1167/jov.24.10.486
Primary Topic
Image Retrieval and Classification Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Categorical object properties outweigh local visual information in object recognition

Michael H. Herzog, Udo Ernst, David Rotermund, Ben Lonnqvist et al.
Journal of Vision
Image Retrieval and Classification Techniques
article

Categorical object properties outweigh local visual information in object recognition

Michael H. Herzog, Udo Ernst, David Rotermund, Ben Lonnqvist, Elsa Scialom, Zehra Merchant
article en

Abstract

Certain parts of an object are more critical for recognition than others. Despite decades of research, it is not well understood what these parts are and how they interact with each other. This study investigates if and to which extent categorical object properties interact with local visual information in object recognition. Fifty participants classified fragmented objects from 12 categories, each consisting of 4 unique exemplars (48 objects in total). Exemplars differed in orientation and shape. Their outlines were presented as either curved segments or dots, providing high and low local visual information respectively. Spatial frequencies and fragment’s size were comparable. We gradually increased the number of fragments to quantify the minimum number of fragments necessary to recognize objects. A linear mixed model indicates that participants required significantly fewer curved segments than dots to recognize objects (F(1,48) = 248.05, p<0.001, partial η2 = 0.12). Additionally, the number of fragments necessary for recognition varied across different categories (F(11,38) = 5.93, p<0.001, partial η2 = 0.65). There was only a weak interaction between fragment type and object category indicating independence between these factors (F(11,38) = 3.66, p<0.001, partial η2 = 0.02). As a consequence, when examining object categories individually, differences in exemplars’ recognition were remarkably stable across the two types of fragmentation (r = 0.75, p < 0.01). The effect sizes observed indicate that the minimum visual information needed to recognize object primarily depends on object category, while local visual information plays a secondary role. Thus, we argue that studying the complexity of object categories is key to determine the minimum visual information needed for object recognition. Our results will help to identify the objects’ parts that are crucial for object recognition in visual prostheses where the number of electrodes is restricted.

Journal of VisionVol. 24(10)
University of Bremen (DE), École Polytechnique Fédérale de Lausanne (CH)
Reduced inequalities
Openalex Percentile: Top 84%
Image Retrieval and Classification Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.