Humans and convolutional neural networks prioritize similar visual features in intuitive physics judgments

Humans reliably infer complex physical relationships between objects in everyday scenes, yet the mechanisms underlying these judgments remain unclear. We explored whether convolutional neural networks (CNNs) can approximate intuitive physical reasoning by capturing statistical regularities in visual experience. We trained a CNN (Inception-v4) to predict tower stability and tested how well its outputs aligned with human judgments (N = 500). CNN predictions more closely matched human judgments (r = 0.718, p < 0.001, accuracy = 81%) than ground-truth predictions from physics simulations (r = 0.406, p = 0.002, accuracy = 68%), suggesting that both CNNs and humans rely on visual heuristics. Eye-tracking data revealed that CNN importance maps overlapped significantly with human gaze patterns, indicating shared attention to features statistically predictive of physical outcomes in intuitive physical judgments. Our findings show that CNNs trained on visual data capture perceptual cues used in human intuitive physics, highlighting their value as models of heuristic reasoning.

Publication Details

Journal
eScholarship (California Digital Library)
Published
2025-01-01
Primary Topic
History of Computing Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Humans and convolutional neural networks prioritize similar visual features in intuitive physics judgments

eScholarship (California Digital Library)
History of Computing Technologies
article

Humans and convolutional neural networks prioritize similar visual features in intuitive physics judgments

article en

Abstract

Humans reliably infer complex physical relationships between objects in everyday scenes, yet the mechanisms underlying these judgments remain unclear. We explored whether convolutional neural networks (CNNs) can approximate intuitive physical reasoning by capturing statistical regularities in visual experience. We trained a CNN (Inception-v4) to predict tower stability and tested how well its outputs aligned with human judgments (N = 500). CNN predictions more closely matched human judgments (r = 0.718, p < 0.001, accuracy = 81%) than ground-truth predictions from physics simulations (r = 0.406, p = 0.002, accuracy = 68%), suggesting that both CNNs and humans rely on visual heuristics. Eye-tracking data revealed that CNN importance maps overlapped significantly with human gaze patterns, indicating shared attention to features statistically predictive of physical outcomes in intuitive physical judgments. Our findings show that CNNs trained on visual data capture perceptual cues used in human intuitive physics, highlighting their value as models of heuristic reasoning.

eScholarship (California Digital Library)
Peace, Justice and strong institutions
Openalex Percentile: Top 42%
History of Computing Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Humans and convolutional neural networks prioritize similar visual features in intuitive physics judgments · eScholarship (California Digital Library) (2025) | TGRS Research Map | TGRS