Perceptual Complexity as Normalized Shannon Entropy

Complexity is one of the most important variables in how the brain performs decision making based on esthetic values. Multiple definitions of perceptual complexity have been proposed, with one of the most fruitful being the Normalized Shannon Entropy one. However, the Normalized Shannon Entropy definition has theoretical gaps that we address in this article. Focusing on visual perception, we first address whether normalization fully corrects for the effects of measurement resolution on entropy. The answer is negative, but the remaining effects are minor, and we propose alternate definitions of complexity, correcting this problem. Related to resolution, we discuss the ideal spatial range in the computation of spatial complexity. The results show that this range must be small but not too small. Furthermore, it is suggested by the analysis of this range that perceptual spatial complexity is based solely on translational isometry. Finally, we study how the complexities of distinct visual variables interact. We argue that the complexities of the variables of interest to the brain's visual system may not interact linearly because of interclass correlation. But the interaction would be linear if the brain weighed complexities as in Kempthorne's λ-Bayes-based compromise problem. We finish by listing several experimental tests of these theoretical ideas on complexity.

Authors

Institutions

Publication Details

Journal
Entropy
Published
2025-02-05
DOI
https://doi.org/10.3390/e27020166
Citations
7
Primary Topic
Visual perception and processing mechanisms
Type
article
Field-Weighted Citation Impact
10.02

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Perceptual Complexity as Normalized Shannon Entropy

Norberto M. Grzywacz
7 citations
Entropy
Visual perception and processing mechanisms
10.02
article

Perceptual Complexity as Normalized Shannon Entropy

Norberto M. Grzywacz
article en
7 citations

Abstract

Complexity is one of the most important variables in how the brain performs decision making based on esthetic values. Multiple definitions of perceptual complexity have been proposed, with one of the most fruitful being the Normalized Shannon Entropy one. However, the Normalized Shannon Entropy definition has theoretical gaps that we address in this article. Focusing on visual perception, we first address whether normalization fully corrects for the effects of measurement resolution on entropy. The answer is negative, but the remaining effects are minor, and we propose alternate definitions of complexity, correcting this problem. Related to resolution, we discuss the ideal spatial range in the computation of spatial complexity. The results show that this range must be small but not too small. Furthermore, it is suggested by the analysis of this range that perceptual spatial complexity is based solely on translational isometry. Finally, we study how the complexities of distinct visual variables interact. We argue that the complexities of the variables of interest to the brain's visual system may not interact linearly because of interclass correlation. But the interaction would be linear if the brain weighed complexities as in Kempthorne's λ-Bayes-based compromise problem. We finish by listing several experimental tests of these theoretical ideas on complexity.

EntropyVol. 27(2)
Johns Hopkins University (US), Loyola University Chicago (US)
Loyola University Chicago
Peace, Justice and strong institutions
Openalex Percentile: Top 2%
Visual perception and processing mechanisms
10.02
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.