Systematic Empirical Evaluation of Fixation Dispersion Metrics for Visual Search and Free Viewing Classification Using Random Forests

We evaluated whether interpretable spatial gaze descriptors discriminate trials from the COCO-Search18 Visual Search dataset and the companion COCO-FreeView dataset while generalizing to participants not used for model fitting. The primary analysis included 45,765 participant-by-image trials from 2094 shared images (20,879 Freeview; 24,886 Visual Search) contributed by two separate 10-participant cohorts. Twelve eye-tracking features representing 10 conceptual families were computed in normalized display coordinates. A Random Forest with a fixed, documented hyperparameter configuration was evaluated using participant-grouped cross-validation. The unadjusted spatial-feature model achieved out-of-fold accuracy 0.9105 and ROC-AUC 0.9632. However, fixation count alone achieved AUC 0.9533, and cumulative recorded fixation duration alone achieved AUC 0.9786, demonstrating strong trial-length differences between the source datasets. After exact fixation-count matching within every validation fold, the count-only negative control returned AUC 0.5000, whereas the spatial-feature model retained mean AUC 0.7999 across 20 matched samples. Thus, spatial gaze descriptors retain residual predictive information after count matching, but the unadjusted performance cannot be attributed to spatial geometry alone. Because the condition is also perfectly confounded with the cohort and acquisition context, the findings do not isolate a causal task-instruction effect.

Authors

Institutions

Publication Details

Journal
Journal of Imaging
Published
2026-11-19
DOI
https://doi.org/10.3390/jimaging12110585
Primary Topic
Visual Attention and Saliency Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Systematic Empirical Evaluation of Fixation Dispersion Metrics for Visual Search and Free Viewing Classification Using Random Forests

E. Akinola, W. Joseph MacInnes
Journal of Imaging
Visual Attention and Saliency Detection
article

Systematic Empirical Evaluation of Fixation Dispersion Metrics for Visual Search and Free Viewing Classification Using Random Forests

E. Akinola, W. Joseph MacInnes
article en

Abstract

We evaluated whether interpretable spatial gaze descriptors discriminate trials from the COCO-Search18 Visual Search dataset and the companion COCO-FreeView dataset while generalizing to participants not used for model fitting. The primary analysis included 45,765 participant-by-image trials from 2094 shared images (20,879 Freeview; 24,886 Visual Search) contributed by two separate 10-participant cohorts. Twelve eye-tracking features representing 10 conceptual families were computed in normalized display coordinates. A Random Forest with a fixed, documented hyperparameter configuration was evaluated using participant-grouped cross-validation. The unadjusted spatial-feature model achieved out-of-fold accuracy 0.9105 and ROC-AUC 0.9632. However, fixation count alone achieved AUC 0.9533, and cumulative recorded fixation duration alone achieved AUC 0.9786, demonstrating strong trial-length differences between the source datasets. After exact fixation-count matching within every validation fold, the count-only negative control returned AUC 0.5000, whereas the spatial-feature model retained mean AUC 0.7999 across 20 matched samples. Thus, spatial gaze descriptors retain residual predictive information after count matching, but the unadjusted performance cannot be attributed to spatial geometry alone. Because the condition is also perfectly confounded with the cohort and acquisition context, the findings do not isolate a causal task-instruction effect.

Journal of ImagingVol. 12(11)
Swansea University (GB)
Visual Attention and Saliency Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon