A Deep Learning Framework for Visual Attention Prediction and Analysis of News Interfaces
News outlets' competition for attention in news interfaces has highlighted the need for demographically-aware saliency prediction models. Despite recent advancements in saliency detection applied to user interfaces (UI), existing datasets are limited in size and demographic representation. We present a deep learning framework that enhances the SaRa (Saliency Ranking) model with DeepGaze IIE, improving Salient Object Ranking (SOR) performance by 10.7%. Our framework optimizes three key components: saliency map generation, grid segment scoring, and map normalization. Through a two-fold experiment using eye-tracking (<tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathbf{3 0}$</tex> participants) and mousetracking (<tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathbf{3 7 5}$</tex> participants aged 13-70), we analyze attention patterns across demographic groups. Statistical analysis reveals significant age-based variations (<tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathbf{p}<0.05, \epsilon^{2}=0.042$</tex>), with older users (36-70) engaging more with textual content and younger users (13-35) interacting more with images. Mouse-tracking data closely approximates eye-tracking behavior (sAUC=0.86) and identifies UI elements that immediately stand out, validating its use in large-scale studies. We conclude that saliency studies should prioritize gathering data from a larger, demographically representative sample and report exact demographic distributions.
Authors
- Chris Porter (ORCID: https://orcid.org/0000-0003-3813-2941)
- Dylan Seychell (ORCID: https://orcid.org/0000-0002-2377-9833)
- Carl James Debono (ORCID: https://orcid.org/0000-0003-2659-8752)
- Matthew Kenely (ORCID: https://orcid.org/0009-0006-3417-7260)
Institutions
- University of Malta (MT)
Publication Details
- Published
- 2025-05-05
- DOI
- https://doi.org/10.1109/cai64502.2025.00050
- Primary Topic
- Visual Attention and Saliency Detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00