Pupillometric Analysis of Cognitive Load in Relation to Relevance and Confirmation Bias

Relevance assessment is fundamental to Interactive Information Retrieval (IIR), and understanding the underlying cognitive processes is essential for optimizing user experience.To investigate how relevance and confirmation bias relate to cognitive load, we conducted a within-subject, lab-based, eye-tracking experiment (N=32).We applied the Low/High Index of Pupillary Activity (LHIPA) to measure cognitive load.LHIPA was calculated based on changes in pupil diameter and was unaffected by lighting conditions.Our results suggest that during relevance assessment: (1) for topically irrelevant documents, cognitive load is higher when users perceive them as relevant; for topically relevant documents, cognitive load is higher when users perceive them as irrelevant; (2) users with higher levels of topic familiarity and interest expend more cognitive load; and (3) users with higher predisposition to confirmation bias invest less cognitive load.These findings demonstrate that during relevance assessment, users' perceived relevance, topical knowledge, interest, and confirmation bias tendency influence cognitive load levels.This research has implications for improving user interface design to facilitate more accurate relevance judgments and more effective, unbiased information retrieval.

Authors

Institutions

Publication Details

Published
2025-03-24
DOI
https://doi.org/10.1145/3698204.3716458
Primary Topic
Human-Automation Interaction and Safety
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Pupillometric Analysis of Cognitive Load in Relation to Relevance and Confirmation Bias

Jacek Gwizdka, Gavindya Jayawardena, Li Shi
Human-Automation Interaction and Safety
article

Pupillometric Analysis of Cognitive Load in Relation to Relevance and Confirmation Bias

Jacek Gwizdka, Gavindya Jayawardena, Li Shi
article en

Abstract

Relevance assessment is fundamental to Interactive Information Retrieval (IIR), and understanding the underlying cognitive processes is essential for optimizing user experience.To investigate how relevance and confirmation bias relate to cognitive load, we conducted a within-subject, lab-based, eye-tracking experiment (N=32).We applied the Low/High Index of Pupillary Activity (LHIPA) to measure cognitive load.LHIPA was calculated based on changes in pupil diameter and was unaffected by lighting conditions.Our results suggest that during relevance assessment: (1) for topically irrelevant documents, cognitive load is higher when users perceive them as relevant; for topically relevant documents, cognitive load is higher when users perceive them as irrelevant; (2) users with higher levels of topic familiarity and interest expend more cognitive load; and (3) users with higher predisposition to confirmation bias invest less cognitive load.These findings demonstrate that during relevance assessment, users' perceived relevance, topical knowledge, interest, and confirmation bias tendency influence cognitive load levels.This research has implications for improving user interface design to facilitate more accurate relevance judgments and more effective, unbiased information retrieval.

The University of Texas at Austin (US)
University of Texas at Austin
Reduced inequalities
Openalex Percentile: Top 90%
Human-Automation Interaction and Safety
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.