450 Estimating Cognitive Load Via Pupil Diameter: A Novel Metric for Assessing Neurosurgical Residency Applicants

INTRODUCTION: Neurosurgical residency applicants are traditionally evaluated on metrics that do not reflect technical ability. While dexterity tests are sometimes used, they do not reveal the internal processing behind a test outcome. Cognitive load (CL) can provide insight into the bandwidth required to perform tasks and whether residual capacity exists for increasing task burden. The baseline change in pupil diameter (BCPD) can be used to calculate CL, providing insights into mental effort and decision-making processes. METHODS: We compared CL between six preclinical and six clinical medical students and four residents performing surgical knot-tying and finger dexterity tests while wearing point-of-view and eye-tracking cameras. We defined BCPD by computing a reference average pupil diameter established during the first task. We calculated task CL by measuring the average difference between baseline and current pupil diameter. RESULTS: Preclinical students had higher average BCPD values (−0.07) than clinical students (−0.56). Resident BCPD averaged −0.16. Increasingly negative values suggest lower CLs. One resident’s BCPD was 1.28 (test score >93rd percentile); when removed, the average resident BCPD was -1.9. Low CL was weakly correlated (0.029) with increased task completion time. Tool motion was not significantly different between groups. Residents had more stable gaze entropy (0.33) than preclinical (0.46) and clinical students (0.58). CONCLUSIONS: With increasing clinical experience, CL during simulated dexterity tasks declined significantly but did not reliably predict task completion time. This suggests that working memory may be occupied despite rapid completion time, making it difficult to attend to unexpected events. Incorporating measures of CL alongside other machine learning-enabled metrics may provide a more objective means of evaluating residency applicants while identifying opportunities for personalized education. The next steps include ongoing data acquisition from more students, residents, and attendings.

Authors

Publication Details

Journal
Neurosurgery
Published
2025-03-14
DOI
https://doi.org/10.1227/neu.0000000000003360_450
Primary Topic
Surgical Simulation and Training
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

450 Estimating Cognitive Load Via Pupil Diameter: A Novel Metric for Assessing Neurosurgical Residency Applicants

Emily Johnson, Kelly Jiang, Alice Hung, Wuyang Yang et al.
Neurosurgery
Surgical Simulation and Training
article

450 Estimating Cognitive Load Via Pupil Diameter: A Novel Metric for Assessing Neurosurgical Residency Applicants

Emily Johnson, Kelly Jiang, Alice Hung, Wuyang Yang, Connor Liu, S. Swaroop Vedula, Judy Huang, Jose L. Porras, Smruti Mahapatra, Aidan Leong, Roger D. Soberanis-Mukul, Mackenzie Cullen, Henry Brem, Nicholas Theodore, Masaru Ishii, Timour Al‐Khindi, Chetan Bettegowda, Carly Weber-Levine, K. Joshi, Mathias Unberath, Gary L. Gallia, Jiachen Liu, Rohit Shankar
article en

Abstract

INTRODUCTION: Neurosurgical residency applicants are traditionally evaluated on metrics that do not reflect technical ability. While dexterity tests are sometimes used, they do not reveal the internal processing behind a test outcome. Cognitive load (CL) can provide insight into the bandwidth required to perform tasks and whether residual capacity exists for increasing task burden. The baseline change in pupil diameter (BCPD) can be used to calculate CL, providing insights into mental effort and decision-making processes. METHODS: We compared CL between six preclinical and six clinical medical students and four residents performing surgical knot-tying and finger dexterity tests while wearing point-of-view and eye-tracking cameras. We defined BCPD by computing a reference average pupil diameter established during the first task. We calculated task CL by measuring the average difference between baseline and current pupil diameter. RESULTS: Preclinical students had higher average BCPD values (−0.07) than clinical students (−0.56). Resident BCPD averaged −0.16. Increasingly negative values suggest lower CLs. One resident’s BCPD was 1.28 (test score >93rd percentile); when removed, the average resident BCPD was -1.9. Low CL was weakly correlated (0.029) with increased task completion time. Tool motion was not significantly different between groups. Residents had more stable gaze entropy (0.33) than preclinical (0.46) and clinical students (0.58). CONCLUSIONS: With increasing clinical experience, CL during simulated dexterity tasks declined significantly but did not reliably predict task completion time. This suggests that working memory may be occupied despite rapid completion time, making it difficult to attend to unexpected events. Incorporating measures of CL alongside other machine learning-enabled metrics may provide a more objective means of evaluating residency applicants while identifying opportunities for personalized education. The next steps include ongoing data acquisition from more students, residents, and attendings.

NeurosurgeryVol. 71(Supplement_1)
Openalex Percentile: Top 92%
Surgical Simulation and Training
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.