450 Estimating Cognitive Load Via Pupil Diameter: A Novel Metric for Assessing Neurosurgical Residency Applicants
INTRODUCTION: Neurosurgical residency applicants are traditionally evaluated on metrics that do not reflect technical ability. While dexterity tests are sometimes used, they do not reveal the internal processing behind a test outcome. Cognitive load (CL) can provide insight into the bandwidth required to perform tasks and whether residual capacity exists for increasing task burden. The baseline change in pupil diameter (BCPD) can be used to calculate CL, providing insights into mental effort and decision-making processes. METHODS: We compared CL between six preclinical and six clinical medical students and four residents performing surgical knot-tying and finger dexterity tests while wearing point-of-view and eye-tracking cameras. We defined BCPD by computing a reference average pupil diameter established during the first task. We calculated task CL by measuring the average difference between baseline and current pupil diameter. RESULTS: Preclinical students had higher average BCPD values (−0.07) than clinical students (−0.56). Resident BCPD averaged −0.16. Increasingly negative values suggest lower CLs. One resident’s BCPD was 1.28 (test score >93rd percentile); when removed, the average resident BCPD was -1.9. Low CL was weakly correlated (0.029) with increased task completion time. Tool motion was not significantly different between groups. Residents had more stable gaze entropy (0.33) than preclinical (0.46) and clinical students (0.58). CONCLUSIONS: With increasing clinical experience, CL during simulated dexterity tasks declined significantly but did not reliably predict task completion time. This suggests that working memory may be occupied despite rapid completion time, making it difficult to attend to unexpected events. Incorporating measures of CL alongside other machine learning-enabled metrics may provide a more objective means of evaluating residency applicants while identifying opportunities for personalized education. The next steps include ongoing data acquisition from more students, residents, and attendings.
Authors
- Emily Johnson (ORCID: https://orcid.org/0000-0002-9334-1482)
- Kelly Jiang (ORCID: https://orcid.org/0000-0002-1144-7882)
- Alice Hung (ORCID: https://orcid.org/0000-0001-6815-3765)
- Wuyang Yang (ORCID: https://orcid.org/0000-0001-5934-7795)
- Connor Liu
- S. Swaroop Vedula (ORCID: https://orcid.org/0000-0002-6992-2957)
- Judy Huang (ORCID: https://orcid.org/0000-0002-0675-1935)
- Jose L. Porras (ORCID: https://orcid.org/0000-0001-8664-7646)
- Smruti Mahapatra (ORCID: https://orcid.org/0000-0001-5303-1570)
- Aidan Leong (ORCID: https://orcid.org/0000-0003-2853-404X)
- Roger D. Soberanis-Mukul (ORCID: https://orcid.org/0000-0003-0712-0534)
- Mackenzie Cullen
- Henry Brem (ORCID: https://orcid.org/0000-0001-7539-4786)
- Nicholas Theodore (ORCID: https://orcid.org/0000-0001-5355-2683)
- Masaru Ishii (ORCID: https://orcid.org/0000-0002-4215-007X)
- Timour Al‐Khindi (ORCID: https://orcid.org/0000-0003-2431-6096)
- Chetan Bettegowda (ORCID: https://orcid.org/0000-0001-9991-7123)
- Carly Weber-Levine (ORCID: https://orcid.org/0000-0003-2057-8419)
- K. Joshi (ORCID: https://orcid.org/0000-0002-8981-5219)
- Mathias Unberath (ORCID: https://orcid.org/0000-0002-0055-9950)
- Gary L. Gallia (ORCID: https://orcid.org/0000-0001-6438-7329)
- Jiachen Liu (ORCID: https://orcid.org/0000-0002-0263-3704)
- Rohit Shankar
Publication Details
- Journal
- Neurosurgery
- Published
- 2025-03-14
- DOI
- https://doi.org/10.1227/neu.0000000000003360_450
- Primary Topic
- Surgical Simulation and Training
- Type
- article
- Field-Weighted Citation Impact
- 0.00