Enhancing Radiologist Reading Performance by Ordering Screening Mammograms Based on Characteristics That Promote Visual Adaptation

Background Mammographic background characteristics may stimulate human visual adaptation, allowing radiologists to detect abnormalities more effectively. However, it is unclear whether density, or another image characteristic, drives visual adaptation. Purpose To investigate whether screening performance improves when screening mammography examinations are ordered for batch reading according to mammographic characteristics that may promote visual adaptation. Materials and Methods This retrospective multireader multicase study was performed with mammograms obtained between September 2016 and May 2019. The screening examinations, each consisting of four mammograms, were interpreted by 13 radiologists in three distinct orders: randomly, by increasing volumetric breast density (VBD), and based on a self-supervised learning (SSL) encoding (examinations automatically grouped as "looking similar"). An eye tracker recorded radiologists' eye movements during interpretation. The area under the receiver operating characteristic curve (AUC), sensitivity, and specificity of random-ordered readings were compared with those of VBD- and SSL-ordered readings using mixed-model analysis of variance. Reading time, fixation metrics, and perceived density were compared using Wilcoxon signed-rank tests. Results Mammography examinations (75 with breast cancer, 75 without breast cancer) from 150 women (median age, 55 years [IQR, 50-63]) were read. The examinations ordered by increasing VBD versus randomly had an increased AUC (0.93 [95% CI: 0.91, 0.96] vs 0.92 [95% CI: 0.89, 0.95]; <i>P</i> = .009), without evidence of a difference in specificity (89% [871 of 975] vs 86% [837 of 975], <i>P</i> = .04) and sensitivity (both 81% [794 of 975 vs 788 of 975], <i>P</i> = .78), and a reduced reading time (24.3 vs 27.9 seconds, <i>P</i> < .001), fixation count (47 vs 52, <i>P</i> < .001), and fixation time in malignant regions (3.7 vs 4.6 seconds, <i>P</i> < .001). For SSL-ordered readings, there was no evidence of differences in AUC (0.92 [95% CI: 0.89, 0.95]; <i>P</i> = .70), specificity (84% [820 of 975], <i>P</i> = .37), sensitivity (80% [784 of 975], <i>P</i> = .79), fixation count (54, <i>P</i> = .05), or fixation time in malignant regions (4.6 seconds, <i>P</i> > .99) compared with random-ordered readings. Reading times were significantly higher for SSL-ordered readings compared with random-ordered readings (28.4 seconds, <i>P</i> = .02). Conclusion Screening mammography examinations ordered from low to high VBD improved screening performance while reducing reading and fixation times. © RSNA, 2024 <i>Supplemental material is available for this article.</i> See also the editorial by Grimm in this issue.

Authors

Institutions

Publication Details

Journal
Radiology
Published
2024-10-01
DOI
https://doi.org/10.1148/radiol.240237
Citations
6
Primary Topic
AI in cancer detection
Type
article
Field-Weighted Citation Impact
2.08

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Radiologist Reading Performance by Ordering Screening Mammograms Based on Characteristics That Promote Visual Adaptation

Jessie Gommers, Lucien E. M. Duijm, Osman B. Kavcar, D. B. Naafs et al.
6 citations
Radiology
AI in cancer detection
2.08
article

Enhancing Radiologist Reading Performance by Ordering Screening Mammograms Based on Characteristics That Promote Visual Adaptation

Jessie Gommers, Lucien E. M. Duijm, Osman B. Kavcar, D. B. Naafs, Craig K. Abbey, Sarah D. Verboom, Mireille J. M. Broeders, Jan-Kees van Rooden, Ioannis Sechopoulos, Janneke B. Houwers, Katya M. Duvivier, A Fleur van Raamt
article en
6 citations

Abstract

Background Mammographic background characteristics may stimulate human visual adaptation, allowing radiologists to detect abnormalities more effectively. However, it is unclear whether density, or another image characteristic, drives visual adaptation. Purpose To investigate whether screening performance improves when screening mammography examinations are ordered for batch reading according to mammographic characteristics that may promote visual adaptation. Materials and Methods This retrospective multireader multicase study was performed with mammograms obtained between September 2016 and May 2019. The screening examinations, each consisting of four mammograms, were interpreted by 13 radiologists in three distinct orders: randomly, by increasing volumetric breast density (VBD), and based on a self-supervised learning (SSL) encoding (examinations automatically grouped as "looking similar"). An eye tracker recorded radiologists' eye movements during interpretation. The area under the receiver operating characteristic curve (AUC), sensitivity, and specificity of random-ordered readings were compared with those of VBD- and SSL-ordered readings using mixed-model analysis of variance. Reading time, fixation metrics, and perceived density were compared using Wilcoxon signed-rank tests. Results Mammography examinations (75 with breast cancer, 75 without breast cancer) from 150 women (median age, 55 years [IQR, 50-63]) were read. The examinations ordered by increasing VBD versus randomly had an increased AUC (0.93 [95% CI: 0.91, 0.96] vs 0.92 [95% CI: 0.89, 0.95]; <i>P</i> = .009), without evidence of a difference in specificity (89% [871 of 975] vs 86% [837 of 975], <i>P</i> = .04) and sensitivity (both 81% [794 of 975 vs 788 of 975], <i>P</i> = .78), and a reduced reading time (24.3 vs 27.9 seconds, <i>P</i> < .001), fixation count (47 vs 52, <i>P</i> < .001), and fixation time in malignant regions (3.7 vs 4.6 seconds, <i>P</i> < .001). For SSL-ordered readings, there was no evidence of differences in AUC (0.92 [95% CI: 0.89, 0.95]; <i>P</i> = .70), specificity (84% [820 of 975], <i>P</i> = .37), sensitivity (80% [784 of 975], <i>P</i> = .79), fixation count (54, <i>P</i> = .05), or fixation time in malignant regions (4.6 seconds, <i>P</i> > .99) compared with random-ordered readings. Reading times were significantly higher for SSL-ordered readings compared with random-ordered readings (28.4 seconds, <i>P</i> = .02). Conclusion Screening mammography examinations ordered from low to high VBD improved screening performance while reducing reading and fixation times. © RSNA, 2024 <i>Supplemental material is available for this article.</i> See also the editorial by Grimm in this issue.

RadiologyVol. 313(1)
University of Nevada, Reno (US), Radboud University Nijmegen (NL), University of California, Santa Barbara (US), University Medical Center (US), Radboud University Medical Center (NL), Maastricht University (NL), Diakonessenhuis hospital (NL), Dutch Expert Centre for Screening (NL), Canisius-Wilhelmina Ziekenhuis (NL), University of Twente (NL)
Nederlandse Organisatie voor Wetenschappelijk Onderzoek, KWF Kankerbestrijding, University of California, Santa Barbara
Quality Education
Openalex Percentile: Top 11%
AI in cancer detection
2.08
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.