Changes in Reader Performance During Sequential Reading of Breast Cancer Screening Digital Breast Tomosynthesis Examinations

Background Studies suggest that readers experience perceptual adaptation when interpreting batched screening mammograms, which may serve as a mechanism for improved performance. Purpose To analyze clinical digital breast tomosynthesis (DBT) screening data to evaluate changes in reader performance during sequential batch reading. Materials and Methods This observational retrospective study used data from the radiology information system collected for screening DBT examinations performed from January 2018 to December 2019. The reference standard was established based on pathology results, if applicable, or imaging findings at 1-year follow-up. Examinations were aggregated into batches, defined as a sequence of cases for a given reader with differences in interexamination time of 10 minutes or less. Mixed-effect models were used to evaluate performance and timing across batch positions. Statistical adjustments accounted for potential confounders, including patient characteristics (age, breast density), reading factors (day of week, time of day), and between-reader heterogeneity. Results The dataset included 121 652 examinations (median patient age, 61 years [IQR, 53-69 years]), including 1081 cancers interpreted by 15 radiologists. Unadjusted false-positive rates decreased from an averaged 15.5% at the first within-batch examination to 10.5% after three sequentially read examinations (<i>P</i> < .001), without a significant change in sensitivity (82.6% vs 84.2%; <i>P</i> = .15). The interpretation time consistently decreased, achieving a substantial reduction in longer batches (average 2.8 to 2.2 minutes for noncancer examinations; <i>P</i> < .001). Adjustment for sampling bias and confounders (patient age, breast density, day of week, time of day; all <i>P</i> < .005) reduced the effect on false-positive rates (11.5% to 9.4% after three examinations; <i>P</i> < .001) and interpretation time (3.2 to 2.7 minutes for noncancer examinations; <i>P</i> < .001). Conclusion Radiologists showed improved recall rates and interpretation times without change in sensitivity over the course of batch reading of DBT screening examinations. © RSNA, 2024 See also the editorial by Iima and Satake in this issue.

Authors

Institutions

Publication Details

Journal
Radiology
Published
2024-11-01
DOI
https://doi.org/10.1148/radiol.232885
Citations
4
Primary Topic
Digital Radiography and Breast Imaging
Type
article
Field-Weighted Citation Impact
1.68

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Changes in Reader Performance During Sequential Reading of Breast Cancer Screening Digital Breast Tomosynthesis Examinations

Osman B. Kavcar, Andriy I. Bandos, Craig K. Abbey, Margarita L. Zuley et al.
4 citations
Radiology
Digital Radiography and Breast Imaging
1.68
article

Changes in Reader Performance During Sequential Reading of Breast Cancer Screening Digital Breast Tomosynthesis Examinations

Osman B. Kavcar, Andriy I. Bandos, Craig K. Abbey, Margarita L. Zuley, Mohana Kuppuswamy Parthasarathy
article en
4 citations

Abstract

Background Studies suggest that readers experience perceptual adaptation when interpreting batched screening mammograms, which may serve as a mechanism for improved performance. Purpose To analyze clinical digital breast tomosynthesis (DBT) screening data to evaluate changes in reader performance during sequential batch reading. Materials and Methods This observational retrospective study used data from the radiology information system collected for screening DBT examinations performed from January 2018 to December 2019. The reference standard was established based on pathology results, if applicable, or imaging findings at 1-year follow-up. Examinations were aggregated into batches, defined as a sequence of cases for a given reader with differences in interexamination time of 10 minutes or less. Mixed-effect models were used to evaluate performance and timing across batch positions. Statistical adjustments accounted for potential confounders, including patient characteristics (age, breast density), reading factors (day of week, time of day), and between-reader heterogeneity. Results The dataset included 121 652 examinations (median patient age, 61 years [IQR, 53-69 years]), including 1081 cancers interpreted by 15 radiologists. Unadjusted false-positive rates decreased from an averaged 15.5% at the first within-batch examination to 10.5% after three sequentially read examinations (<i>P</i> < .001), without a significant change in sensitivity (82.6% vs 84.2%; <i>P</i> = .15). The interpretation time consistently decreased, achieving a substantial reduction in longer batches (average 2.8 to 2.2 minutes for noncancer examinations; <i>P</i> < .001). Adjustment for sampling bias and confounders (patient age, breast density, day of week, time of day; all <i>P</i> < .005) reduced the effect on false-positive rates (11.5% to 9.4% after three examinations; <i>P</i> < .001) and interpretation time (3.2 to 2.7 minutes for noncancer examinations; <i>P</i> < .001). Conclusion Radiologists showed improved recall rates and interpretation times without change in sensitivity over the course of batch reading of DBT screening examinations. © RSNA, 2024 See also the editorial by Iima and Satake in this issue.

RadiologyVol. 313(2)
Magee-Womens Hospital (US)
National Institutes of Health
Quality Education
Openalex Percentile: Top 14%
Digital Radiography and Breast Imaging
1.68
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.