AI-Assisted Follow-Up MRI Interpretation in Multiple Sclerosis: Radiology Residents’ Diagnostic Confidence and Performance

Background/Objectives: Artificial intelligence (AI) tools are becoming increasingly utilised in everyday radiological practice. Evaluating follow-up magnetic resonance imaging (MRI) of patients with multiple sclerosis (MS) is challenging. The aim of this study was to assess changes in confidence among four participating radiology residents when evaluating follow-up MRIs of MS patients using Pixyl.Neuro.MS® software. Methods: This retrospective study included 78 MS patients. Previous and new FLAIR images were independently analysed by four residents, first without AI and then in an immediate AI-assisted second reading using Pixyl.Neuro.MS®, a deep-learning lesion-segmentation software. Readers recorded their findings and confidence after each reading and rated the impact and usefulness of AI. The reference standard was defined by a consensus reading of a neuroradiologist and a radiology resident (15 and 4 years of experience). Paired analyses and patient-level bootstrap confidence intervals were used; bootstrap inference was conditional on the four readers. Results: The reference standard identified 24 patients with new lesions. Mean accuracy across readers increased from 84.62% to 90.71% (difference, 6.09 percentage points; 95% bootstrap confidence interval [CI], 2.24–10.26). Only Reader 3 showed a significant accuracy increase after Holm adjustment (p = 0.025). No accuracy comparison with routine reports was significant after adjustment. Confidence increased for all readers (all Holm-adjusted p < 0.001). Perceived usefulness did not differ significantly between lesion-burden groups. All readers predominantly rated the impact of AI as positive. The second-reading phase was shorter by a mean of 59.35 s (95% bootstrap CI, 51.39–67.07). Conclusions: In these four residents, the AI-assisted second reading was associated with higher confidence and average accuracy. The immediate sequential design prevents separation of AI contributions from familiarity and order effects, and the shorter second-reading phase does not establish an overall workflow time saving.

Authors

Institutions

Publication Details

Journal
Diagnostics
Published
2026-11-18
DOI
https://doi.org/10.3390/diagnostics16223866
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

AI-Assisted Follow-Up MRI Interpretation in Multiple Sclerosis: Radiology Residents’ Diagnostic Confidence and Performance

Jasmina M. Boban, Verónica Muñoz-Ramírez, Marie Blanchère, Myriam Edjlali et al.
7 links
Diagnostics
Artificial Intelligence in Healthcare and Education
article

AI-Assisted Follow-Up MRI Interpretation in Multiple Sclerosis: Radiology Residents’ Diagnostic Confidence and Performance

Jasmina M. Boban, Verónica Muñoz-Ramírez, Marie Blanchère, Myriam Edjlali, Wend-Yam Mohamed Traoré, Milica Mastilović, Olivier Heinzlef, Igor Romčević, Marwa Alkatheeri, Artur Tomlinson
article en

Abstract

Background/Objectives: Artificial intelligence (AI) tools are becoming increasingly utilised in everyday radiological practice. Evaluating follow-up magnetic resonance imaging (MRI) of patients with multiple sclerosis (MS) is challenging. The aim of this study was to assess changes in confidence among four participating radiology residents when evaluating follow-up MRIs of MS patients using Pixyl.Neuro.MS® software. Methods: This retrospective study included 78 MS patients. Previous and new FLAIR images were independently analysed by four residents, first without AI and then in an immediate AI-assisted second reading using Pixyl.Neuro.MS®, a deep-learning lesion-segmentation software. Readers recorded their findings and confidence after each reading and rated the impact and usefulness of AI. The reference standard was defined by a consensus reading of a neuroradiologist and a radiology resident (15 and 4 years of experience). Paired analyses and patient-level bootstrap confidence intervals were used; bootstrap inference was conditional on the four readers. Results: The reference standard identified 24 patients with new lesions. Mean accuracy across readers increased from 84.62% to 90.71% (difference, 6.09 percentage points; 95% bootstrap confidence interval [CI], 2.24–10.26). Only Reader 3 showed a significant accuracy increase after Holm adjustment (p = 0.025). No accuracy comparison with routine reports was significant after adjustment. Confidence increased for all readers (all Holm-adjusted p < 0.001). Perceived usefulness did not differ significantly between lesion-burden groups. All readers predominantly rated the impact of AI as positive. The second-reading phase was shorter by a mean of 59.35 s (95% bootstrap CI, 51.39–67.07). Conclusions: In these four residents, the AI-assisted second reading was associated with higher confidence and average accuracy. The immediate sequential design prevents separation of AI contributions from familiarity and order effects, and the shorter second-reading phase does not establish an overall workflow time saving.

DiagnosticsVol. 16(22)
Centre National de la Recherche Scientifique (FR), Inserm (FR), University of Novi Sad (RS), Arts et Métiers (FR), Commissariat à l'Énergie Atomique et aux Énergies Alternatives (FR), Université Paris-Saclay (FR), Sorbonne Université (FR), Université Sorbonne Paris Nord (FR), Assistance Publique – Hôpitaux de Paris (FR), Observatoire Français de la Sclérose en Plaques (FR), Oncology Institute of Vojvodina (RS), Centre Hospitalier Intercommunal de Poissy (FR), Hôpitaux Universitaires Paris-Ouest (FR), CEA Paris-Saclay (FR), Institut de Biomécanique Humaine Georges Charpak (FR), Laboratoire d'Imagerie Biomédicale Multimodale Paris-Saclay (FR)
Good health and well-being
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon