EP01.26: Diagnostic performance of antenatal diagnosis of congenital heart disease with artificial intelligence versus trained specialists

To determine the diagnostic performance of antenatal diagnosis of congenital heart disease with artificial intelligence versus trained specialists. Cross-sectional study with obstetric ultrasound images from centres involved in the program for the diagnosis, training, logistics, education, organisation, and follow-up of patients with congenital heart disease (DELFOS). A group of trained specialists was exposed to a set of 50 training images simulating the training process of the Artificial Intelligence (AI) model. Subsequently, the participants had to determine in 56 images corresponding to 30 patients whether there was or not a presence of congenital heart disease. The final results were grouped at the patient level for both the specialist study and the AI model. Study participants did not have access to the patient's medical history or additional data, so they had to perform the analysis with the same information as the AI model. 48 trained specialists from the basic screening and anomaly detection course of DELFOS were included. Sensitivity, specificity, false negative rate, and false positive rate were calculated for the group of trained specialists and AI. Additionally, comparison was made with the developed AI method and with random performance. It can be observed that trained specialists have higher sensitivity levels than the AI model but have lower specificity. This is due to the false positive rate calculated for trained specialists being significantly higher than that indicated by the AI model. In our experience, the diagnostic performance of AI (DELFOS) demonstrated higher specificity and a lower false positive rate compared to trained specialists. However, specialists had higher sensitivity. This balance between sensitivity and specificity is crucial for the detection of congenital heart disease, so the incorporation of an AI model complements and enhances detection capability.

Authors

Institutions

Publication Details

Journal
Ultrasound in Obstetrics and Gynecology
Published
2024-09-01
DOI
https://doi.org/10.1002/uog.28041
Primary Topic
Congenital Heart Disease Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

EP01.26: Diagnostic performance of antenatal diagnosis of congenital heart disease with artificial intelligence versus trained specialists

N. Ramirez, Pablo Arbeláez, N. Rodríguez, L. M. Echeverry et al.
Ultrasound in Obstetrics and Gynecology
Congenital Heart Disease Studies
article

EP01.26: Diagnostic performance of antenatal diagnosis of congenital heart disease with artificial intelligence versus trained specialists

N. Ramirez, Pablo Arbeláez, N. Rodríguez, L. M. Echeverry, Antonio Javier Alias-Castillo, María Escobar, A. Sarmiento
article en

Abstract

To determine the diagnostic performance of antenatal diagnosis of congenital heart disease with artificial intelligence versus trained specialists. Cross-sectional study with obstetric ultrasound images from centres involved in the program for the diagnosis, training, logistics, education, organisation, and follow-up of patients with congenital heart disease (DELFOS). A group of trained specialists was exposed to a set of 50 training images simulating the training process of the Artificial Intelligence (AI) model. Subsequently, the participants had to determine in 56 images corresponding to 30 patients whether there was or not a presence of congenital heart disease. The final results were grouped at the patient level for both the specialist study and the AI model. Study participants did not have access to the patient's medical history or additional data, so they had to perform the analysis with the same information as the AI model. 48 trained specialists from the basic screening and anomaly detection course of DELFOS were included. Sensitivity, specificity, false negative rate, and false positive rate were calculated for the group of trained specialists and AI. Additionally, comparison was made with the developed AI method and with random performance. It can be observed that trained specialists have higher sensitivity levels than the AI model but have lower specificity. This is due to the false positive rate calculated for trained specialists being significantly higher than that indicated by the AI model. In our experience, the diagnostic performance of AI (DELFOS) demonstrated higher specificity and a lower false positive rate compared to trained specialists. However, specialists had higher sensitivity. This balance between sensitivity and specificity is crucial for the detection of congenital heart disease, so the incorporation of an AI model complements and enhances detection capability.

Ultrasound in Obstetrics and GynecologyVol. 64(S1)
Universidad de Los Andes (CO), Universidad El Bosque (CO), Fundación Santa Fe de Bogotá (CO)
Good health and well-being
Openalex Percentile: Top 77%
Congenital Heart Disease Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.