Abstract 4144271: AI-Assisted Transseptal Puncture: Visual-Prompt Fine-Tuning of Foundation Models on Low-Dose X-RAY Images

Background: Transseptal puncture (TSP) is a critical step allowing access from right atrium to left atrium in cardiac interventions. The operation relies heavily on real-time X-ray imaging and often involves subjective decision-making needing experience. Recent advancements in artificial intelligence (AI), particularly visual foundation model offer promising solutions to enhance the precision and consistency of TSP. Research questions: We hypothesize that a foundation model fine-tuned on real TSP images and expert annotations, can accurately predict the optimal puncture site on imaging. Aims: This study aims to develop and validate an AI method that automatically identifies the ideal TSP site using only the CS catheter as a reference in X-RAY image. This approach seeks to replicate the decision-making process of experienced clinicians, thereby improving the accuracy and safety of the procedure. Methods: A pilot study enrolled 101 patients in one center. Three experienced senior practitioners are responsible for labeling these images. To learn information from limited X-RAY images, we design a co-training framework based on Segment Anything Model (SAM) to fine-tune the decision module for TSP by combining visual prompts of the three bounding boxes (heart edge, spine, and coronary sinus electrode). The input images are captured before puncture and resized to 512*512. The candidate puncture area is set as a circle centered at actual puncture point with a radius of 10 pixels. Results: Images from 80 patients were used to fine-tune the decision module, while 21 for validation. The Intersection over Union (IoU) on validation set is 70.22% for the pre-defined candidate TSP circle. In validation, the success rates of the predicted TSP point (the center of the predicted area) falling within radii of 5, 10, 15 pixels cantered on the actual TSP site are 56.30%, 72.01% and 83.54%, respectively. Conclusions: In this study, we introduce an AI-assisted visual prompt for TSP using SAM-based fine-tuning. With the limited samples, the performance of puncture-site prediction underscores the potential of our framework as an efficient solution for TSP guidance and assistance. The future works include expanding the sample size and testing whether visual prompts can enhance TSP quality and clinical training.

Authors

Institutions

Publication Details

Journal
Circulation
Published
2024-11-12
DOI
https://doi.org/10.1161/circ.150.suppl_1.4144271
Primary Topic
Medical Imaging and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Abstract 4144271: AI-Assisted Transseptal Puncture: Visual-Prompt Fine-Tuning of Foundation Models on Low-Dose X-RAY Images

Xin Qi, Weizhu Ju, Chang Cui, Xuehao Wang et al.
Circulation
Medical Imaging and Analysis
article

Abstract 4144271: AI-Assisted Transseptal Puncture: Visual-Prompt Fine-Tuning of Foundation Models on Low-Dose X-RAY Images

Xin Qi, Weizhu Ju, Chang Cui, Xuehao Wang, Chen Minglong
article en

Abstract

Background: Transseptal puncture (TSP) is a critical step allowing access from right atrium to left atrium in cardiac interventions. The operation relies heavily on real-time X-ray imaging and often involves subjective decision-making needing experience. Recent advancements in artificial intelligence (AI), particularly visual foundation model offer promising solutions to enhance the precision and consistency of TSP. Research questions: We hypothesize that a foundation model fine-tuned on real TSP images and expert annotations, can accurately predict the optimal puncture site on imaging. Aims: This study aims to develop and validate an AI method that automatically identifies the ideal TSP site using only the CS catheter as a reference in X-RAY image. This approach seeks to replicate the decision-making process of experienced clinicians, thereby improving the accuracy and safety of the procedure. Methods: A pilot study enrolled 101 patients in one center. Three experienced senior practitioners are responsible for labeling these images. To learn information from limited X-RAY images, we design a co-training framework based on Segment Anything Model (SAM) to fine-tune the decision module for TSP by combining visual prompts of the three bounding boxes (heart edge, spine, and coronary sinus electrode). The input images are captured before puncture and resized to 512*512. The candidate puncture area is set as a circle centered at actual puncture point with a radius of 10 pixels. Results: Images from 80 patients were used to fine-tune the decision module, while 21 for validation. The Intersection over Union (IoU) on validation set is 70.22% for the pre-defined candidate TSP circle. In validation, the success rates of the predicted TSP point (the center of the predicted area) falling within radii of 5, 10, 15 pixels cantered on the actual TSP site are 56.30%, 72.01% and 83.54%, respectively. Conclusions: In this study, we introduce an AI-assisted visual prompt for TSP using SAM-based fine-tuning. With the limited samples, the performance of puncture-site prediction underscores the potential of our framework as an efficient solution for TSP guidance and assistance. The future works include expanding the sample size and testing whether visual prompts can enhance TSP quality and clinical training.

CirculationVol. 150(Suppl_1)
Jiangsu Province Hospital (CN), Nanjing Medical University (CN)
Peace, Justice and strong institutions
Openalex Percentile: Top 81%
Medical Imaging and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.