Slice-based YOLO-SAM hybrid prompting framework for automatic medical image segmentation

Accurate medical image segmentation is essential for computer-aided diagnosis, treatment planning, and quantitative image analysis. This study evaluates a slice-based automatic segmentation framework that couples YOLOv8-based region localization with prompt-driven Segment Anything Model (SAM) segmentation. In contrast to a simple YOLOv8 + SAM cascade using only bounding-box prompts, the proposed framework adds hybrid prompt generation with bounding boxes and positive/negative points, parameter-efficient fine-tuning of the SAM prompt encoder and mask decoder, and lightweight post-processing. The framework is evaluated on two public datasets under explicitly defined local protocols: 2D slice-based prostate MRI segmentation using Prostate158 and skin lesion segmentation using an internal ISIC 2018 split. On Prostate158, the method obtains Dice coefficients of 89.2%, 76.8%, and 65.3% for central gland, peripheral zone, and prostate cancer lesion segmentation, respectively. On the local ISIC 2018 split, it obtains a Dice coefficient of 94.8% and a Jaccard index of 91.5%. These results indicate competitive performance under the implemented experimental protocol, but they should not be interpreted as protocol-independent state-of-the-art claims. The manuscript clarifies the evaluation unit, prompt-source protocol, 2D processing strategy, hyperparameter settings, baseline grouping, and limitations related to statistical uncertainty, detector failure propagation, and clinical translation.

Authors

Institutions

Publication Details

Journal
PLoS ONE
Published
2026-11-13
DOI
https://doi.org/10.1371/journal.pone.0360939
Primary Topic
Medical Image Segmentation Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Slice-based YOLO-SAM hybrid prompting framework for automatic medical image segmentation

Qiuyan Pei, Xiaobo Liu, Xiaoyu Wang, Honghang Luo
2 links
PLoS ONE
Medical Image Segmentation Techniques
article

Slice-based YOLO-SAM hybrid prompting framework for automatic medical image segmentation

Qiuyan Pei, Xiaobo Liu, Xiaoyu Wang, Honghang Luo
article en

Abstract

Accurate medical image segmentation is essential for computer-aided diagnosis, treatment planning, and quantitative image analysis. This study evaluates a slice-based automatic segmentation framework that couples YOLOv8-based region localization with prompt-driven Segment Anything Model (SAM) segmentation. In contrast to a simple YOLOv8 + SAM cascade using only bounding-box prompts, the proposed framework adds hybrid prompt generation with bounding boxes and positive/negative points, parameter-efficient fine-tuning of the SAM prompt encoder and mask decoder, and lightweight post-processing. The framework is evaluated on two public datasets under explicitly defined local protocols: 2D slice-based prostate MRI segmentation using Prostate158 and skin lesion segmentation using an internal ISIC 2018 split. On Prostate158, the method obtains Dice coefficients of 89.2%, 76.8%, and 65.3% for central gland, peripheral zone, and prostate cancer lesion segmentation, respectively. On the local ISIC 2018 split, it obtains a Dice coefficient of 94.8% and a Jaccard index of 91.5%. These results indicate competitive performance under the implemented experimental protocol, but they should not be interpreted as protocol-independent state-of-the-art claims. The manuscript clarifies the evaluation unit, prompt-source protocol, 2D processing strategy, hyperparameter settings, baseline grouping, and limitations related to statistical uncertainty, detector failure propagation, and clinical translation.

PLoS ONEVol. 21(11)
Fujian Medical University (CN), Hubei University of Science and Technology (CN), China Institute for Radiation Protection (CN), Fujian Forestry Vocational & Technical College (CN), Taiyuan University of Technology (CN)
Good health and well-being
Medical Image Segmentation Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon