Slice-based YOLO-SAM hybrid prompting framework for automatic medical image segmentation
Accurate medical image segmentation is essential for computer-aided diagnosis, treatment planning, and quantitative image analysis. This study evaluates a slice-based automatic segmentation framework that couples YOLOv8-based region localization with prompt-driven Segment Anything Model (SAM) segmentation. In contrast to a simple YOLOv8 + SAM cascade using only bounding-box prompts, the proposed framework adds hybrid prompt generation with bounding boxes and positive/negative points, parameter-efficient fine-tuning of the SAM prompt encoder and mask decoder, and lightweight post-processing. The framework is evaluated on two public datasets under explicitly defined local protocols: 2D slice-based prostate MRI segmentation using Prostate158 and skin lesion segmentation using an internal ISIC 2018 split. On Prostate158, the method obtains Dice coefficients of 89.2%, 76.8%, and 65.3% for central gland, peripheral zone, and prostate cancer lesion segmentation, respectively. On the local ISIC 2018 split, it obtains a Dice coefficient of 94.8% and a Jaccard index of 91.5%. These results indicate competitive performance under the implemented experimental protocol, but they should not be interpreted as protocol-independent state-of-the-art claims. The manuscript clarifies the evaluation unit, prompt-source protocol, 2D processing strategy, hyperparameter settings, baseline grouping, and limitations related to statistical uncertainty, detector failure propagation, and clinical translation.
Authors
- Qiuyan Pei
- Xiaobo Liu (ORCID: https://orcid.org/0009-0001-3813-2522)
- Xiaoyu Wang
- Honghang Luo
Institutions
- Fujian Medical University (CN)
- Hubei University of Science and Technology (CN)
- China Institute for Radiation Protection (CN)
- Fujian Forestry Vocational & Technical College (CN)
- Taiyuan University of Technology (CN)
Publication Details
- Journal
- PLoS ONE
- Published
- 2026-11-13
- DOI
- https://doi.org/10.1371/journal.pone.0360939
- Primary Topic
- Medical Image Segmentation Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00