Zero-Shot Capillary Segmentation in Dermoscopy Images via SAM2: A Case Study on Oral Mucosa

Morphological changes in oral mucosal microvasculature serve as early diagnostic markers for various diseases. However, existing dermoscopy image analysis relies heavily on physician expertise, leading to high subjectivity and low efficiency. This paper proposes a zero-shot capillary segmentation method for oral mucosa based on Segment Anything Model 2 (SAM2), which effectively handles reflection artifacts and highlights minute vascular structures through a multi-scale adaptive enhancement algorithm. The method employs a morphology-aware automatic prompt annotation strategy to generate composite guidance containing bounding boxes, foreground points, and background points for SAM2. Without requiring annotated data or model training, this approach achieves precise instance segmentation of capillaries through an "enhancement-annotation-segmentation" collaborative paradigm. On a clinical dataset comprising 212 dermoscopy images from 106 subjects, our method achieved a Dice coefficient of 0.7278 and an IoU of 0.5721, representing improvements of 17.12% and 26.9% respectively compared to the medical-specific baseline MedSAM. This provides an objective auxiliary diagnostic method for oral mucosal diseases that depend on capillary morphology analysis.

Authors

Institutions

Publication Details

Journal
IEEE Journal of Biomedical and Health Informatics
Published
2025-01-01
DOI
https://doi.org/10.1109/jbhi.2025.3628493
Primary Topic
Cutaneous Melanoma Detection and Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Zero-Shot Capillary Segmentation in Dermoscopy Images via SAM2: A Case Study on Oral Mucosa

Wenqing Su, Runda Jia, Jian Qin, Youcheng Zong et al.
IEEE Journal of Biomedical and Health Informatics
Cutaneous Melanoma Detection and Management
article

Zero-Shot Capillary Segmentation in Dermoscopy Images via SAM2: A Case Study on Oral Mucosa

Wenqing Su, Runda Jia, Jian Qin, Youcheng Zong, Ming Li
article en

Abstract

Morphological changes in oral mucosal microvasculature serve as early diagnostic markers for various diseases. However, existing dermoscopy image analysis relies heavily on physician expertise, leading to high subjectivity and low efficiency. This paper proposes a zero-shot capillary segmentation method for oral mucosa based on Segment Anything Model 2 (SAM2), which effectively handles reflection artifacts and highlights minute vascular structures through a multi-scale adaptive enhancement algorithm. The method employs a morphology-aware automatic prompt annotation strategy to generate composite guidance containing bounding boxes, foreground points, and background points for SAM2. Without requiring annotated data or model training, this approach achieves precise instance segmentation of capillaries through an "enhancement-annotation-segmentation" collaborative paradigm. On a clinical dataset comprising 212 dermoscopy images from 106 subjects, our method achieved a Dice coefficient of 0.7278 and an IoU of 0.5721, representing improvements of 17.12% and 26.9% respectively compared to the medical-specific baseline MedSAM. This provides an objective auxiliary diagnostic method for oral mucosal diseases that depend on capillary morphology analysis.

IEEE Journal of Biomedical and Health InformaticsVol. PP
Jinan Stomatological Hospital (CN), Northeastern University (CN)
Openalex Percentile: Top 56%
Cutaneous Melanoma Detection and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Zero-Shot Capillary Segmentation in Dermoscopy Images via SAM2: A Case Study on Oral Mucosa — Wenqing Su, Runda Jia, et al. · IEEE Journal of Biomedical and Health Informatics (2025) | TGRS Research Map | TGRS