Embedded framework for clinical medical image segment anything in resource limited healthcare regions

The emergence of portable imaging devices improves medical image acquisition efficiency in resource-limited regions, but a shortage of medical personnel still limits timely diagnosis. We propose Embed-MedSAM, a fully automatic segmentation model with low deployment cost. Built on MedSAM, it integrates a lightweight RepViT encoder to reduce computation and applies two-stage distillation on over one million multimodal medical images to preserve the original model's visual representation. A self-prompting mechanism is also introduced, where the model generates pseudo labels to guide fine-grained segmentation. The training jointly optimizes KL divergence and segmentation losses to improve accuracy under prompt-free conditions. Embed-MedSAM shows excellent performance on 17 benchmark datasets covering 7 imaging modalities. Without external prompts, it improves average Dice score by nearly 16% over the second-best model. It also runs at nearly 30 FPS on iPhone 14, showing strong potential for real-world deployment.

Authors

Institutions

Publication Details

Journal
npj Digital Medicine
Published
2025-09-24
DOI
https://doi.org/10.1038/s41746-025-01881-y
Primary Topic
COVID-19 diagnosis using AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Embedded framework for clinical medical image segment anything in resource limited healthcare regions

Xin Lian, Ying Zhang, Liyu Yang, Tianlong Jiang et al.
npj Digital Medicine
COVID-19 diagnosis using AI
article

Embedded framework for clinical medical image segment anything in resource limited healthcare regions

Xin Lian, Ying Zhang, Liyu Yang, Tianlong Jiang, Fangdie Ye, Lei Yang, Xiaofeng Yu
article en

Abstract

The emergence of portable imaging devices improves medical image acquisition efficiency in resource-limited regions, but a shortage of medical personnel still limits timely diagnosis. We propose Embed-MedSAM, a fully automatic segmentation model with low deployment cost. Built on MedSAM, it integrates a lightweight RepViT encoder to reduce computation and applies two-stage distillation on over one million multimodal medical images to preserve the original model's visual representation. A self-prompting mechanism is also introduced, where the model generates pseudo labels to guide fine-grained segmentation. The training jointly optimizes KL divergence and segmentation losses to improve accuracy under prompt-free conditions. Embed-MedSAM shows excellent performance on 17 benchmark datasets covering 7 imaging modalities. Without external prompts, it improves average Dice score by nearly 16% over the second-best model. It also runs at nearly 30 FPS on iPhone 14, showing strong potential for real-world deployment.

npj Digital MedicineVol. 8(1)
Fudan University (CN), First Hospital of China Medical University (CN), Huashan Hospital (CN), China Medical University (CN)
Openalex Percentile: Top 61%
COVID-19 diagnosis using AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Embedded framework for clinical medical image segment anything in resource limited healthcare regions — Xin Lian, Ying Zhang, et al. · npj Digital Medicine (2025) | TGRS Research Map | TGRS