Embedded framework for clinical medical image segment anything in resource limited healthcare regions
The emergence of portable imaging devices improves medical image acquisition efficiency in resource-limited regions, but a shortage of medical personnel still limits timely diagnosis. We propose Embed-MedSAM, a fully automatic segmentation model with low deployment cost. Built on MedSAM, it integrates a lightweight RepViT encoder to reduce computation and applies two-stage distillation on over one million multimodal medical images to preserve the original model's visual representation. A self-prompting mechanism is also introduced, where the model generates pseudo labels to guide fine-grained segmentation. The training jointly optimizes KL divergence and segmentation losses to improve accuracy under prompt-free conditions. Embed-MedSAM shows excellent performance on 17 benchmark datasets covering 7 imaging modalities. Without external prompts, it improves average Dice score by nearly 16% over the second-best model. It also runs at nearly 30 FPS on iPhone 14, showing strong potential for real-world deployment.
Authors
- Xin Lian
- Ying Zhang (ORCID: https://orcid.org/0000-0002-7926-9904)
- Liyu Yang (ORCID: https://orcid.org/0000-0003-0497-1819)
- Tianlong Jiang (ORCID: https://orcid.org/0000-0002-6638-7813)
- Fangdie Ye (ORCID: https://orcid.org/0000-0001-8572-0493)
- Lei Yang (ORCID: https://orcid.org/0000-0003-1800-6892)
- Xiaofeng Yu
Institutions
- Fudan University (CN)
- First Hospital of China Medical University (CN)
- Huashan Hospital (CN)
- China Medical University (CN)
Publication Details
- Journal
- npj Digital Medicine
- Published
- 2025-09-24
- DOI
- https://doi.org/10.1038/s41746-025-01881-y
- Primary Topic
- COVID-19 diagnosis using AI
- Type
- article
- Field-Weighted Citation Impact
- 0.00