Conditional Virtual Imaging for Few-Shot Vascular Image Segmentation
In the field of medical image processing, vascular image segmentation plays a crucial role in clinical diagnosis, treatment planning, prognosis, and medical decision-making. Accurate and automated segmentation of vascular images can assist clinicians in understanding the vascular network structure, leading to more informed medical decisions. However, manual annotation of vascular images is time-consuming and challenging due to the fine and low-contrast vascular branches, especially in the medical imaging domain where annotation requires specialized knowledge and clinical expertise. Data-driven deep learning models struggle to achieve good performance when only a small number of annotated vascular images are available. To address this issue, this paper proposes a novel Conditional Virtual Imaging (CVI) framework for few-shot vascular image segmentation learning. The framework combines limited annotated data with extensive unlabeled data to generate high-quality images, effectively improving the accuracy and robustness of segmentation learning. Our approach primarily includes two innovations: First, aligned image-mask pair generation, which leverages the powerful image generation capabilities of large pre-trained models to produce high-quality vascular images with complex structures using only a few training images; Second, the Dual-Consistency Learning (DCL) strategy, which simultaneously trains the generator and segmentation model, allowing them to learn from each other and maximize the utilization of limited data. Experimental results demonstrate that our CVI framework can generate high-quality medical images and effectively enhance the performance of segmentation models in few-shot scenarios. Our code will be made publicly available online.
Authors
- Rongjun Ge (ORCID: https://orcid.org/0000-0002-7084-1126)
- Ming‐Yang Su (ORCID: https://orcid.org/0000-0001-9164-5856)
- Hui Nee Tang (ORCID: https://orcid.org/0000-0001-8448-6623)
- Yanglong He
- Yang Chen (ORCID: https://orcid.org/0000-0002-5660-6349)
- Huazhong Shu (ORCID: https://orcid.org/0000-0002-3833-7915)
- Yuting He (ORCID: https://orcid.org/0000-0003-0878-8915)
- Yuxin Liu (ORCID: https://orcid.org/0009-0003-9615-4804)
- Jean-Louis Coatrieux
Institutions
- Laboratoire Traitement du Signal et de l'Image (FR)
- Ministry of Education (BD)
- Case Western Reserve University (US)
- Southeast University (CN)
Publication Details
- Journal
- IEEE Transactions on Medical Imaging
- Published
- 2025-09-25
- DOI
- https://doi.org/10.1109/tmi.2025.3608467
- Primary Topic
- Advanced X-ray and CT Imaging
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Government of Jiangsu Province
- Natural Science Foundation of Jiangsu Province