RGVT: retrieval-guided Vision Transformer for CT-based kidney lesion classification and segmentation
Kidney lesion classification and segmentation from computed tomography images remain challenging because cysts, stones, tumors, and normal renal tissue may show overlapping visual characteristics, low-contrast boundaries, and inter-patient variability. This study proposes RGVT, a retrieval-guided Vision Transformer framework for CT-based kidney lesion classification and segmentation. The proposed framework extracts global image features using a Vision Transformer encoder and retrieves visually similar reference-case embeddings from a training-set memory bank. These retrieved embeddings are fused with current-case image features through cross-attention to improve lesion representation before classification and segmentation. The framework was evaluated on a CT kidney lesion dataset 1 containing cyst, normal, stone, and tumor classes and was compared with U-Net, U-Net + HC, and Swin Transformer baselines. In the original image-level evaluation, RGVT achieved an accuracy of 96.40%, precision of 96.20%, recall of 96.00%, F1-score of 96.10%, and macro-AUC of 0.977. For binary kidney-stone segmentation on KSSD2025, RGVT achieved a Dice score of 94.20% and an IoU of 89.50%. An additional group-disjoint analysis was performed using the same RGVT architecture and is reported in the Supplementary Information to examine the effect of examination-level separation on classification performance. The retrieval memory was restricted to training-group representations in this additional analysis. These results are intended to provide complementary evidence regarding the behavior of retrieval-guided visual feature fusion under different data-partitioning conditions.
Authors
- Faten Khalid Karim (ORCID: https://orcid.org/0000-0003-1111-5818)
- Ayman Aljarbouh (ORCID: https://orcid.org/0000-0002-3909-2227)
- N. Thirupathi Rao (ORCID: https://orcid.org/0000-0002-8957-8532)
- V V Ramana CH (ORCID: https://orcid.org/0000-0003-3846-8269)
Institutions
- Princess Nourah bint Abdulrahman University (SA)
- Prince Mohammad bin Fahd University (SA)
- International Institute of Information Technology (IN)
Publication Details
- Journal
- Scientific Reports
- Published
- 2026-11-13
- DOI
- https://doi.org/10.1038/s41598-026-78251-5
- Primary Topic
- Medical Image Segmentation Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Department of Science and Technology, Ministry of Science and Technology, India
- Princess Nourah Bint Abdulrahman University
- Science and Engineering Research Board