RGVT: retrieval-guided Vision Transformer for CT-based kidney lesion classification and segmentation

Kidney lesion classification and segmentation from computed tomography images remain challenging because cysts, stones, tumors, and normal renal tissue may show overlapping visual characteristics, low-contrast boundaries, and inter-patient variability. This study proposes RGVT, a retrieval-guided Vision Transformer framework for CT-based kidney lesion classification and segmentation. The proposed framework extracts global image features using a Vision Transformer encoder and retrieves visually similar reference-case embeddings from a training-set memory bank. These retrieved embeddings are fused with current-case image features through cross-attention to improve lesion representation before classification and segmentation. The framework was evaluated on a CT kidney lesion dataset 1 containing cyst, normal, stone, and tumor classes and was compared with U-Net, U-Net + HC, and Swin Transformer baselines. In the original image-level evaluation, RGVT achieved an accuracy of 96.40%, precision of 96.20%, recall of 96.00%, F1-score of 96.10%, and macro-AUC of 0.977. For binary kidney-stone segmentation on KSSD2025, RGVT achieved a Dice score of 94.20% and an IoU of 89.50%. An additional group-disjoint analysis was performed using the same RGVT architecture and is reported in the Supplementary Information to examine the effect of examination-level separation on classification performance. The retrieval memory was restricted to training-group representations in this additional analysis. These results are intended to provide complementary evidence regarding the behavior of retrieval-guided visual feature fusion under different data-partitioning conditions.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-11-13
DOI
https://doi.org/10.1038/s41598-026-78251-5
Primary Topic
Medical Image Segmentation Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

RGVT: retrieval-guided Vision Transformer for CT-based kidney lesion classification and segmentation

Faten Khalid Karim, Ayman Aljarbouh, N. Thirupathi Rao, V V Ramana CH
Scientific Reports
Medical Image Segmentation Techniques
article

RGVT: retrieval-guided Vision Transformer for CT-based kidney lesion classification and segmentation

Faten Khalid Karim, Ayman Aljarbouh, N. Thirupathi Rao, V V Ramana CH
article en

Abstract

Kidney lesion classification and segmentation from computed tomography images remain challenging because cysts, stones, tumors, and normal renal tissue may show overlapping visual characteristics, low-contrast boundaries, and inter-patient variability. This study proposes RGVT, a retrieval-guided Vision Transformer framework for CT-based kidney lesion classification and segmentation. The proposed framework extracts global image features using a Vision Transformer encoder and retrieves visually similar reference-case embeddings from a training-set memory bank. These retrieved embeddings are fused with current-case image features through cross-attention to improve lesion representation before classification and segmentation. The framework was evaluated on a CT kidney lesion dataset 1 containing cyst, normal, stone, and tumor classes and was compared with U-Net, U-Net + HC, and Swin Transformer baselines. In the original image-level evaluation, RGVT achieved an accuracy of 96.40%, precision of 96.20%, recall of 96.00%, F1-score of 96.10%, and macro-AUC of 0.977. For binary kidney-stone segmentation on KSSD2025, RGVT achieved a Dice score of 94.20% and an IoU of 89.50%. An additional group-disjoint analysis was performed using the same RGVT architecture and is reported in the Supplementary Information to examine the effect of examination-level separation on classification performance. The retrieval memory was restricted to training-group representations in this additional analysis. These results are intended to provide complementary evidence regarding the behavior of retrieval-guided visual feature fusion under different data-partitioning conditions.

Scientific Reports
Princess Nourah bint Abdulrahman University (SA), Prince Mohammad bin Fahd University (SA), International Institute of Information Technology (IN)
Department of Science and Technology, Ministry of Science and Technology, India, Princess Nourah Bint Abdulrahman University, Science and Engineering Research Board
Good health and well-being
Medical Image Segmentation Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon