Conformal uncertainty aware prototype discovery for auditing deep chest radiograph clustering

Abstract Deep clustering can support exploratory organization of large chest-radiograph repositories, but deterministic assignments can conceal model ambiguity and apparently coherent clusters may reflect acquisition or optimization effects rather than clinically validated phenotypes. We present CUPID-Med, an uncertainty-aware prototype clustering framework combining distributional latent learning, learnable prototypes, anti-collapse regularization, and patient-disjoint split-conformal cluster sets. The evaluated implementation operates on frozen 1,024-dimensional ImageNet-pretrained DenseNet121 embeddings and uses a leakage-controlled 60/10/15/15 Train/Validation/Calibration/Test protocol on 10,000 CheXpert radiographs from 10,000 distinct patients. Model selection is restricted to Validation, and the frozen benchmark evaluates ten matched seeds in a common train-only PCA-64 geometry. On Test, CUPID-Med achieved shared-space Silhouette $$0.0403\pm 0.0041$$ , compared with 0.0440 for Spectral-kNN and 0.0429 for k -means, while yielding higher mean Silhouette than the evaluated deep representation-learning baselines. None of the 63 CUPID-Med-versus-baseline matched-seed comparisons remained significant after Holm correction, so performance differences are interpreted descriptively. At nominal 90% confidence, the primary stochastic APS procedure achieved $$0.9753\pm 0.0070$$ empirical coverage with mean set size 5.61; assignment entropy aligned with cross-seed instability ( $$\rho =0.618$$ , bootstrap 95% CI 0.581–0.652), and frozen weak-view perturbations changed hard assignments in 3.36% of Test cases on average. External evaluation on 112,120 NIH ChestXray14 images retained conservative model-relative coverage under measurable distribution shift. Across ten seeds, the metadata audit identified substantial association between cluster membership and the recorded acquisition-projection field (Cramér’s $$V=0.614\pm 0.039$$ , range 0.515–0.641). The uniformly small internal Silhouette values indicate weak absolute separation for all evaluated methods. CUPID-Med should therefore be interpreted as an exploratory framework for auditing cluster structure and assignment ambiguity, not as a diagnostic or clinically validated phenotype-discovery system.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-10-19
DOI
https://doi.org/10.1038/s41598-026-75016-y
Primary Topic
Advanced Clustering Algorithms Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Conformal uncertainty aware prototype discovery for auditing deep chest radiograph clustering

Abbas Karimi, Faraneh Zarafshan, Mojtaba Jahanian, Nafiseh Osati Eraghi
Scientific Reports
Advanced Clustering Algorithms Research
article

Conformal uncertainty aware prototype discovery for auditing deep chest radiograph clustering

Abbas Karimi, Faraneh Zarafshan, Mojtaba Jahanian, Nafiseh Osati Eraghi
article en

Abstract

Abstract Deep clustering can support exploratory organization of large chest-radiograph repositories, but deterministic assignments can conceal model ambiguity and apparently coherent clusters may reflect acquisition or optimization effects rather than clinically validated phenotypes. We present CUPID-Med, an uncertainty-aware prototype clustering framework combining distributional latent learning, learnable prototypes, anti-collapse regularization, and patient-disjoint split-conformal cluster sets. The evaluated implementation operates on frozen 1,024-dimensional ImageNet-pretrained DenseNet121 embeddings and uses a leakage-controlled 60/10/15/15 Train/Validation/Calibration/Test protocol on 10,000 CheXpert radiographs from 10,000 distinct patients. Model selection is restricted to Validation, and the frozen benchmark evaluates ten matched seeds in a common train-only PCA-64 geometry. On Test, CUPID-Med achieved shared-space Silhouette $$0.0403\pm 0.0041$$ , compared with 0.0440 for Spectral-kNN and 0.0429 for k -means, while yielding higher mean Silhouette than the evaluated deep representation-learning baselines. None of the 63 CUPID-Med-versus-baseline matched-seed comparisons remained significant after Holm correction, so performance differences are interpreted descriptively. At nominal 90% confidence, the primary stochastic APS procedure achieved $$0.9753\pm 0.0070$$ empirical coverage with mean set size 5.61; assignment entropy aligned with cross-seed instability ( $$\rho =0.618$$ , bootstrap 95% CI 0.581–0.652), and frozen weak-view perturbations changed hard assignments in 3.36% of Test cases on average. External evaluation on 112,120 NIH ChestXray14 images retained conservative model-relative coverage under measurable distribution shift. Across ten seeds, the metadata audit identified substantial association between cluster membership and the recorded acquisition-projection field (Cramér’s $$V=0.614\pm 0.039$$ , range 0.515–0.641). The uniformly small internal Silhouette values indicate weak absolute separation for all evaluated methods. CUPID-Med should therefore be interpreted as an exploratory framework for auditing cluster structure and assignment ambiguity, not as a diagnostic or clinically validated phenotype-discovery system.

Scientific Reports
Islamic Azad University, Karaj (IR), Islamic Azad University, Arak (IR), Islamic Azad University of Hamedan (IR), Technical and Vocational University (IR)
Openalex Percentile: Top 13%
Advanced Clustering Algorithms Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.