Breast Ultrasound Classification Under Cross-Dataset Shift: A Multi-Seed Benchmark of Convolutional Networks, a Vision Transformer, and a Self-Supervised Foundation Model
Deep-learning classifiers for breast ultrasound are usually evaluated on images from their training institution, and self-supervised foundation models are increasingly proposed as more transferable than supervised networks; whether ranking ability, decision thresholds, and probability calibration survive a change in institution has rarely been tested under leakage-controlled conditions. We fine-tuned ResNet-50, EfficientNet-B0, a supervised Vision Transformer (ViT-B/16), and self-supervised DINOv2 under one shared protocol on the official BUS-BRA five-fold partitions, each fold with three seeds, and on three case-grouped hold-out splits, and evaluated every trained model unchanged on the Breast Ultrasound Images (BUSI) dataset. The supervised models largely retained their discrimination externally. ResNet-50 had the highest mean area under the receiver operating characteristic curve under the official folds, but no criterion separated it from ViT-B/16, whose small hold-out advantage at the decision threshold did not recur. In every official-fold run, both models labeled a larger share of BUSI than of BUS-BRA images malignant, although prevalence was the same—a shift that temperature scaling cannot correct. Top-label calibration error also understated malignant-class miscalibration. Full-frame DINOv2 did not fit its training data in any run, although exploratory lesion cropping produced good discrimination. External evaluations should report operating-point transport and class-wise calibration alongside discrimination.
Authors
- Ervin Ramollari (ORCID: https://orcid.org/0009-0006-8614-7813)
- Narasimha Rao Vajjhala (ORCID: https://orcid.org/0000-0002-8260-2392)
- Rajesh Kumar (ORCID: https://orcid.org/0000-0001-8223-828X)
- Khalid Hussain
- Ranjeeta Mahraj
- Komal Ramchandani
Institutions
- Montclair State University (US)
- American University in Bulgaria (BG)
- Chemnitz University of Technology (DE)
- University of New York Tirana (AL)
Publication Details
- Journal
- Algorithms
- Published
- 2026-11-18
- DOI
- https://doi.org/10.3390/a19111011
- Primary Topic
- AI in cancer detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00