<i>Shortkit-ML</i> : A Unified Multi-Perspective Framework for Detecting Shortcut Learning in Medical Imaging Embeddings
, an open-source Python framework for unified shortcut analysis in embedding spaces. The framework integrates over 20 detection methods and six mitigation strategies within a modular pipeline, encompassing embedding analysis, fairness metrics, training dynamics, causal methods, explainability, and representation analysis. We evaluate the framework on chest X-ray datasets (CheXpert and MIMIC-CXR), synthetic benchmarks, and an out-of-domain dataset (CelebA). Experimental results demonstrate that multi-method auditing provides more stable and interpretable evidence than individual methods, while detector disagreement reveals meaningful representational differences. The proposed framework offers automated reporting, interactive visualization, and is available as a pip-installable package. The source code and documentation are publicly available at https://github.com/criticaldata/ShortKit-ML and https://criticaldata.github.io/ShortKit-ML/ .
Authors
- Aldo Marzullo (ORCID: https://orcid.org/0000-0002-9651-7156)
- Felipe Ocampo Osorio (ORCID: https://orcid.org/0000-0002-5250-4636)
- Alessandro Quarta (ORCID: https://orcid.org/0000-0001-6319-2466)
- Sebastian Cajas
- Sahil Kapadia
- Milit Patel (ORCID: https://orcid.org/0009-0000-9179-267X)
- Qingpeng Kong
- Filipe Santos
- Leo Anthony Celi (ORCID: https://orcid.org/0000-0001-6712-6626)
- Po-Chih Kuo
- Raul Ignacio Rojas Sillery
Institutions
- Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento (PT)
- National Tsing Hua University (TW)
- Fundación Valle del Lili (CO)
- University of Calabria (IT)
- Massachusetts Institute of Technology (US)
- The University of Texas at Austin (US)
- Politecnico di Milano (IT)
- University of California, Berkeley (US)
Publication Details
- Journal
- medRxiv
- Published
- 2026-04-30
- DOI
- https://doi.org/10.64898/2026.04.29.26352053
- Primary Topic
- COVID-19 diagnosis using AI
- Type
- article
- Field-Weighted Citation Impact
- 0.00