<i>Shortkit-ML</i> : A Unified Multi-Perspective Framework for Detecting Shortcut Learning in Medical Imaging Embeddings

, an open-source Python framework for unified shortcut analysis in embedding spaces. The framework integrates over 20 detection methods and six mitigation strategies within a modular pipeline, encompassing embedding analysis, fairness metrics, training dynamics, causal methods, explainability, and representation analysis. We evaluate the framework on chest X-ray datasets (CheXpert and MIMIC-CXR), synthetic benchmarks, and an out-of-domain dataset (CelebA). Experimental results demonstrate that multi-method auditing provides more stable and interpretable evidence than individual methods, while detector disagreement reveals meaningful representational differences. The proposed framework offers automated reporting, interactive visualization, and is available as a pip-installable package. The source code and documentation are publicly available at https://github.com/criticaldata/ShortKit-ML and https://criticaldata.github.io/ShortKit-ML/ .

Authors

Institutions

Publication Details

Journal
medRxiv
Published
2026-04-30
DOI
https://doi.org/10.64898/2026.04.29.26352053
Primary Topic
COVID-19 diagnosis using AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Shortkit-ML : A Unified Multi-Perspective Framework for Detecting Shortcut Learning in Medical Imaging Embeddings

Aldo Marzullo, Felipe Ocampo Osorio, Alessandro Quarta, Sebastian Cajas et al.
medRxiv
COVID-19 diagnosis using AI
article

Shortkit-ML : A Unified Multi-Perspective Framework for Detecting Shortcut Learning in Medical Imaging Embeddings

Aldo Marzullo, Felipe Ocampo Osorio, Alessandro Quarta, Sebastian Cajas, Sahil Kapadia, Milit Patel, Qingpeng Kong, Filipe Santos, Leo Anthony Celi, Po-Chih Kuo, Raul Ignacio Rojas Sillery
article en

Abstract

, an open-source Python framework for unified shortcut analysis in embedding spaces. The framework integrates over 20 detection methods and six mitigation strategies within a modular pipeline, encompassing embedding analysis, fairness metrics, training dynamics, causal methods, explainability, and representation analysis. We evaluate the framework on chest X-ray datasets (CheXpert and MIMIC-CXR), synthetic benchmarks, and an out-of-domain dataset (CelebA). Experimental results demonstrate that multi-method auditing provides more stable and interpretable evidence than individual methods, while detector disagreement reveals meaningful representational differences. The proposed framework offers automated reporting, interactive visualization, and is available as a pip-installable package. The source code and documentation are publicly available at https://github.com/criticaldata/ShortKit-ML and https://criticaldata.github.io/ShortKit-ML/ .

medRxiv
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento (PT), National Tsing Hua University (TW), Fundación Valle del Lili (CO), University of Calabria (IT), Massachusetts Institute of Technology (US), The University of Texas at Austin (US), Politecnico di Milano (IT), University of California, Berkeley (US)
No poverty
Openalex Percentile: Top 8%
COVID-19 diagnosis using AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.