Eigenvalue-Based Diagnostic Equity Testing: A Random Matrix Framework for Detecting Multi-Dimensional Performance Disparities in Clinical Classifiers

Evaluating whether clinical classifiers perform equitably across patient subgroups is a central requirement for the responsible deployment of machine learning in medicine. Conventional approaches test one fairness metric at a time, such as sensitivity, positive predictive value, or area under the receiver operating characteristic curve, and therefore cannot detect disparities that manifest only in the joint structure of a group-specific confusion matrix. We develop a unified hypothesis-testing framework rooted in random matrix theory that compares demographic groups through the L2 distance between their joint eigenvalue densities, yielding a scalar spectral divergence that is sensitive to every cell of the 2×2 confusion matrix simultaneously. We derive the closed-form spectral divergence for Gaussian-approximated eigenvalue densities, prove almost-sure consistency of the empirical estimator via the delta method, and construct an extreme-value (Gumbel) test statistic with family-wise error rate control. Monte Carlo experiments comprising 10,000 replications across balanced, moderately imbalanced, and severely imbalanced group-size regimes show that the spectral test keeps Type I errors close to its nominal level while achieving power exceeding 90% in complex and multi-dimensional violation scenarios, where the best single-metric competitor reaches at most 63%. Three clinical benchmark datasets from the UCI Machine Learning Repository utilised include Pima Indians Diabetes (n=768), Cleveland Heart Disease (n=303), and Heart Failure Clinical Records (n=299). Results confirm that the spectral method detects statistically significant (p<0.001) performance disparities missed by all three conventional tests. These results support eigenvalue-based divergence as a practical, model-agnostic diagnostic equity tool for clinical machine learning audits.

Authors

Institutions

Publication Details

Journal
Mathematics
Published
2026-07-17
DOI
https://doi.org/10.3390/math14142583
Primary Topic
Imbalanced Data Classification Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Eigenvalue-Based Diagnostic Equity Testing: A Random Matrix Framework for Detecting Multi-Dimensional Performance Disparities in Clinical Classifiers

Mohammed H. Alharbi, Ali Alzahrani, Oyebayo Ridwan Olaniran, Nada MohammedSaeed Alharbi et al.
Mathematics
Imbalanced Data Classification Techniques
article

Eigenvalue-Based Diagnostic Equity Testing: A Random Matrix Framework for Detecting Multi-Dimensional Performance Disparities in Clinical Classifiers

Mohammed H. Alharbi, Ali Alzahrani, Oyebayo Ridwan Olaniran, Nada MohammedSaeed Alharbi, Saheed Ajibade Kunle, Asma Ahmad Alzahrani
article en

Abstract

Evaluating whether clinical classifiers perform equitably across patient subgroups is a central requirement for the responsible deployment of machine learning in medicine. Conventional approaches test one fairness metric at a time, such as sensitivity, positive predictive value, or area under the receiver operating characteristic curve, and therefore cannot detect disparities that manifest only in the joint structure of a group-specific confusion matrix. We develop a unified hypothesis-testing framework rooted in random matrix theory that compares demographic groups through the L2 distance between their joint eigenvalue densities, yielding a scalar spectral divergence that is sensitive to every cell of the 2×2 confusion matrix simultaneously. We derive the closed-form spectral divergence for Gaussian-approximated eigenvalue densities, prove almost-sure consistency of the empirical estimator via the delta method, and construct an extreme-value (Gumbel) test statistic with family-wise error rate control. Monte Carlo experiments comprising 10,000 replications across balanced, moderately imbalanced, and severely imbalanced group-size regimes show that the spectral test keeps Type I errors close to its nominal level while achieving power exceeding 90% in complex and multi-dimensional violation scenarios, where the best single-metric competitor reaches at most 63%. Three clinical benchmark datasets from the UCI Machine Learning Repository utilised include Pima Indians Diabetes (n=768), Cleveland Heart Disease (n=303), and Heart Failure Clinical Records (n=299). Results confirm that the spectral method detects statistically significant (p<0.001) performance disparities missed by all three conventional tests. These results support eigenvalue-based divergence as a practical, model-agnostic diagnostic equity tool for clinical machine learning audits.

MathematicsVol. 14(14)
University of Ilorin (NG), Umm al-Qura University (SA), Taibah University (SA), University of Jeddah (SA), Al Baha University (SA), Kwara State University (NG)
Umm Al-Qura University
Openalex Percentile: Top 6%
Imbalanced Data Classification Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.