SubPSI: Detecting Hidden Bias Drift in Machine Learning Through Subgroup-Decomposed Population Stability Analysis.

This paper studies subgroup-decomposed population stability index (PSI) analysis for detecting bias drift in machine learning models, meaning shifts within subgroups that aggregate drift monitoring can miss. It tests the method with mathematical simulations, public-record comparisons and resampling experiments, and benchmarks it against Kolmogorov–Smirnov tests. An optimized implementation cut median processing time by 40.6% compared with standard PSI, and all checked comparisons gave the same results as the standard method. The paper also sets out the method’s limitations and where KS tests still do better. Submitted to NSEF Pakistan (National Science and Engineering Fair), Systems Software category.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-19
DOI
https://doi.org/10.5281/zenodo.24374393
Primary Topic
Ethics and Social Impacts of AI
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

SubPSI: Detecting Hidden Bias Drift in Machine Learning Through Subgroup-Decomposed Population Stability Analysis.

Hiba Chaudhry
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
preprint

SubPSI: Detecting Hidden Bias Drift in Machine Learning Through Subgroup-Decomposed Population Stability Analysis.

Hiba Chaudhry
preprint en

Abstract

This paper studies subgroup-decomposed population stability index (PSI) analysis for detecting bias drift in machine learning models, meaning shifts within subgroups that aggregate drift monitoring can miss. It tests the method with mathematical simulations, public-record comparisons and resampling experiments, and benchmarks it against Kolmogorov–Smirnov tests. An optimized implementation cut median processing time by 40.6% compared with standard PSI, and all checked comparisons gave the same results as the standard method. The paper also sets out the method’s limitations and where KS tests still do better. Submitted to NSEF Pakistan (National Science and Engineering Fair), Systems Software category.

Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon