Empirical Analysis of SHAP Stability Under Data Corruption Across Datasets and Model Architectures

The deployment of machine learning models in critical decision making requires reliable explanations that remain stable under varying data conditions.While SHapley Additive exPlanations (SHAP) provides theoretically grounded feature importance rankings, the stability of these explanations when models encounter corrupted or degraded data remains poorly understood.This study investigates the robustness of SHAP feature importance rankings under controlled data corruption scenarios across three classification algorithms and datasets of varying complexity.The methodology employs optimally regularized Logistic Regression, Random Forest, and XGBoost models trained on medical, financial, and text classification datasets.Controlled corruption mechanisms combining 5% random sample removal and Gaussian noise injection with standard deviation equal to 0.1 times feature standard deviation simulate realistic data quality degradation.Stability metrics including Spearman correlation, Kendall tau, and top k feature overlap quantify ranking preservation.Results demonstrate that properly regularized models maintain substantial SHAP stability, with Spearman correlations exceeding 0.89 across all configurations.Random Forest exhibits superior stability with near perfect correlation (0.999) on structured data, while maintaining correlations above 0.95 across all scenarios.The findings establish that appropriate regularization and model selection enable reliable SHAP explanations even under moderate data corruption, providing practical guidelines for deploying interpretable machine learning in production environments where data quality cannot be guaranteed.

Authors

Publication Details

Journal
IARJSET
Published
2025-08-18
DOI
https://doi.org/10.17148/iarjset.2025.12810
Primary Topic
Cloud Computing and Resource Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Empirical Analysis of SHAP Stability Under Data Corruption Across Datasets and Model Architectures

May Stow, Annemie Stewart
IARJSET
Cloud Computing and Resource Management
article

Empirical Analysis of SHAP Stability Under Data Corruption Across Datasets and Model Architectures

May Stow, Annemie Stewart
article en

Abstract

The deployment of machine learning models in critical decision making requires reliable explanations that remain stable under varying data conditions.While SHapley Additive exPlanations (SHAP) provides theoretically grounded feature importance rankings, the stability of these explanations when models encounter corrupted or degraded data remains poorly understood.This study investigates the robustness of SHAP feature importance rankings under controlled data corruption scenarios across three classification algorithms and datasets of varying complexity.The methodology employs optimally regularized Logistic Regression, Random Forest, and XGBoost models trained on medical, financial, and text classification datasets.Controlled corruption mechanisms combining 5% random sample removal and Gaussian noise injection with standard deviation equal to 0.1 times feature standard deviation simulate realistic data quality degradation.Stability metrics including Spearman correlation, Kendall tau, and top k feature overlap quantify ranking preservation.Results demonstrate that properly regularized models maintain substantial SHAP stability, with Spearman correlations exceeding 0.89 across all configurations.Random Forest exhibits superior stability with near perfect correlation (0.999) on structured data, while maintaining correlations above 0.95 across all scenarios.The findings establish that appropriate regularization and model selection enable reliable SHAP explanations even under moderate data corruption, providing practical guidelines for deploying interpretable machine learning in production environments where data quality cannot be guaranteed.

IARJSETVol. 12(8)
Peace, Justice and strong institutions
Openalex Percentile: Top 69%
Cloud Computing and Resource Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Empirical Analysis of SHAP Stability Under Data Corruption Across Datasets and Model Architectures — May Stow, Annemie Stewart · IARJSET (2025) | TGRS Research Map | TGRS