Beyond Classification Accuracy: A Stability-Driven and Explainable Multi-Stage Radiomics Framework for Breast Ultrasound Image Classification

Objective: The aim of this study is to reduce high-dimensional radiomic features extracted from breast ultrasound images into compact and stable subsets using a multi-stage feature selection process, and to evaluate the effectiveness of these features in classifying benign and malignant breast lesions through various machine learning algorithms. Methods: A total of 647 breast ultrasound images comprising 437 benign and 210 malignant cases obtained from the Breast Ultrasound Images (BUSI) dataset were used in this study. A total of 753 radiomic features were extracted using PyRadiomics, including first-order statistical, shape, and texture features, as well as features derived from wavelet and Laplacian of Gaussian transforms. To reduce feature dimensionality, a multi-stage feature selection approach was employed, consisting of variance filtering, correlation analysis, Mutual Information, Least Absolute Shrinkage and Selection Operator (LASSO), and Recursive Feature Elimination (RFE). Compact radiomic feature sets comprising five and ten features—were evaluated using nine machine learning algorithms through three-, five-, and ten-fold stratified cross-validation. Final model performance was assessed using an 80% development and 20% hold-out test split. Classification performance was evaluated through bootstrap confidence intervals, DeLong and McNemar tests, as well as calibration and decision curve analyses. Feature selection stability and model explainability were investigated using selection frequency, SHAP (SHapley Additive exPlanations), and permutation importance analyses. Results: As a result of a multi-stage feature selection process, compact candidate sets consisting of five and ten features were constructed. SVM and MLP models stood out due to their high classification performance. Explainability analyses, classification performance, and feature selection stability have provided significant opportunities for the multidimensional assessment of the diagnostic potential of compact radiomic feature sets.Conclusions: This study contributes to a comprehensive analysis of compact radiomics-based classification approaches by integrating explainability analyses, feature selection stability, statistical comparisons, and thorough model validation. For future research, validation using multi-center and independent datasets may be required to demonstrate clinical generalizability.

Authors

Publication Details

Journal
Preprints.org
Published
2026-11-16
DOI
https://doi.org/10.20944/preprints202611.1519.v1
Primary Topic
Radiomics and Machine Learning in Medical Imaging
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Beyond Classification Accuracy: A Stability-Driven and Explainable Multi-Stage Radiomics Framework for Breast Ultrasound Image Classification

Bahaddin Erdem
2 links
Preprints.org
Radiomics and Machine Learning in Medical Imaging
preprint

Beyond Classification Accuracy: A Stability-Driven and Explainable Multi-Stage Radiomics Framework for Breast Ultrasound Image Classification

Bahaddin Erdem
preprint en

Abstract

Objective: The aim of this study is to reduce high-dimensional radiomic features extracted from breast ultrasound images into compact and stable subsets using a multi-stage feature selection process, and to evaluate the effectiveness of these features in classifying benign and malignant breast lesions through various machine learning algorithms. Methods: A total of 647 breast ultrasound images comprising 437 benign and 210 malignant cases obtained from the Breast Ultrasound Images (BUSI) dataset were used in this study. A total of 753 radiomic features were extracted using PyRadiomics, including first-order statistical, shape, and texture features, as well as features derived from wavelet and Laplacian of Gaussian transforms. To reduce feature dimensionality, a multi-stage feature selection approach was employed, consisting of variance filtering, correlation analysis, Mutual Information, Least Absolute Shrinkage and Selection Operator (LASSO), and Recursive Feature Elimination (RFE). Compact radiomic feature sets comprising five and ten features—were evaluated using nine machine learning algorithms through three-, five-, and ten-fold stratified cross-validation. Final model performance was assessed using an 80% development and 20% hold-out test split. Classification performance was evaluated through bootstrap confidence intervals, DeLong and McNemar tests, as well as calibration and decision curve analyses. Feature selection stability and model explainability were investigated using selection frequency, SHAP (SHapley Additive exPlanations), and permutation importance analyses. Results: As a result of a multi-stage feature selection process, compact candidate sets consisting of five and ten features were constructed. SVM and MLP models stood out due to their high classification performance. Explainability analyses, classification performance, and feature selection stability have provided significant opportunities for the multidimensional assessment of the diagnostic potential of compact radiomic feature sets.Conclusions: This study contributes to a comprehensive analysis of compact radiomics-based classification approaches by integrating explainability analyses, feature selection stability, statistical comparisons, and thorough model validation. For future research, validation using multi-center and independent datasets may be required to demonstrate clinical generalizability.

Preprints.org
Good health and well-being
Radiomics and Machine Learning in Medical Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon