Robust Variable Selection Via Reciprocal Elastic Net in High-Dimensional Regression

Variable selection in high-dimensional regression models is crucial for improving interpretability and predictive accuracy. Traditional penalized ‎regression methods, such as the LASSO and Elastic Net, suffer from sensitivity to outliers, which can lead to biased coefficient estimation and ‎incorrect variable selection. In this study, we propose a robust variable selection method based on the reciprocal elastic net penalty, which ‎enhances sparsity while maintaining stability in the presence of extreme values. To further improve robustness, we integrate Huber loss and M-estimators, thereby mitigating the influence of outliers on the regression coefficients. The proposed method is evaluated through an extensive simulation ‎study under different contamination levels and applied to a financial risk dataset, where the presence of anomalies is common. Performance is ‎assessed using mean absolute error and breakdown point as evaluation criteria. The results demonstrate that the robust reciprocal elastic net ‎outperforms traditional penalized regression models and provides more reliable variable selection in the presence of outliers‎.

Authors

Institutions

Publication Details

Journal
International Journal of Advanced Mathematical Sciences
Published
2025-10-26
DOI
https://doi.org/10.14419/m6v7vs95
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Robust Variable Selection Via Reciprocal Elastic Net in High-Dimensional Regression

Saif Hosam Raheem
International Journal of Advanced Mathematical Sciences
Neural Networks and Applications
article

Robust Variable Selection Via Reciprocal Elastic Net in High-Dimensional Regression

Saif Hosam Raheem
article en

Abstract

Variable selection in high-dimensional regression models is crucial for improving interpretability and predictive accuracy. Traditional penalized ‎regression methods, such as the LASSO and Elastic Net, suffer from sensitivity to outliers, which can lead to biased coefficient estimation and ‎incorrect variable selection. In this study, we propose a robust variable selection method based on the reciprocal elastic net penalty, which ‎enhances sparsity while maintaining stability in the presence of extreme values. To further improve robustness, we integrate Huber loss and M-estimators, thereby mitigating the influence of outliers on the regression coefficients. The proposed method is evaluated through an extensive simulation ‎study under different contamination levels and applied to a financial risk dataset, where the presence of anomalies is common. Performance is ‎assessed using mean absolute error and breakdown point as evaluation criteria. The results demonstrate that the robust reciprocal elastic net ‎outperforms traditional penalized regression models and provides more reliable variable selection in the presence of outliers‎.

International Journal of Advanced Mathematical SciencesVol. 11(2)
University of Al-Qadisiyah (IQ)
Openalex Percentile: Top 84%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.