Exponential Squared Loss-Based Robust Variable Selection with Prior Information in Linear Regression Models

This paper proposes a robust variable selection method that incorporates prior information through linear constraints. For more than a decade, penalized likelihood frameworks have been the predominant approach for variable selection, where appropriate loss and penalty functions are selected to formulate unconstrained optimization problems. However, in many specific applications, some prior information can be obtained. In this paper, we reformulate variable selection by incorporating prior knowledge as linear constraints. In addition, the loss function adopted in this paper is a robust exponential squared loss function, which ensures that the estimation of model parameter coefficient will not have a great impact when there are a few outliers in the dataset. This paper uses the designed solution algorithm to calculate the estimated values of coefficients and some other parameters, and finally conducts numerical simulations and a real-data experiment. Experimental results demonstrate that our model significantly improves estimation robustness compared to existing methods, even in outlier-contaminated scenarios.

Authors

Institutions

Publication Details

Journal
Axioms
Published
2025-07-04
DOI
https://doi.org/10.3390/axioms14070516
Primary Topic
Statistical Methods and Inference
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exponential Squared Loss-Based Robust Variable Selection with Prior Information in Linear Regression Models

Jin Tian, Yunquan Song, Hongyuan Wei
Axioms
Statistical Methods and Inference
article

Exponential Squared Loss-Based Robust Variable Selection with Prior Information in Linear Regression Models

Jin Tian, Yunquan Song, Hongyuan Wei
article en

Abstract

This paper proposes a robust variable selection method that incorporates prior information through linear constraints. For more than a decade, penalized likelihood frameworks have been the predominant approach for variable selection, where appropriate loss and penalty functions are selected to formulate unconstrained optimization problems. However, in many specific applications, some prior information can be obtained. In this paper, we reformulate variable selection by incorporating prior knowledge as linear constraints. In addition, the loss function adopted in this paper is a robust exponential squared loss function, which ensures that the estimation of model parameter coefficient will not have a great impact when there are a few outliers in the dataset. This paper uses the designed solution algorithm to calculate the estimated values of coefficients and some other parameters, and finally conducts numerical simulations and a real-data experiment. Experimental results demonstrate that our model significantly improves estimation robustness compared to existing methods, even in outlier-contaminated scenarios.

AxiomsVol. 14(7)
China University of Petroleum, East China (CN)
Fundamental Research Funds for the Central Universities
Openalex Percentile: Top 84%
Statistical Methods and Inference
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Exponential Squared Loss-Based Robust Variable Selection with Prior Information in Linear Regression Models — Jin Tian, Yunquan Song, et al. · Axioms (2025) | TGRS Research Map | TGRS