Quantile-based robust Kibria–Lukman estimator for linear regression model to combat multicollinearity and outliers: Real life applications using T20 cricket sports and anthropometric data
The performance of ordinary least squares (OLS) and ridge regression (RR) are influenced when outliers are present in y-direction with multicollinearity among independent variables. The robust RR with ridge parameters provides a biased estimator that has a smaller variance than conventional OLS and RR estimators. The optimal value of the ridge parameter has a vital role in bias-variance tradeoff. This study proposes quantile-based estimation of ridge parameter in robust RR to deal with the joint issue of y-direction outliers and multicollinearity. The effectiveness of the proposed estimators is evaluated using intensive Monte Carlo simulation and two real data sets in terms of mean square error (MSE) and predictions sum of squared error (PSSE) criterion. Simulation findings reveal that the newly developed estimators of ridge parameter in robust RR have better performance than OLS, RR, and existing robust RR estimators when errors are normally and non-normally distributed. The results from two numerical examples of T20 Cricket sports and anthropometric data show that the new estimator with quantile probability 0.50 and 0.99 respectively has winning performance among all competing and proposed estimators. • Multicollinearity and outliers pose challenges in linear regression models. • A new robust ridge M-estimator addresses multicollinearity with y-direction outliers. • The proposed estimators efficiently handle multicollinearity with dependent variable outliers. • Simulations and real data show the effectiveness of the proposed ridge estimators.
Authors
- Fuad A. A. Awwad (ORCID: https://orcid.org/0000-0001-9541-5695)
- Muhammad Suhail (ORCID: https://orcid.org/0000-0003-1784-5272)
- Maha Shabbir (ORCID: https://orcid.org/0000-0002-1525-2505)
- Emad A. A. Ismail (ORCID: https://orcid.org/0000-0003-0430-0847)
- Danish Wasim (ORCID: https://orcid.org/0000-0002-9620-8855)
- Sajjad Ahmad Khan (ORCID: https://orcid.org/0000-0001-6630-7222)
- Amjad Ali (ORCID: https://orcid.org/0000-0001-8048-9093)
- Hijaz Ahmad (ORCID: https://orcid.org/0000-0002-5438-5407)
Institutions
- University of the Punjab (PK)
- Islamia College University (PK)
- The University of Agriculture, Peshawar (PK)
- King Saud University (SA)
- University of Business and Technology (SA)
- Abasyn University (PK)
- Near East University (CY)
Publication Details
- Journal
- Kuwait Journal of Science
- Published
- 2024-10-18
- DOI
- https://doi.org/10.1016/j.kjs.2024.100336
- Citations
- 3
- Primary Topic
- Advanced Statistical Methods and Models
- Type
- article
- Field-Weighted Citation Impact
- 2.13