Comparative Evaluation of Some Penalty Regression Techniques in the Multicollinearity Problem

This study aimed to predict an important biological trait, such as egg albumen height, in the presence of multicollinearity problem using some external quality parameters (egg weight, width, length, shape index, Haugh unit). Although a high coefficient of determination (R²=0.995) was obtained in the multiple regression model generated using the Classical Least Squares Method (LSM), serious multicollinearity problem was detected among the independent variables, negatively impacting the model's reliability. To address this issue, LASSO and Liu regression techniques were applied; in models generated with both methods, the explanatory factor R² decreased to approximately 89 %, but the multicollinearity problem was effectively mitigated. Comparisons also showed that the Liu regression model outperformed the LASSO model in terms of information criteria (AIC, cAIC, BIC). The results show that regression methods with penalty terms provide reliable and consistent estimates in data sets with multicollinearity problems, and these techniques are recommended for the analysis and modeling of biological data.

Authors

Institutions

Publication Details

Journal
Türk Tarım ve Doğa Bilimleri Dergisi
Published
2025-10-17
DOI
https://doi.org/10.30910/turkjans.1757995
Primary Topic
Advanced Statistical Methods and Models
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparative Evaluation of Some Penalty Regression Techniques in the Multicollinearity Problem

Tolga Tolun
Türk Tarım ve Doğa Bilimleri Dergisi
Advanced Statistical Methods and Models
article

Comparative Evaluation of Some Penalty Regression Techniques in the Multicollinearity Problem

Tolga Tolun
article en

Abstract

This study aimed to predict an important biological trait, such as egg albumen height, in the presence of multicollinearity problem using some external quality parameters (egg weight, width, length, shape index, Haugh unit). Although a high coefficient of determination (R²=0.995) was obtained in the multiple regression model generated using the Classical Least Squares Method (LSM), serious multicollinearity problem was detected among the independent variables, negatively impacting the model's reliability. To address this issue, LASSO and Liu regression techniques were applied; in models generated with both methods, the explanatory factor R² decreased to approximately 89 %, but the multicollinearity problem was effectively mitigated. Comparisons also showed that the Liu regression model outperformed the LASSO model in terms of information criteria (AIC, cAIC, BIC). The results show that regression methods with penalty terms provide reliable and consistent estimates in data sets with multicollinearity problems, and these techniques are recommended for the analysis and modeling of biological data.

Türk Tarım ve Doğa Bilimleri DergisiVol. 12(4)
Kahramanmaraş Sütçü İmam University (TR)
Openalex Percentile: Top 72%
Advanced Statistical Methods and Models
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.