The Appropriate Sample Size to Avoid the Biasness of the Parameters Estimation in Binary Logistic Regression Models

In general, the maximum likelihood method with Newton-Raphson iteration is used to estimate the parameters of the binary logistic regression models, and also can be estimated using an iterative (re-)weighted least squares (IWLS) whose iterations are equivalent to the Newton-Raphson iterations. However, it is known that these methods produce bias estimates if small sample sizes are used. The main aim of this paper is to determine the appropriate sample size to achieve the unbiasedness of parameters estimates in the binary logistic regression model. To investigate the appropriate sample size three models were suggested and generated with known parameters. The estimates of the suggested models were collected via simulation study, using different sample sizes. The expected values for the collected parameters by the simulation where compared with the actual values of parameters of the suggested models. From the results of the simulation study, it was found that the appropriate sample size to achieve the unbiasness for such models, is 80 or more.

Authors

Publication Details

Journal
Scholars Journal of Physics Mathematics and Statistics
Published
2024-12-10
DOI
https://doi.org/10.36347/sjpms.2024.v11i12.001
Primary Topic
Advanced Statistical Methods and Models
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Appropriate Sample Size to Avoid the Biasness of the Parameters Estimation in Binary Logistic Regression Models

Ramzi Othman, Jalal A. Moaiti
Scholars Journal of Physics Mathematics and Statistics
Advanced Statistical Methods and Models
article

The Appropriate Sample Size to Avoid the Biasness of the Parameters Estimation in Binary Logistic Regression Models

Ramzi Othman, Jalal A. Moaiti
article en

Abstract

In general, the maximum likelihood method with Newton-Raphson iteration is used to estimate the parameters of the binary logistic regression models, and also can be estimated using an iterative (re-)weighted least squares (IWLS) whose iterations are equivalent to the Newton-Raphson iterations. However, it is known that these methods produce bias estimates if small sample sizes are used. The main aim of this paper is to determine the appropriate sample size to achieve the unbiasedness of parameters estimates in the binary logistic regression model. To investigate the appropriate sample size three models were suggested and generated with known parameters. The estimates of the suggested models were collected via simulation study, using different sample sizes. The expected values for the collected parameters by the simulation where compared with the actual values of parameters of the suggested models. From the results of the simulation study, it was found that the appropriate sample size to achieve the unbiasness for such models, is 80 or more.

Scholars Journal of Physics Mathematics and StatisticsVol. 11(12)
Openalex Percentile: Top 76%
Advanced Statistical Methods and Models
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

The Appropriate Sample Size to Avoid the Biasness of the Parameters Estimation in Binary Logistic Regression Models — Ramzi Othman, Jalal A. Moaiti · Scholars Journal of Physics Mathematics and Statistics (2024) | TGRS Research Map | TGRS