On the Validity of Regression Models
This work elaborates the connection between prediction and description in regression analysis. Many empirical studies aim at description, which requires a valid regression model. I show that regression models with a strong prediction power can be highly invalid and thus be inappropriate for the purpose of description. Conversely, valid regression models may have a weak prediction power and they even need not fit at all. For this reason, measures of prediction power, or of goodness of fit, are not suitable for assessing the validity of regression models. I develop a simple validity test, which can be applied to all types of regression models with any number of regressors. It is very powerful in large samples and performs very well also in small samples, given that the validity of the regression model is sufficiently low and that there is not too much noise in the true regression equation.
Authors
- Gabriel Frahm (ORCID: https://orcid.org/0000-0001-7507-730X)
Institutions
- Helmut Schmidt University (DE)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-09-16
- DOI
- https://doi.org/10.5281/zenodo.22798005
- Primary Topic
- Advanced Statistical Modeling Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00