On the Validity of Regression Models

This work elaborates the connection between prediction and description in regression analysis. Many empirical studies aim at description, which requires a valid regression model. I show that regression models with a strong prediction power can be highly invalid and thus be inappropriate for the purpose of description. Conversely, valid regression models may have a weak prediction power and they even need not fit at all. For this reason, measures of prediction power, or of goodness of fit, are not suitable for assessing the validity of regression models. I develop a simple validity test, which can be applied to all types of regression models with any number of regressors. It is very powerful in large samples and performs very well also in small samples, given that the validity of the regression model is sufficiently low and that there is not too much noise in the true regression equation.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-16
DOI
https://doi.org/10.5281/zenodo.22798006
Primary Topic
Advanced Statistical Modeling Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

On the Validity of Regression Models

Gabriel Frahm
Zenodo (CERN European Organization for Nuclear Research)
Advanced Statistical Modeling Techniques
article

On the Validity of Regression Models

Gabriel Frahm
article en

Abstract

This work elaborates the connection between prediction and description in regression analysis. Many empirical studies aim at description, which requires a valid regression model. I show that regression models with a strong prediction power can be highly invalid and thus be inappropriate for the purpose of description. Conversely, valid regression models may have a weak prediction power and they even need not fit at all. For this reason, measures of prediction power, or of goodness of fit, are not suitable for assessing the validity of regression models. I develop a simple validity test, which can be applied to all types of regression models with any number of regressors. It is very powerful in large samples and performs very well also in small samples, given that the validity of the regression model is sufficiently low and that there is not too much noise in the true regression equation.

Zenodo (CERN European Organization for Nuclear Research)
Helmut Schmidt University (DE)
Reduced inequalities
Openalex Percentile: Top 8%
Advanced Statistical Modeling Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.