<scp><i>R</i><sup>2</sup></scp> should not be used to describe behavioral‐economic discounting and demand models

Literature concerning operant behavioral economics shows a strong preference for the coefficient of determination (R<sup>2</sup>) metric to (a) describe how well an applied model accounts for variance and (b) depict the quality of collected data. Yet R<sup>2</sup> is incompatible with nonlinear modeling. In this report, we provide an updated discussion of the concerns with R<sup>2</sup>. We first review recent articles that have been published in the Journal of the Experimental Analysis of Behavior that employ nonlinear models, noting recent trends in goodness-of-fit reporting, including the continued reliance on R<sup>2</sup>. We then examine the tendency for these metrics to bias against linear-like patterns via a positive correlation between goodness of fit and the primary outputs of behavioral-economic modeling. Mathematically, R<sup>2</sup> is systematically more stringent for lower values for discounting parameters (e.g., k) in discounting studies and lower values for the elasticity parameter (α) in demand analysis. The study results suggest there may be heterogeneity in how this bias emerges in data sets of varied composition and origin. There are limitations when using any goodness-of-fit measure to assess the systematic nature of data in behavioral-economic studies, and to address those we recommend the use of algorithms that test fundamental expectations of the data.

Authors

Institutions

Publication Details

Journal
Journal of the Experimental Analysis of Behavior
Published
2024-08-19
DOI
https://doi.org/10.1002/jeab.4200
Citations
6
Primary Topic
Behavioral and Psychological Studies
Type
article
Field-Weighted Citation Impact
4.74
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

R2 should not be used to describe behavioral‐economic discounting and demand models

Brett W. Gelino, Justin C. Strickland, Matthew W. Johnson
6 citations
Journal of the Experimental Analysis of Behavior
Behavioral and Psychological Studies
4.74
article

R2 should not be used to describe behavioral‐economic discounting and demand models

Brett W. Gelino, Justin C. Strickland, Matthew W. Johnson
article en
6 citations

Abstract

Literature concerning operant behavioral economics shows a strong preference for the coefficient of determination (R<sup>2</sup>) metric to (a) describe how well an applied model accounts for variance and (b) depict the quality of collected data. Yet R<sup>2</sup> is incompatible with nonlinear modeling. In this report, we provide an updated discussion of the concerns with R<sup>2</sup>. We first review recent articles that have been published in the Journal of the Experimental Analysis of Behavior that employ nonlinear models, noting recent trends in goodness-of-fit reporting, including the continued reliance on R<sup>2</sup>. We then examine the tendency for these metrics to bias against linear-like patterns via a positive correlation between goodness of fit and the primary outputs of behavioral-economic modeling. Mathematically, R<sup>2</sup> is systematically more stringent for lower values for discounting parameters (e.g., k) in discounting studies and lower values for the elasticity parameter (α) in demand analysis. The study results suggest there may be heterogeneity in how this bias emerges in data sets of varied composition and origin. There are limitations when using any goodness-of-fit measure to assess the systematic nature of data in behavioral-economic studies, and to address those we recommend the use of algorithms that test fundamental expectations of the data.

Journal of the Experimental Analysis of BehaviorVol. 122(2)
Johns Hopkins University (US), Johns Hopkins Medicine (US), Sheppard and Enoch Pratt Hospital (US)
Openalex Percentile: Top 5%
Behavioral and Psychological Studies
4.74
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.