A two-sample size estimator for large datasets

Summary In generalized method of moments (GMM) estimators, moment conditions with additive error terms involve an observed component and a predicted component. If the predicted component is computationally costly to evaluate, it may not be feasible to estimate the model with all the available data. We propose a simple two-sample ‘large–small’ size estimator that uses the full dataset for the computationally cheap observed component, but a reduced sample size for the predicted component. We derive a practical criterion for when the large-small estimator has a lower variance than standard GMM with the reduced sample size. As an alternative, we show how a previously described asymptotically efficient conditional expectation projection based GMM estimator can also be used to reduce computational cost in our setting. We compare the performance of the estimators in a Monte Carlo study of a panel-data random coefficients logit model, and illustrate the use of our estimator in an empirical application to alcohol demand.

Authors

Institutions

Publication Details

Journal
Econometrics Journal
Published
2025-01-09
DOI
https://doi.org/10.1093/ectj/utaf002
Primary Topic
Advanced Statistical Methods and Models
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A two-sample size estimator for large datasets

Øyvind Thomassen, Martin O’Connell, Howard W. Smith
Econometrics Journal
Advanced Statistical Methods and Models
article

A two-sample size estimator for large datasets

Øyvind Thomassen, Martin O’Connell, Howard W. Smith
article en

Abstract

Summary In generalized method of moments (GMM) estimators, moment conditions with additive error terms involve an observed component and a predicted component. If the predicted component is computationally costly to evaluate, it may not be feasible to estimate the model with all the available data. We propose a simple two-sample ‘large–small’ size estimator that uses the full dataset for the computationally cheap observed component, but a reduced sample size for the predicted component. We derive a practical criterion for when the large-small estimator has a lower variance than standard GMM with the reduced sample size. As an alternative, we show how a previously described asymptotically efficient conditional expectation projection based GMM estimator can also be used to reduce computational cost in our setting. We compare the performance of the estimators in a Monte Carlo study of a panel-data random coefficients logit model, and illustrate the use of our estimator in an empirical application to alcohol demand.

Econometrics JournalVol. 28(3)
University of Wisconsin–Madison (US), Institute for Fiscal Studies (GB), University of Oxford (GB), Norwegian School of Economics (NO)
Openalex Percentile: Top 99%
Advanced Statistical Methods and Models
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A two-sample size estimator for large datasets — Øyvind Thomassen, Martin O’Connell, et al. · Econometrics Journal (2025) | TGRS Research Map | TGRS