Specification-Curve Analysis of Exposure and Eligibility Definitions in a Synthetic Medicare Cohort: How Raw Claims-Processing Decisions Shape Estimated Associations

Purpose. Studies of Medicare claims rest on many small processing decisions about who enters the cohort, how drug exposure is defined and how follow-up is handled. These choices are rarely varied or reported together, so a single published estimate may reflect them as much as the underlying association. Methods. We used the 2008–2009 CMS DE-SynPUF Sample 1 synthetic Medicare claims file (116,352 beneficiaries; 114,538 alive at baseline). The outcome was hospitalization during 2009 and the exposure was any prescription drug claim in 2008. We crossed four cohort rules, two exposure definitions, two follow-up rules and two adjustment sets into 32 specifications and estimated the risk difference in each with robust standard errors. We tested the whole set jointly with the specification-curve procedure of Simonsohn and colleagues (500 resamples under a forced null) and measured how much of the variation each decision explains. Results. Risk differences ranged from 0.46 to 8.26 percentage points (median 3.89). Twenty-five of 32 specifications were significant, all in the positive direction, and the joint tests rejected the null (all P < 0.01). The cohort rule explained 66.1% of the variation among the estimates and the follow-up rule 15.4%; the exposure definition (0.05%) and covariate adjustment (0.01%) explained almost none. Requiring full-year Part D coverage raised the share classed as exposed from 62.3% to 97.5%. Conclusions. In this synthetic cohort the direction of the association was stable, but its size depended mainly on cohort eligibility rules rather than on the exposure definition or adjustment. Claims studies should report eligibility sensitivity analyses alongside their primary estimate. The data are synthetic and all findings are associational; no causal or drug-safety inference is intended.

Authors

Publication Details

Journal
Preprints.org
Published
2026-11-18
DOI
https://doi.org/10.20944/preprints202611.1826.v1
Primary Topic
Advanced Causal Inference Techniques
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Specification-Curve Analysis of Exposure and Eligibility Definitions in a Synthetic Medicare Cohort: How Raw Claims-Processing Decisions Shape Estimated Associations

Olakunle Daniel Olorunkemi
Preprints.org
Advanced Causal Inference Techniques
preprint

Specification-Curve Analysis of Exposure and Eligibility Definitions in a Synthetic Medicare Cohort: How Raw Claims-Processing Decisions Shape Estimated Associations

Olakunle Daniel Olorunkemi
preprint en

Abstract

Purpose. Studies of Medicare claims rest on many small processing decisions about who enters the cohort, how drug exposure is defined and how follow-up is handled. These choices are rarely varied or reported together, so a single published estimate may reflect them as much as the underlying association. Methods. We used the 2008–2009 CMS DE-SynPUF Sample 1 synthetic Medicare claims file (116,352 beneficiaries; 114,538 alive at baseline). The outcome was hospitalization during 2009 and the exposure was any prescription drug claim in 2008. We crossed four cohort rules, two exposure definitions, two follow-up rules and two adjustment sets into 32 specifications and estimated the risk difference in each with robust standard errors. We tested the whole set jointly with the specification-curve procedure of Simonsohn and colleagues (500 resamples under a forced null) and measured how much of the variation each decision explains. Results. Risk differences ranged from 0.46 to 8.26 percentage points (median 3.89). Twenty-five of 32 specifications were significant, all in the positive direction, and the joint tests rejected the null (all P < 0.01). The cohort rule explained 66.1% of the variation among the estimates and the follow-up rule 15.4%; the exposure definition (0.05%) and covariate adjustment (0.01%) explained almost none. Requiring full-year Part D coverage raised the share classed as exposed from 62.3% to 97.5%. Conclusions. In this synthetic cohort the direction of the association was stable, but its size depended mainly on cohort eligibility rules rather than on the exposure definition or adjustment. Claims studies should report eligibility sensitivity analyses alongside their primary estimate. The data are synthetic and all findings are associational; no causal or drug-safety inference is intended.

Preprints.org
Advanced Causal Inference Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon