Within-Subject Precision Measurement: Theory and Utility of Assessing Change Scores and Their Variance
Within-subject studies gain statistical power by removing stable between-subject differences from the comparison. However, the metrics commonly used to select measurement instruments and anticipate their within-subject performance are often based on between-subject correlations of raw scores from test-retest designs. Measuring each subject's change directly -- after an intervention, and ideally more than once -- provides a firmer basis for evaluating measurement precision and planning studies of within-subject change. Here we describe the statistical theory behind estimating measurement properties from change scores. In one instantiation, the pre- and post-intervention measurements are each made twice, yielding the duplicate change-score design. Such a design provides an estimate of the mean signal change and enables the decomposition of the total observed variance of change scores into true between-subject response heterogeneity and measurement noise. In extended designs, where multiple measures are collected within and across days, measurement noise can be further decomposed to distinguish within-session from between-day measurement variability. These estimates supply the inputs needed for within-subject study design, including providing a basis for selecting among alternative measurements and comparing processing pipelines, performing power calculations, and estimating the precision limits of detecting change within individual subjects.
Authors
- B.T. Thomas Yeo (ORCID: https://orcid.org/0000-0002-0119-3276)
- Deanna M. Barch (ORCID: https://orcid.org/0000-0003-1693-8506)
- Patrick Mair (ORCID: https://orcid.org/0000-0003-0100-6511)
- Theodore Daniel Satterthwaite (ORCID: https://orcid.org/0000-0001-7072-9399)
- Randy L. Buckner (ORCID: https://orcid.org/0000-0001-6422-8037)
- Thomas E. Nichols (ORCID: https://orcid.org/0000-0002-4516-5103)
Institutions
- Harvard University (US)
- National University of Singapore (SG)
- Washington University in St. Louis (US)
- University of Oxford (GB)
- University of Pennsylvania (US)
Publication Details
- Journal
- bioRxiv (Cold Spring Harbor Laboratory)
- Published
- 2026-11-18
- DOI
- https://doi.org/10.64898/2026.11.16.767165
- Primary Topic
- Reliability and Agreement in Measurement
- Type
- preprint
Funders
- National Institute on Aging