Within-Subject Precision Measurement: Theory and Utility of Assessing Change Scores and Their Variance

Within-subject studies gain statistical power by removing stable between-subject differences from the comparison. However, the metrics commonly used to select measurement instruments and anticipate their within-subject performance are often based on between-subject correlations of raw scores from test-retest designs. Measuring each subject's change directly -- after an intervention, and ideally more than once -- provides a firmer basis for evaluating measurement precision and planning studies of within-subject change. Here we describe the statistical theory behind estimating measurement properties from change scores. In one instantiation, the pre- and post-intervention measurements are each made twice, yielding the duplicate change-score design. Such a design provides an estimate of the mean signal change and enables the decomposition of the total observed variance of change scores into true between-subject response heterogeneity and measurement noise. In extended designs, where multiple measures are collected within and across days, measurement noise can be further decomposed to distinguish within-session from between-day measurement variability. These estimates supply the inputs needed for within-subject study design, including providing a basis for selecting among alternative measurements and comparing processing pipelines, performing power calculations, and estimating the precision limits of detecting change within individual subjects.

Authors

Institutions

Publication Details

Journal
bioRxiv (Cold Spring Harbor Laboratory)
Published
2026-11-18
DOI
https://doi.org/10.64898/2026.11.16.767165
Primary Topic
Reliability and Agreement in Measurement
Type
preprint

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Within-Subject Precision Measurement: Theory and Utility of Assessing Change Scores and Their Variance

B.T. Thomas Yeo, Deanna M. Barch, Patrick Mair, Theodore Daniel Satterthwaite et al.
bioRxiv (Cold Spring Harbor Laboratory)
Reliability and Agreement in Measurement
preprint

Within-Subject Precision Measurement: Theory and Utility of Assessing Change Scores and Their Variance

B.T. Thomas Yeo, Deanna M. Barch, Patrick Mair, Theodore Daniel Satterthwaite, Randy L. Buckner, Thomas E. Nichols
preprint en

Abstract

Within-subject studies gain statistical power by removing stable between-subject differences from the comparison. However, the metrics commonly used to select measurement instruments and anticipate their within-subject performance are often based on between-subject correlations of raw scores from test-retest designs. Measuring each subject's change directly -- after an intervention, and ideally more than once -- provides a firmer basis for evaluating measurement precision and planning studies of within-subject change. Here we describe the statistical theory behind estimating measurement properties from change scores. In one instantiation, the pre- and post-intervention measurements are each made twice, yielding the duplicate change-score design. Such a design provides an estimate of the mean signal change and enables the decomposition of the total observed variance of change scores into true between-subject response heterogeneity and measurement noise. In extended designs, where multiple measures are collected within and across days, measurement noise can be further decomposed to distinguish within-session from between-day measurement variability. These estimates supply the inputs needed for within-subject study design, including providing a basis for selecting among alternative measurements and comparing processing pipelines, performing power calculations, and estimating the precision limits of detecting change within individual subjects.

bioRxiv (Cold Spring Harbor Laboratory)
Harvard University (US), National University of Singapore (SG), Washington University in St. Louis (US), University of Oxford (GB), University of Pennsylvania (US)
National Institute on Aging
Reliability and Agreement in Measurement
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon