No Validity Without Reliability: Measurement in Relationship Science, 1994–2024

ABSTRACT Measurement reliability is necessary for validity and foundational to theory, inference, and cumulative knowledge in relationship science, yet concerns about questionable measurement practices persist. We examined long‐term trends in measurement reliability and reporting practices across 482 empirical articles published in three leading relationship‐focused journals ( JPSP: IRGP , JSPR , and PR ) in 1994, 2004, 2014, and 2024. Using multilevel models to account for measures nested within studies nested within articles, we assessed change over time and journal differences in internal consistency reliability, scale length, citation age of measures, sample size, sample items, and use of ad‐hoc and single‐item measures. Results revealed steady increases in internal consistency reliability (driven by mean inter‐item correlation increases), alongside accelerating growth in sample sizes and a marked decline in ad‐hoc measures after the mid‐2000s. At the same time, authors increasingly relied on older measures, and trends in scale length, single‐item usage, and sample‐item inclusion varied by journal. Despite gains in reliability, validity reporting remained rare. These findings document meaningful progress in some aspects of measurement practice while underscoring the continued neglect of validity reporting. We conclude with recommendations for researchers, reviewers, and editors aimed at strengthening measurement reporting and cumulative progress in relationship science.

Authors

Institutions

Publication Details

Journal
Personal Relationships
Published
2026-08-28
DOI
https://doi.org/10.1111/pere.70086
Primary Topic
Attachment and Relationship Dynamics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

No Validity Without Reliability: Measurement in Relationship Science, 1994–2024

Gregory D. Webster, A. Krause, Soo Yeon Park, Z. T. Li et al.
Personal Relationships
Attachment and Relationship Dynamics
article

No Validity Without Reliability: Measurement in Relationship Science, 1994–2024

Gregory D. Webster, A. Krause, Soo Yeon Park, Z. T. Li, Eva A. García Ferrés, Amy Pezoldt, Anaïs Ortiz
article en

Abstract

ABSTRACT Measurement reliability is necessary for validity and foundational to theory, inference, and cumulative knowledge in relationship science, yet concerns about questionable measurement practices persist. We examined long‐term trends in measurement reliability and reporting practices across 482 empirical articles published in three leading relationship‐focused journals ( JPSP: IRGP , JSPR , and PR ) in 1994, 2004, 2014, and 2024. Using multilevel models to account for measures nested within studies nested within articles, we assessed change over time and journal differences in internal consistency reliability, scale length, citation age of measures, sample size, sample items, and use of ad‐hoc and single‐item measures. Results revealed steady increases in internal consistency reliability (driven by mean inter‐item correlation increases), alongside accelerating growth in sample sizes and a marked decline in ad‐hoc measures after the mid‐2000s. At the same time, authors increasingly relied on older measures, and trends in scale length, single‐item usage, and sample‐item inclusion varied by journal. Despite gains in reliability, validity reporting remained rare. These findings document meaningful progress in some aspects of measurement practice while underscoring the continued neglect of validity reporting. We conclude with recommendations for researchers, reviewers, and editors aimed at strengthening measurement reporting and cumulative progress in relationship science.

Personal RelationshipsVol. 33(3)
University of Florida (US)
Reduced inequalities
Openalex Percentile: Top 6%
Attachment and Relationship Dynamics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

No Validity Without Reliability: Measurement in Relationship Science, 1994–2024 — Gregory D. Webster, A. Krause, et al. · Personal Relationships (2026) | TGRS Research Map | TGRS