The Importance of Specifying the Time Period in Repeated Measures of Personality Assessments

Because most validated personality measures were designed to capture relatively general and stable characteristics, they do not specify a particular timeframe for respondents to consider. It is thus unknown how these measures perform when administered repeatedly or how this performance compares to the same measures with instructions and items adapted to the repeated timeframe of interest. We randomly assigned undergraduate participants (N = 257; Mage = 20.4; 79% female; 77% white; 77% heterosexual) to complete measures of personality (NEO-FFI-3, LPFS-BF-2.0, PID-5-BF, FFBI-SF) with validated general instructions and items or measures with instructions and items pertaining to the previous week once per week for six weeks. Compared to measures with general instructions, measures with weekly instructions demonstrated greater within-person internal consistency (weekly omegas: .42-.83; general omegas: .44-.72), lower rank-order stability (weekly average one-week r: .72; general average one-week r: .86), greater variability (ds: .08-.94), lower average mean scores across time (ds: –.96 - .25), and stronger associations with measures of anxiety and depression, well-being, and functioning but similar between-person internal consistencies (weekly omegas: .79-.99; general omegas: .79-.99) and measurement invariance. Researchers assessing personality weekly may thus be able to capture more variability and stronger associations with relevant constructs while still maintaining reliable individual differences and construct validity using personality measures referencing participants’ past week. However, nuances such as lower average scores when referencing the past week should be kept in mind when comparing results between studies using different reference time frames.

Authors

Publication Details

Published
2025-10-04
DOI
https://doi.org/10.31234/osf.io/tb94v_v1
Primary Topic
Psychological Testing and Assessment
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Importance of Specifying the Time Period in Repeated Measures of Personality Assessments

Matthew W. Southward, Shannon Sauer‐Zavala, Nicole Stumpp, Sarah Cecil et al.
Psychological Testing and Assessment
article

The Importance of Specifying the Time Period in Repeated Measures of Personality Assessments

Matthew W. Southward, Shannon Sauer‐Zavala, Nicole Stumpp, Sarah Cecil, Caden Maynard, Madeline Kushner, Alexandra Kaelin Barnhill, Vincent Buchenberger
article en

Abstract

Because most validated personality measures were designed to capture relatively general and stable characteristics, they do not specify a particular timeframe for respondents to consider. It is thus unknown how these measures perform when administered repeatedly or how this performance compares to the same measures with instructions and items adapted to the repeated timeframe of interest. We randomly assigned undergraduate participants (N = 257; Mage = 20.4; 79% female; 77% white; 77% heterosexual) to complete measures of personality (NEO-FFI-3, LPFS-BF-2.0, PID-5-BF, FFBI-SF) with validated general instructions and items or measures with instructions and items pertaining to the previous week once per week for six weeks. Compared to measures with general instructions, measures with weekly instructions demonstrated greater within-person internal consistency (weekly omegas: .42-.83; general omegas: .44-.72), lower rank-order stability (weekly average one-week r: .72; general average one-week r: .86), greater variability (ds: .08-.94), lower average mean scores across time (ds: –.96 - .25), and stronger associations with measures of anxiety and depression, well-being, and functioning but similar between-person internal consistencies (weekly omegas: .79-.99; general omegas: .79-.99) and measurement invariance. Researchers assessing personality weekly may thus be able to capture more variability and stronger associations with relevant constructs while still maintaining reliable individual differences and construct validity using personality measures referencing participants’ past week. However, nuances such as lower average scores when referencing the past week should be kept in mind when comparing results between studies using different reference time frames.

National Institute of Mental Health
Openalex Percentile: Top 69%
Psychological Testing and Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

The Importance of Specifying the Time Period in Repeated Measures of Personality Assessments — Matthew W. Southward, Shannon Sauer‐Zavala, et al. · (2025) | TGRS Research Map | TGRS