Establishing Content Validity for the Scale for Emotion Regulation in Everyday Life (SERiEL): A Mixed-Methods Approach to Iterative Optimization

Experience Sampling Methods (ESM) offer a promising approach to capturing emotion regulation (ER), but item validity is often unclear due to ad hoc development and insufficient evaluation. Qualitative approaches can uncover validity issues, yet systematic guidelines remain limited. We examined content validity of the Scale for Emotion Regulation in Everyday Life (SERiEL), a new ESM questionnaire, via mixed-methods triangulation of qualitative (cognitive interviews) and quantitative (online surveys) data from users (n = 16) and researchers (n = 12). Analyses revealed content validity concerns in 15 item wordings, 5 flagged quantitatively and 10 more qualitatively, with qualitative analyses yielding richer, more nuanced insights. Most prominent was construct conflation, including confusion between ER strategies and between strategy employment and perceived success. Our systematic cognitive interview analysis approach and lessons learned may inform standardized best practices across studies; for ER research, clearly distinguishing distinct regulation processes seems important to avoid construct conflation.

Authors

Publication Details

Journal
PsyArXiv (OSF Preprints)
Published
2026-11-18
DOI
https://doi.org/10.31234/osf.io/6djw7_v1
Primary Topic
Psychometric Methodologies and Testing
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Establishing Content Validity for the Scale for Emotion Regulation in Everyday Life (SERiEL): A Mixed-Methods Approach to Iterative Optimization

Julia Anna Glombiewski, Julia Haas, Philipp Herzog, Saskia Scholten et al.
PsyArXiv (OSF Preprints)
Psychometric Methodologies and Testing
preprint

Establishing Content Validity for the Scale for Emotion Regulation in Everyday Life (SERiEL): A Mixed-Methods Approach to Iterative Optimization

Julia Anna Glombiewski, Julia Haas, Philipp Herzog, Saskia Scholten, Lea Schemer, Lisa Kolb-Grunder
preprint en

Abstract

Experience Sampling Methods (ESM) offer a promising approach to capturing emotion regulation (ER), but item validity is often unclear due to ad hoc development and insufficient evaluation. Qualitative approaches can uncover validity issues, yet systematic guidelines remain limited. We examined content validity of the Scale for Emotion Regulation in Everyday Life (SERiEL), a new ESM questionnaire, via mixed-methods triangulation of qualitative (cognitive interviews) and quantitative (online surveys) data from users (n = 16) and researchers (n = 12). Analyses revealed content validity concerns in 15 item wordings, 5 flagged quantitatively and 10 more qualitatively, with qualitative analyses yielding richer, more nuanced insights. Most prominent was construct conflation, including confusion between ER strategies and between strategy employment and perceived success. Our systematic cognitive interview analysis approach and lessons learned may inform standardized best practices across studies; for ER research, clearly distinguishing distinct regulation processes seems important to avoid construct conflation.

PsyArXiv (OSF Preprints)
Psychometric Methodologies and Testing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon