Common Persons Design in Score Equating: A Monte Carlo Investigation

The Common Persons (CP) equating design offers critical advantages for high-security testing contexts-eliminating anchor item exposure risks while accommodating non-equivalent groups-yet few studies have systematically examined how CP characteristics influence equating accuracy, and the field still lacks clear implementation guidelines. Addressing this gap, this comprehensive Monte Carlo simulation (<i>N</i> = 5,000 examinees per form; 500 replications) evaluates CP equating by manipulating 8 factors: test length, difficulty shift, ability dispersion, correlation between test forms and CP characteristics. Four equating methods (identity, IRT true-score, linear, equipercentile) were compared using normalized RMSE and %Bias. Key findings reveal: (a) when the CP sample size reaches at least 30, CP sample properties exert negligible influence on accuracy, challenging assumptions about distributional representativeness; (b) Test factors dominate outcomes-difficulty shifts ( <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mrow><mml:mi>Δ</mml:mi> <mml:msub><mml:mrow><mml:mi>δ</mml:mi></mml:mrow> <mml:mrow><mml:mi>XY</mml:mi></mml:mrow> </mml:msub> </mml:mrow> </mml:math> = 1) degrade IRT precision severely (|%Bias| >22% vs. linear/equipercentile's |%Bias| <1.5%), while longer tests reduce NRMSE and wider ability dispersion ( <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:msub><mml:mrow><mml:mi>σ</mml:mi></mml:mrow> <mml:mrow><mml:mi>θ</mml:mi></mml:mrow> </mml:msub> </mml:mrow> </mml:math> = 1) enhances precision through improved person-item targeting; (c) Equipercentile and linear methods demonstrate superior robustness under form differences. We establish minimum operational thresholds: ≥30 CPs covering the score range suffice for precise equating. These results provide an evidence-based framework for CP implementation by systematically examining multiple manipulated factors, resolving security-vs-accuracy tradeoffs in high-stakes equating (e.g., credentialing exams) and enabling novel solutions like synthetic respondents.

Authors

Institutions

Publication Details

Journal
Educational and Psychological Measurement
Published
2025-10-29
DOI
https://doi.org/10.1177/00131644251380585
Citations
1
Primary Topic
Psychometric Methodologies and Testing
Type
article
Field-Weighted Citation Impact
2.11
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Common Persons Design in Score Equating: A Monte Carlo Investigation

Yuting Han, S. H. Feng, Zhehan Jiang, Tianle Zheng et al.
1 citations
Educational and Psychological Measurement
Psychometric Methodologies and Testing
2.11
article

Common Persons Design in Score Equating: A Monte Carlo Investigation

Yuting Han, S. H. Feng, Zhehan Jiang, Tianle Zheng, Jiayi Liu
article en
1 citations

Abstract

The Common Persons (CP) equating design offers critical advantages for high-security testing contexts-eliminating anchor item exposure risks while accommodating non-equivalent groups-yet few studies have systematically examined how CP characteristics influence equating accuracy, and the field still lacks clear implementation guidelines. Addressing this gap, this comprehensive Monte Carlo simulation (<i>N</i> = 5,000 examinees per form; 500 replications) evaluates CP equating by manipulating 8 factors: test length, difficulty shift, ability dispersion, correlation between test forms and CP characteristics. Four equating methods (identity, IRT true-score, linear, equipercentile) were compared using normalized RMSE and %Bias. Key findings reveal: (a) when the CP sample size reaches at least 30, CP sample properties exert negligible influence on accuracy, challenging assumptions about distributional representativeness; (b) Test factors dominate outcomes-difficulty shifts ( <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mrow><mml:mi>Δ</mml:mi> <mml:msub><mml:mrow><mml:mi>δ</mml:mi></mml:mrow> <mml:mrow><mml:mi>XY</mml:mi></mml:mrow> </mml:msub> </mml:mrow> </mml:math> = 1) degrade IRT precision severely (|%Bias| >22% vs. linear/equipercentile's |%Bias| <1.5%), while longer tests reduce NRMSE and wider ability dispersion ( <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:msub><mml:mrow><mml:mi>σ</mml:mi></mml:mrow> <mml:mrow><mml:mi>θ</mml:mi></mml:mrow> </mml:msub> </mml:mrow> </mml:math> = 1) enhances precision through improved person-item targeting; (c) Equipercentile and linear methods demonstrate superior robustness under form differences. We establish minimum operational thresholds: ≥30 CPs covering the score range suffice for precise equating. These results provide an evidence-based framework for CP implementation by systematically examining multiple manipulated factors, resolving security-vs-accuracy tradeoffs in high-stakes equating (e.g., credentialing exams) and enabling novel solutions like synthetic respondents.

Educational and Psychological MeasurementVol. 86(2)
Beijing Language and Culture University (CN), Peking University (CN)
Openalex Percentile: Top 9%
Psychometric Methodologies and Testing
2.11
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.