A Position-Sensitive Mixture Item Response Model

Standard item response theory (IRT) models are ill-equipped for when the probability of a correct response depends on the location in the test where an item is encountered—a phenomenon we refer to as position effects. Unmodeled position effects complicate comparing respondents taking the same test. We propose a position-sensitive IRT model that is a mixture of two item response functions, capturing the difference in response probability when the item is encountered early versus late in the test. The mixing proportion depends on item location and latent person-level characteristics, separating person and item contributions to position effects. We present simulation studies outlining various features of model performance and end with an application to a large-scale admissions test with observed position effects.

Authors

Institutions

Publication Details

Journal
Journal of Educational and Behavioral Statistics
Published
2024-11-25
DOI
https://doi.org/10.3102/10769986241289399
Citations
2
Primary Topic
Psychometric Methodologies and Testing
Type
article
Field-Weighted Citation Impact
0.98
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Position-Sensitive Mixture Item Response Model

Klint Kanopka, Benjamin W. Domingue
2 citations
Journal of Educational and Behavioral Statistics
Psychometric Methodologies and Testing
0.98
article

A Position-Sensitive Mixture Item Response Model

Klint Kanopka, Benjamin W. Domingue
article en
2 citations

Abstract

Standard item response theory (IRT) models are ill-equipped for when the probability of a correct response depends on the location in the test where an item is encountered—a phenomenon we refer to as position effects. Unmodeled position effects complicate comparing respondents taking the same test. We propose a position-sensitive IRT model that is a mixture of two item response functions, capturing the difference in response probability when the item is encountered early versus late in the test. The mixing proportion depends on item location and latent person-level characteristics, separating person and item contributions to position effects. We present simulation studies outlining various features of model performance and end with an application to a large-scale admissions test with observed position effects.

Journal of Educational and Behavioral StatisticsVol. 50(6)
New York University (US), Stanford University (US)
Openalex Percentile: Top 20%
Psychometric Methodologies and Testing
0.98
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.