Homogeneity-Pursuit Calibration of Item Response Theory Models with Limited Samples and Sparse Response Data

Calibrating item response theory models is challenging when item banks are large relative to available sample sizes and response data are sparsely observed, as commonly occurs in classroom assessment, low-stakes testing, and early-stage item bank development. These challenges are particularly pronounced for the two-parameter logistic model, where unconstrained estimation often yields unstable or extreme item parameter estimates. To address this problem, we propose a new calibration framework based on homogeneity pursuit (HP), which stabilizes estimation by adaptively pooling information across items with similar psychometric properties. Rather than aiming to recover exact latent groupings, HP reduces effective model complexity through data-driven equality constraints, improving finite-sample estimation accuracy. We develop two variants of the proposed framework-HP-Scott and HP-Silhouette-that differ in the criteria used to guide adaptive pooling. Three simulation studies evaluate the performance of HP under idealized and realistic item-bank settings, including continuous parameter variation, small sample sizes, and high missing-response rates. Across these conditions, HP consistently reduces estimation error and mitigates extreme parameter estimates compared with baseline approaches. A real classroom assessment application with over 60% missing responses further demonstrates that HP produces more plausible item parameter estimates and superior model fit.

Authors

Institutions

Publication Details

Journal
Multivariate Behavioral Research
Published
2026-10-16
DOI
https://doi.org/10.1080/00273171.2026.2737426
Primary Topic
Psychometric Methodologies and Testing
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Homogeneity-Pursuit Calibration of Item Response Theory Models with Limited Samples and Sparse Response Data

程聪, Shiyu Wang, Yuan Ke, Zichu Liu
Multivariate Behavioral Research
Psychometric Methodologies and Testing
article

Homogeneity-Pursuit Calibration of Item Response Theory Models with Limited Samples and Sparse Response Data

程聪, Shiyu Wang, Yuan Ke, Zichu Liu
article en

Abstract

Calibrating item response theory models is challenging when item banks are large relative to available sample sizes and response data are sparsely observed, as commonly occurs in classroom assessment, low-stakes testing, and early-stage item bank development. These challenges are particularly pronounced for the two-parameter logistic model, where unconstrained estimation often yields unstable or extreme item parameter estimates. To address this problem, we propose a new calibration framework based on homogeneity pursuit (HP), which stabilizes estimation by adaptively pooling information across items with similar psychometric properties. Rather than aiming to recover exact latent groupings, HP reduces effective model complexity through data-driven equality constraints, improving finite-sample estimation accuracy. We develop two variants of the proposed framework-HP-Scott and HP-Silhouette-that differ in the criteria used to guide adaptive pooling. Three simulation studies evaluate the performance of HP under idealized and realistic item-bank settings, including continuous parameter variation, small sample sizes, and high missing-response rates. Across these conditions, HP consistently reduces estimation error and mitigates extreme parameter estimates compared with baseline approaches. A real classroom assessment application with over 60% missing responses further demonstrates that HP produces more plausible item parameter estimates and superior model fit.

Multivariate Behavioral Research
University of Georgia (US)
Directorate for Social, Behavioral and Economic Sciences
Openalex Percentile: Top 10%
Psychometric Methodologies and Testing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.