Real-Time Dynamic Adaptive Test Assembly for Personalized Measurement of Cognitive Abilities Under Continuous Item Bank Growth
The accurate measurement of individual cognitive abilities in educational settings increasingly relies on personalized assessment systems that adapt to the learner’s current standing on the measured ability. These systems generate and use assessment items continuously and in real-time, bypassing the field-test cycle that traditional calibration requires. Item banks therefore contain a growing share of items whose parameters must be predicted first, and each test form must be assembled in real time to match the learner’s current ability level and content needs for effective personalized instruction. This study proposes an Ising framework that addresses both requirements by predicting item parameters from text with calibrated uncertainty estimates and assembling personalized test forms within the time budget of the assessment loop. This framework is validated through a factorial simulation and an empirical study on state-level English Language Arts items across Grades 3 through 12. In the simulation, the proposed uncertainty-aware method achieves a mean test information function (TIF) gap of 0.226, compared with 1.171 for the conventional baseline that ignores prediction uncertainty. The proposed method also produces feasible forms across the full operational region, whereas the chance-constrained and robust baselines become infeasible at high prediction error combined with a high share of predicted items. In the empirical study, predictive intervals achieve coverage within ten percentage points of the nominal level in the pooled condition, and the uncertainty-aware assembly reduces the TIF gap relative to the baseline, with the largest gains at the extremes of the ability distribution where accurate measurement matters most for instructional placement decisions. By separating prediction uncertainty from true individual differences in ability, this framework preserves the interpretability of cognitive ability estimates and provides a foundation for personalized assessment systems that support differentiated instruction under continuous item bank growth.
Authors
- Jiawei Xiong (ORCID: https://orcid.org/0000-0002-2069-8720)
- Feiming Li (ORCID: https://orcid.org/0009-0002-3963-4847)
- Qidi Liu (ORCID: https://orcid.org/0000-0002-6797-4163)
- Cheng Tang (ORCID: https://orcid.org/0000-0001-9780-7203)
Institutions
- Zhejiang Normal University (CN)
- University of Georgia (US)
Publication Details
- Journal
- Journal of Intelligence
- Published
- 2026-09-06
- DOI
- https://doi.org/10.3390/jintelligence14090216
- Primary Topic
- Psychometric Methodologies and Testing
- Type
- article
- Field-Weighted Citation Impact
- 0.00