Real-Time Dynamic Adaptive Test Assembly for Personalized Measurement of Cognitive Abilities Under Continuous Item Bank Growth

The accurate measurement of individual cognitive abilities in educational settings increasingly relies on personalized assessment systems that adapt to the learner’s current standing on the measured ability. These systems generate and use assessment items continuously and in real-time, bypassing the field-test cycle that traditional calibration requires. Item banks therefore contain a growing share of items whose parameters must be predicted first, and each test form must be assembled in real time to match the learner’s current ability level and content needs for effective personalized instruction. This study proposes an Ising framework that addresses both requirements by predicting item parameters from text with calibrated uncertainty estimates and assembling personalized test forms within the time budget of the assessment loop. This framework is validated through a factorial simulation and an empirical study on state-level English Language Arts items across Grades 3 through 12. In the simulation, the proposed uncertainty-aware method achieves a mean test information function (TIF) gap of 0.226, compared with 1.171 for the conventional baseline that ignores prediction uncertainty. The proposed method also produces feasible forms across the full operational region, whereas the chance-constrained and robust baselines become infeasible at high prediction error combined with a high share of predicted items. In the empirical study, predictive intervals achieve coverage within ten percentage points of the nominal level in the pooled condition, and the uncertainty-aware assembly reduces the TIF gap relative to the baseline, with the largest gains at the extremes of the ability distribution where accurate measurement matters most for instructional placement decisions. By separating prediction uncertainty from true individual differences in ability, this framework preserves the interpretability of cognitive ability estimates and provides a foundation for personalized assessment systems that support differentiated instruction under continuous item bank growth.

Authors

Institutions

Publication Details

Journal
Journal of Intelligence
Published
2026-09-06
DOI
https://doi.org/10.3390/jintelligence14090216
Primary Topic
Psychometric Methodologies and Testing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Real-Time Dynamic Adaptive Test Assembly for Personalized Measurement of Cognitive Abilities Under Continuous Item Bank Growth

Jiawei Xiong, Feiming Li, Qidi Liu, Cheng Tang
Journal of Intelligence
Psychometric Methodologies and Testing
article

Real-Time Dynamic Adaptive Test Assembly for Personalized Measurement of Cognitive Abilities Under Continuous Item Bank Growth

Jiawei Xiong, Feiming Li, Qidi Liu, Cheng Tang
article en

Abstract

The accurate measurement of individual cognitive abilities in educational settings increasingly relies on personalized assessment systems that adapt to the learner’s current standing on the measured ability. These systems generate and use assessment items continuously and in real-time, bypassing the field-test cycle that traditional calibration requires. Item banks therefore contain a growing share of items whose parameters must be predicted first, and each test form must be assembled in real time to match the learner’s current ability level and content needs for effective personalized instruction. This study proposes an Ising framework that addresses both requirements by predicting item parameters from text with calibrated uncertainty estimates and assembling personalized test forms within the time budget of the assessment loop. This framework is validated through a factorial simulation and an empirical study on state-level English Language Arts items across Grades 3 through 12. In the simulation, the proposed uncertainty-aware method achieves a mean test information function (TIF) gap of 0.226, compared with 1.171 for the conventional baseline that ignores prediction uncertainty. The proposed method also produces feasible forms across the full operational region, whereas the chance-constrained and robust baselines become infeasible at high prediction error combined with a high share of predicted items. In the empirical study, predictive intervals achieve coverage within ten percentage points of the nominal level in the pooled condition, and the uncertainty-aware assembly reduces the TIF gap relative to the baseline, with the largest gains at the extremes of the ability distribution where accurate measurement matters most for instructional placement decisions. By separating prediction uncertainty from true individual differences in ability, this framework preserves the interpretability of cognitive ability estimates and provides a foundation for personalized assessment systems that support differentiated instruction under continuous item bank growth.

Journal of IntelligenceVol. 14(9)
Zhejiang Normal University (CN), University of Georgia (US)
Quality Education
Openalex Percentile: Top 6%
Psychometric Methodologies and Testing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.