Passage Difficulty Modeling in Oral Reading Fluency Assessments

In oral reading fluency (ORF) assessments, passages contain rich textual information that may inform their levels of difficulty. In this study, we estimated passage parameters using a speed-accuracy measurement model and investigated whether those parameters could be predicted from observable textual characteristics, thereby extending item difficulty modeling from discrete items to reading passages. Despite the dismal overall performance of the models, results showed that baseline linguistic features, including several readability indices were good predictors of passage difficulty and time-intensity parameters. Surprisal features, which are related to the unexpectedness of words in a passage, improved the prediction of time-intensity parameters; however, they did not contribute to the prediction of passage difficulty. These findings demonstrate the potential of derived textual features to explain psychometric passage parameters and support passage calibration, selection, and development in ORF assessments.

Authors

Institutions

Publication Details

Journal
Applied Measurement in Education
Published
2026-11-12
DOI
https://doi.org/10.1080/08957347.2026.2760382
Primary Topic
Reading and Literacy Development
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Passage Difficulty Modeling in Oral Reading Fluency Assessments

William Ebo Annan, Zoltán Szentkirályi, Yusuf Kara, Joanne Joo et al.
Applied Measurement in Education
Reading and Literacy Development
article

Passage Difficulty Modeling in Oral Reading Fluency Assessments

William Ebo Annan, Zoltán Szentkirályi, Yusuf Kara, Joanne Joo, Kuo Wang, Cesar Flores
article en

Abstract

In oral reading fluency (ORF) assessments, passages contain rich textual information that may inform their levels of difficulty. In this study, we estimated passage parameters using a speed-accuracy measurement model and investigated whether those parameters could be predicted from observable textual characteristics, thereby extending item difficulty modeling from discrete items to reading passages. Despite the dismal overall performance of the models, results showed that baseline linguistic features, including several readability indices were good predictors of passage difficulty and time-intensity parameters. Surprisal features, which are related to the unexpectedness of words in a passage, improved the prediction of time-intensity parameters; however, they did not contribute to the prediction of passage difficulty. These findings demonstrate the potential of derived textual features to explain psychometric passage parameters and support passage calibration, selection, and development in ORF assessments.

Applied Measurement in Education
University of Miami (US), Clarkson University (US), Southern Methodist University (US)
Institute of Education Sciences
Quality education
Reading and Literacy Development
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon