Assessing reading fluency in elementary grades: A machine learning approach
This study compares eleven widely used machine learning algorithms to identify the most accurate and comprehensive method for assessing children's reading fluency. Our fluency framework integrates three key dimensions: accuracy in word decoding, reading speed (words per minute), and prosody, which captures appropriate pausing and intonation during reading. Audio recordings from 2nd and 3rd grade students across 144 Brazilian schools were transcribed using the advanced Whisper ASR system, enabling automated extraction of fluency features. The research objective was to determine which algorithm best predicts fluency, considering diverse evaluation setups including binary classification (fluent versus non-fluent), multiclass classification (differentiated fluency levels), and regression analysis to estimate continuous fluency scores. Among the eleven models evaluated, Logistic Regression achieved the highest overall performance in the classification experiments, demonstrating superior precision and accuracy. Ensemble methods such as Gradient Boosting and Random Forest also yielded robust results, particularly in regression analyses where they effectively captured the variability in expert fluency ratings. Notably, reading speed emerged as the most critical indicator of fluency across all experiments, consistently outweighing contributions from accuracy and prosody. Nevertheless, prosody maintained significant importance, especially when fluency was modeled as a continuous variable, emphasizing the value of expressive reading. These findings suggest that while high accuracy in word decoding is fundamental, interventions that enhance reading speed and incorporate prosodic features can offer more nuanced support for reading development. This work provides educators with insights into scalable, automated, and cost-effective approaches to monitoring and improving reading fluency. • The approach covered the three dimensions of fluency: accuracy, speed, and prosody. • Logistic Regression was the best-performing model overall in the classification experiments. • Speed was the most determinant fluency characteristic across all applied experiments.
Authors
- Américo N. Amorim (ORCID: https://orcid.org/0000-0002-7834-2057)
- Lieny Jeon (ORCID: https://orcid.org/0000-0003-2028-8358)
- Vinícius F. da Silva
- Vanessa C. Silva (ORCID: https://orcid.org/0009-0007-8013-2239)
- Alexandre Zarate Maciel (ORCID: https://orcid.org/0000-0003-0397-4954)
- Suzana Souza (ORCID: https://orcid.org/0000-0003-2496-7999)
- Maxsuel S. Silva
- João Pedro Nunes (ORCID: https://orcid.org/0000-0001-8144-5906)
- Rodrigo Lins Rodrigues (ORCID: https://orcid.org/0000-0002-3598-5204)
- Emilia X.S. Albuquerque
- Gabriel Silva (ORCID: https://orcid.org/0000-0002-7470-8613)
- Alessandra de Aragão Pinheiro
- Igor Mauro
Institutions
- Universidade Federal de Pernambuco (BR)
- Faculty of 1000 (United States) (US)
- Centro de Estudos e Sistemas Avançados do Recife (BR)
- Secretaria da Educação (BR)
- University of Virginia (US)
- Universidade Federal Rural de Pernambuco (BR)
- Universidade de Pernambuco (BR)
Publication Details
- Journal
- Computers and Education Artificial Intelligence
- Published
- 2025-04-29
- DOI
- https://doi.org/10.1016/j.caeai.2025.100411
- Citations
- 4
- Primary Topic
- Reading and Literacy Development
- Type
- article
- Field-Weighted Citation Impact
- 13.78