Transformer-LSTM Models for Automatic Scoring and Feedback in English Writing Assessment

Writing assessment is one of the most important stages in the educational process, but it is also the most resource-demanding one. To address the challenges of scalability and inconsistency, this study proposes a Transformer-LSTM model for automated scoring and feedback generation, enhancing accuracy and reliability in assessment. Integrating the contextual reading abilities of transformers with the sequential analysis strength of LSTMs, the model analyzes significant metrics of writing quality, including grammar, coherence, and structure, while providing individualized, actionable feedback. Using annotated datasets and evaluation metrics like RMSE and feedback relevance, it was established that the model performs well overall and that improvements in grammar and coherence seemed to be the most significant contributors to writing ability. It was also demonstrated that feedback relevance enhances these outcomes, thus confirming its valuable role in promoting structural and grammatical accuracy. Understanding that most existing systems do not encourage significant human feedback, this work demonstrates a scalable approach with potential alignment with human evaluation standards. Finally, this study shows hybrid models’ promise for automated writing assessment as promising scalable, equitable, impact-based tools for global enhancement of educational outcomes.

Authors

Institutions

Publication Details

Journal
IEEE Access
Published
2025-01-01
DOI
https://doi.org/10.1109/access.2025.3562493
Primary Topic
Educational Technology and Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Transformer-LSTM Models for Automatic Scoring and Feedback in English Writing Assessment

Yunyun Xuan
IEEE Access
Educational Technology and Assessment
article

Transformer-LSTM Models for Automatic Scoring and Feedback in English Writing Assessment

Yunyun Xuan
article en

Abstract

Writing assessment is one of the most important stages in the educational process, but it is also the most resource-demanding one. To address the challenges of scalability and inconsistency, this study proposes a Transformer-LSTM model for automated scoring and feedback generation, enhancing accuracy and reliability in assessment. Integrating the contextual reading abilities of transformers with the sequential analysis strength of LSTMs, the model analyzes significant metrics of writing quality, including grammar, coherence, and structure, while providing individualized, actionable feedback. Using annotated datasets and evaluation metrics like RMSE and feedback relevance, it was established that the model performs well overall and that improvements in grammar and coherence seemed to be the most significant contributors to writing ability. It was also demonstrated that feedback relevance enhances these outcomes, thus confirming its valuable role in promoting structural and grammatical accuracy. Understanding that most existing systems do not encourage significant human feedback, this work demonstrates a scalable approach with potential alignment with human evaluation standards. Finally, this study shows hybrid models’ promise for automated writing assessment as promising scalable, equitable, impact-based tools for global enhancement of educational outcomes.

IEEE AccessVol. 13
Universiti Putra Malaysia (MY)
Quality Education
Openalex Percentile: Top 90%
Educational Technology and Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.