An LLM-based hybrid approach for enhanced automated essay scoring

Automated Essay Scoring systems have traditionally relied on shallow lexical data, such as word frequency and sentence length, to assess essays. However, these approaches neglect crucial factors like text structure and semantics, resulting in limited evaluations of coherence and quality. To address these limitations, we propose a hybrid approach to AES that combines multiple features from different linguistic levels. By leveraging the complementary nature of these features, our model captures the intricate relationships underlying coherent texts. Through extensive experimentation using standard essay datasets, we demonstrate that our large language model based hybrid model surpasses state-of-the-art methods based on shallow features and pure neural networks. This research represents a significant advancement towards the development of an accurate and effective tool for assessing student writing.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2025-04-25
DOI
https://doi.org/10.1038/s41598-025-87862-3
Citations
13
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
32.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An LLM-based hybrid approach for enhanced automated essay scoring

John Atkinson, Diego Palma
13 citations
Scientific Reports
Topic Modeling
32.25
article

An LLM-based hybrid approach for enhanced automated essay scoring

John Atkinson, Diego Palma
article en
13 citations

Abstract

Automated Essay Scoring systems have traditionally relied on shallow lexical data, such as word frequency and sentence length, to assess essays. However, these approaches neglect crucial factors like text structure and semantics, resulting in limited evaluations of coherence and quality. To address these limitations, we propose a hybrid approach to AES that combines multiple features from different linguistic levels. By leveraging the complementary nature of these features, our model captures the intricate relationships underlying coherent texts. Through extensive experimentation using standard essay datasets, we demonstrate that our large language model based hybrid model surpasses state-of-the-art methods based on shallow features and pure neural networks. This research represents a significant advancement towards the development of an accurate and effective tool for assessing student writing.

Scientific ReportsVol. 15(1)
Empowerment Program (US)
Openalex Percentile: Top 0%
Topic Modeling
32.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.