A survey on deep learning-based automated essay scoring and feedback generation

Deep learning-based automated essay scoring (AES) models exhibit a remarkable ability to identify complex patterns within essays and then generate accurate score predictions in an end-to-end training fashion. However, these models face a critical limitation in explaining the specific patterns and features utilized for scoring, which are essential for interpreting the scores and offering constructive feedback to essay authors. Numerous studies have focused on essay scoring, with the aim of modeling prompt-specific, domain-adaptable, or trait-specific AES. While existing surveys on AES cover topics ranging from representation to scoring models, they primarily emphasize scoring models. This study addresses a crucial gap by encompassing research on feedback generation for essay assessment tasks. By delving into essay scoring and feedback generation, we synthesize several existing literature to provide readers with a comprehensive understanding of ongoing research in both deep learning-based essay scoring and automated feedback generation. We categorized the existing essay scoring studies into prompt-specific and cross-prompt AES models, noting that prompt-specific AES is extensively researched category. However, we have only come across a few studies concerning automated feedback generation, likely because of the limited availability of suitable datasets for researching such types of tasks. Moreover, this survey provides insights into approaches for essay representation, prevalent datasets, evaluation metrics, and challenges in automated essay scoring tasks. By shedding light on these aspects, our goal is to delineate the current landscape, identify key research directions, and pave the way for further advancements in automated essay assessment.

Authors

Institutions

Publication Details

Journal
Artificial Intelligence Review
Published
2024-12-20
DOI
https://doi.org/10.1007/s10462-024-11017-5
Citations
17
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
5.91

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A survey on deep learning-based automated essay scoring and feedback generation

Ingyu Lee, Gyu Sang Choi, Haile Misgna, Byung-Won On
17 citations
Artificial Intelligence Review
Topic Modeling
5.91
article

A survey on deep learning-based automated essay scoring and feedback generation

Ingyu Lee, Gyu Sang Choi, Haile Misgna, Byung-Won On
article en
17 citations

Abstract

Deep learning-based automated essay scoring (AES) models exhibit a remarkable ability to identify complex patterns within essays and then generate accurate score predictions in an end-to-end training fashion. However, these models face a critical limitation in explaining the specific patterns and features utilized for scoring, which are essential for interpreting the scores and offering constructive feedback to essay authors. Numerous studies have focused on essay scoring, with the aim of modeling prompt-specific, domain-adaptable, or trait-specific AES. While existing surveys on AES cover topics ranging from representation to scoring models, they primarily emphasize scoring models. This study addresses a crucial gap by encompassing research on feedback generation for essay assessment tasks. By delving into essay scoring and feedback generation, we synthesize several existing literature to provide readers with a comprehensive understanding of ongoing research in both deep learning-based essay scoring and automated feedback generation. We categorized the existing essay scoring studies into prompt-specific and cross-prompt AES models, noting that prompt-specific AES is extensively researched category. However, we have only come across a few studies concerning automated feedback generation, likely because of the limited availability of suitable datasets for researching such types of tasks. Moreover, this survey provides insights into approaches for essay representation, prevalent datasets, evaluation metrics, and challenges in automated essay scoring tasks. By shedding light on these aspects, our goal is to delineate the current landscape, identify key research directions, and pave the way for further advancements in automated essay assessment.

Artificial Intelligence ReviewVol. 58(2)
Kunsan National University (KR), Yeungnam University (KR)
National Research Foundation, National Research Foundation of Korea, Ministry of Science and ICT, South Korea
Openalex Percentile: Top 3%
Topic Modeling
5.91
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.