Enhancing Arabic Automated Essay Scoring with Synthetic Data and Error Injection

Automated Essay Scoring (AES) plays a crucial role in assessing language learners' writing quality, reducing grading workload, and providing real-time feedback.The lack of annotated essay datasets inhibits the development of Arabic AES systems.This paper leverages Large Language Models (LLMs) and Transformer models to generate synthetic Arabic essays for AES.We prompt an LLM to generate essays across the Common European Framework of Reference (CEFR) proficiency levels and introduce and compare two approaches to error injection.We create a dataset of 3,040 annotated essays with errors injected using our two methods.Additionally, we develop a BERTbased Arabic AES system calibrated to CEFR levels.Our experimental results demonstrate the effectiveness of our synthetic dataset in improving Arabic AES performance.We make our code and data publicly available. 1

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.bea-1.40
Citations
2
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
4.96
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Arabic Automated Essay Scoring with Synthetic Data and Error Injection

Ted Briscoe, Chatrine Qwaider, Nizar Habash, Bashar Alhafni et al.
2 citations
Natural Language Processing Techniques
4.96
article

Enhancing Arabic Automated Essay Scoring with Synthetic Data and Error Injection

Ted Briscoe, Chatrine Qwaider, Nizar Habash, Bashar Alhafni, Kirill Chirkunov
article en
2 citations

Abstract

Automated Essay Scoring (AES) plays a crucial role in assessing language learners' writing quality, reducing grading workload, and providing real-time feedback.The lack of annotated essay datasets inhibits the development of Arabic AES systems.This paper leverages Large Language Models (LLMs) and Transformer models to generate synthetic Arabic essays for AES.We prompt an LLM to generate essays across the Common European Framework of Reference (CEFR) proficiency levels and introduce and compare two approaches to error injection.We create a dataset of 3,040 annotated essays with errors injected using our two methods.Additionally, we develop a BERTbased Arabic AES system calibrated to CEFR levels.Our experimental results demonstrate the effectiveness of our synthetic dataset in improving Arabic AES performance.We make our code and data publicly available. 1

Openalex Percentile: Top 5%
Natural Language Processing Techniques
4.96
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.