Automatic Assessment of Short Answer Questions

Automatic grading tools are increasingly used in educational settings as a substitute for manual grading, particularly for open-answer questions. However, many existing systems lack some necessary features to ensure accurate and reliable results and meet the changing needs for different target users. This research addresses some of these limitations by introducing the Automatic Assessment of short Answer Questions system, a novel contribution to the field of Automatic Short Answer Grading. The system utilizes an unsupervised machine learning approach in natural language processing, integrating Word2vec embeddings, the Cosine Similarity metric, and the Ginger spell correction tool to enhance grading accuracy. The inclusion of a spell correction component ensures fair grading for non-native English speakers by mitigating the impact of spelling errors on their marks. Experimental evaluation using the F1 metric demonstrated an average performance of 95%, showcasing the system's effectiveness in improving grading reliability through advanced model configurations and refined spell correction techniques.

Authors

Institutions

Publication Details

Published
2025-05-07
DOI
https://doi.org/10.1109/aiit63112.2025.11082812
Primary Topic
Educational Technology and Assessment
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Automatic Assessment of Short Answer Questions

Ghada Alharbi, Hadir Orkouby, Eman Redwan, Layan Talal et al.
Educational Technology and Assessment
article

Automatic Assessment of Short Answer Questions

Ghada Alharbi, Hadir Orkouby, Eman Redwan, Layan Talal, Sarah Mahalawi
article en

Abstract

Automatic grading tools are increasingly used in educational settings as a substitute for manual grading, particularly for open-answer questions. However, many existing systems lack some necessary features to ensure accurate and reliable results and meet the changing needs for different target users. This research addresses some of these limitations by introducing the Automatic Assessment of short Answer Questions system, a novel contribution to the field of Automatic Short Answer Grading. The system utilizes an unsupervised machine learning approach in natural language processing, integrating Word2vec embeddings, the Cosine Similarity metric, and the Ginger spell correction tool to enhance grading accuracy. The inclusion of a spell correction component ensures fair grading for non-native English speakers by mitigating the impact of spelling errors on their marks. Experimental evaluation using the F1 metric demonstrated an average performance of 95%, showcasing the system's effectiveness in improving grading reliability through advanced model configurations and refined spell correction techniques.

Taibah University (SA)
Taibah University
Openalex Percentile: Top 74%
Educational Technology and Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Automatic Assessment of Short Answer Questions — Ghada Alharbi, Hadir Orkouby, et al. · (2025) | TGRS Research Map | TGRS