Machine Learning Algorithms for Improved Script Evaluation

Evaluating subjective answers in educational assessments presents a complex challenge due to the need for contextual and semantic understanding. Traditional keyword-based approaches often fall short in capturing the subtleties of students' responses. This paper investigates the use of three different methods: BERT (Bidirectional Encoder Representations from Transformers), Cosine Similarity, and Fuzzy Logic to enhance the accuracy and context sensitivity in evaluating subjective answers. The experimental analysis demonstrates that these methods can improve the evaluation process by offering more precise and contextually aware grading. A comprehensive comparison was conducted using metrics such as accuracy, precision, recall, which resulted in improvements, particularly with BERT. The implications of incorporating these methods in educational settings are profound, offering potential advancements in automated grading systems. Overall, key findings suggest that integrating these methods can lead to more reliable and efficient subjective answer evaluation, contributing to the advancement of automated educational technologies.

Authors

Publication Details

Published
2024-11-07
DOI
https://doi.org/10.1109/csitss64042.2024.10816825
Primary Topic
Machine Learning and Data Classification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Machine Learning Algorithms for Improved Script Evaluation

Ashwini KB, Manasi Patwardhan
Machine Learning and Data Classification
article

Machine Learning Algorithms for Improved Script Evaluation

Ashwini KB, Manasi Patwardhan
article en

Abstract

Evaluating subjective answers in educational assessments presents a complex challenge due to the need for contextual and semantic understanding. Traditional keyword-based approaches often fall short in capturing the subtleties of students' responses. This paper investigates the use of three different methods: BERT (Bidirectional Encoder Representations from Transformers), Cosine Similarity, and Fuzzy Logic to enhance the accuracy and context sensitivity in evaluating subjective answers. The experimental analysis demonstrates that these methods can improve the evaluation process by offering more precise and contextually aware grading. A comprehensive comparison was conducted using metrics such as accuracy, precision, recall, which resulted in improvements, particularly with BERT. The implications of incorporating these methods in educational settings are profound, offering potential advancements in automated grading systems. Overall, key findings suggest that integrating these methods can lead to more reliable and efficient subjective answer evaluation, contributing to the advancement of automated educational technologies.

Quality Education
Openalex Percentile: Top 77%
Machine Learning and Data Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.