AI-ASSISTED GRADING IN HIGHEREDUCATION: ACCURACY, EFFICIANCY, AND FAIRNESS COMPARED TO HUMAN RATERS

This study investigates the use of artificial intelligence (AI) in higher education essay grading, emphasizing justice, validity, efficiency, and dependability. Modern AI systems are made to deliver assessments more quickly and consistently, whereas traditional hand grading is frequently laborious and subjective. Three hundred undergraduate essays were compared and evaluated by an AI system that was in line with the rubric and by qualified human raters. According to the results, AI grading performed close to human-human agreement (0.84), with a Quadratic Weighted Kappa (QWK) of 0.81 in comparison to human raters' consensus scores. Furthermore, AI shortened the grading process by almost 70%, demonstrating its effectiveness in extensive evaluation. Nevertheless, a fairness investigation showed some biases, with AI giving native speakers slightly higher marks. These results imply that AI-based grading can efficiently enable consistent, fast, and extensive evaluation in higher education when paired with teacher supervision and fairness checks.

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-10-12
DOI
https://doi.org/10.5281/zenodo.17334954
Primary Topic
Academic integrity and plagiarism
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI-ASSISTED GRADING IN HIGHEREDUCATION: ACCURACY, EFFICIANCY, AND FAIRNESS COMPARED TO HUMAN RATERS

Zenodo (CERN European Organization for Nuclear Research)
Academic integrity and plagiarism
article

AI-ASSISTED GRADING IN HIGHEREDUCATION: ACCURACY, EFFICIANCY, AND FAIRNESS COMPARED TO HUMAN RATERS

article en

Abstract

This study investigates the use of artificial intelligence (AI) in higher education essay grading, emphasizing justice, validity, efficiency, and dependability. Modern AI systems are made to deliver assessments more quickly and consistently, whereas traditional hand grading is frequently laborious and subjective. Three hundred undergraduate essays were compared and evaluated by an AI system that was in line with the rubric and by qualified human raters. According to the results, AI grading performed close to human-human agreement (0.84), with a Quadratic Weighted Kappa (QWK) of 0.81 in comparison to human raters' consensus scores. Furthermore, AI shortened the grading process by almost 70%, demonstrating its effectiveness in extensive evaluation. Nevertheless, a fairness investigation showed some biases, with AI giving native speakers slightly higher marks. These results imply that AI-based grading can efficiently enable consistent, fast, and extensive evaluation in higher education when paired with teacher supervision and fairness checks.

Zenodo (CERN European Organization for Nuclear Research)
Quality Education
Openalex Percentile: Top 44%
Academic integrity and plagiarism
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

AI-ASSISTED GRADING IN HIGHEREDUCATION: ACCURACY, EFFICIANCY, AND FAIRNESS COMPARED TO HUMAN RATERS · Zenodo (CERN European Organization for Nuclear Research) (2025) | TGRS Research Map | TGRS