Classification AI vs Generative AI in grading and feedback

Marking is among the most time-consuming activities in education, and artificial intelligence (AI) is widely proposed as a remedy. Attention has centred on generative large language models, yet regulators raise concerns about their bias, consistency, and explainability. This paper contrasts generative grading with per-question classification models trained only on an educator’s own marking and deployed in a human-in-the-loop workflow. The architectures are compared against criteria drawn from regulatory guidance: transparency, construct-relevant features, determinism, and specifiable training data. A narrower role for generative models is also identified, in composing and restructuring marker-approved feedback rather than in marking. Deployment analytics from one platform are then reported, covering approximately 166,000 marked questions, 39,500 essays, and six institutions: 66.2% of questions were marked in under one minute, 77.6% to 89.5% of AI suggestions were accepted, and essay models reached a quadratic weighted kappa of 0.93 for high-confidence predictions. Questionnaire responses from earlier pilots (33 markers, 30 students) are also reported: markers described marking as faster and consistent feedback as easier to provide; most students rated feedback more consistent and higher in quality. Implications for institutions selecting or building such tools are discussed, alongside the limitations of vendor-collected data.

Authors

Publication Details

Journal
ASCILITE Publications
Published
2026-11-17
DOI
https://doi.org/10.65106/apubs.2026.3409
Primary Topic
Artificial Intelligence in Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Classification AI vs Generative AI in grading and feedback

Manjinder Kainth
3 links
ASCILITE Publications
Artificial Intelligence in Education
article

Classification AI vs Generative AI in grading and feedback

Manjinder Kainth
article en

Abstract

Marking is among the most time-consuming activities in education, and artificial intelligence (AI) is widely proposed as a remedy. Attention has centred on generative large language models, yet regulators raise concerns about their bias, consistency, and explainability. This paper contrasts generative grading with per-question classification models trained only on an educator’s own marking and deployed in a human-in-the-loop workflow. The architectures are compared against criteria drawn from regulatory guidance: transparency, construct-relevant features, determinism, and specifiable training data. A narrower role for generative models is also identified, in composing and restructuring marker-approved feedback rather than in marking. Deployment analytics from one platform are then reported, covering approximately 166,000 marked questions, 39,500 essays, and six institutions: 66.2% of questions were marked in under one minute, 77.6% to 89.5% of AI suggestions were accepted, and essay models reached a quadratic weighted kappa of 0.93 for high-confidence predictions. Questionnaire responses from earlier pilots (33 markers, 30 students) are also reported: markers described marking as faster and consistent feedback as easier to provide; most students rated feedback more consistent and higher in quality. Implications for institutions selecting or building such tools are discussed, alongside the limitations of vendor-collected data.

ASCILITE Publications
Quality education
Artificial Intelligence in Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon