GDBERT-score: Semantic Graph-Enhanced DeBERTa for automated essay scoring in higher education

Automated essay scoring (AES) systems typically rely on either sequential text models for contextual semantics or graph-based approaches for discourse structure, but rarely integrate both effectively. We present GDBERT-Score, a hybrid architecture that combines DeBERTa’s disentangled attention with graph convolutional networks (GCN) for holistic essay scoring. Each essay is represented as a sentence-level semantic graph, where nodes are DeBERTa mean-pooled sentence embeddings and edges connect sentence pairs whose cosine similarity exceeds a learned threshold ( τ = 0 . 4 ). GCN-derived structural embeddings are concatenated with DeBERTa’s document-level contextual embedding and fused through a progressive reduction network ( 896 → 512 → 256 → 128 ) to produce a final holistic score. Evaluated on the Kaggle Automated Essay Scoring 2.0 benchmark via six-fold cross-validation, GDBERT-Score achieves QWK = 0.7777 ± 0.0017 (mean ± std across 5 random seeds), significantly outperforming both the DeBERTa-only baseline ( p < 0 . 0001 ) and the TF–IDF graph variant ( p = 0 . 0010 ). Ablation experiments reveal that node feature quality, rather than graph topology, is the primary determinant of GCN effectiveness in automated essay scoring: replacing surface-level node features with DeBERTa sentence embeddings yields significant improvements over both the DeBERTa-only baseline ( Δ QWK = +0.0294, p < 0 . 0001 ) and the graph-augmented variant ( Δ QWK = +0.0239, p = 0 . 0010 ), confirmed across five random seeds (QWK = 0.7777 ± 0.0017).

Authors

Institutions

Publication Details

Journal
Alexandria Engineering Journal
Published
2026-05-01
DOI
https://doi.org/10.1016/j.aej.2026.04.019
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

GDBERT-score: Semantic Graph-Enhanced DeBERTa for automated essay scoring in higher education

Tianjiao Yu, Tiantian Mi
Alexandria Engineering Journal
Topic Modeling
article

GDBERT-score: Semantic Graph-Enhanced DeBERTa for automated essay scoring in higher education

Tianjiao Yu, Tiantian Mi
article en

Abstract

Automated essay scoring (AES) systems typically rely on either sequential text models for contextual semantics or graph-based approaches for discourse structure, but rarely integrate both effectively. We present GDBERT-Score, a hybrid architecture that combines DeBERTa’s disentangled attention with graph convolutional networks (GCN) for holistic essay scoring. Each essay is represented as a sentence-level semantic graph, where nodes are DeBERTa mean-pooled sentence embeddings and edges connect sentence pairs whose cosine similarity exceeds a learned threshold ( τ = 0 . 4 ). GCN-derived structural embeddings are concatenated with DeBERTa’s document-level contextual embedding and fused through a progressive reduction network ( 896 → 512 → 256 → 128 ) to produce a final holistic score. Evaluated on the Kaggle Automated Essay Scoring 2.0 benchmark via six-fold cross-validation, GDBERT-Score achieves QWK = 0.7777 ± 0.0017 (mean ± std across 5 random seeds), significantly outperforming both the DeBERTa-only baseline ( p < 0 . 0001 ) and the TF–IDF graph variant ( p = 0 . 0010 ). Ablation experiments reveal that node feature quality, rather than graph topology, is the primary determinant of GCN effectiveness in automated essay scoring: replacing surface-level node features with DeBERTa sentence embeddings yields significant improvements over both the DeBERTa-only baseline ( Δ QWK = +0.0294, p < 0 . 0001 ) and the graph-augmented variant ( Δ QWK = +0.0239, p = 0 . 0010 ), confirmed across five random seeds (QWK = 0.7777 ± 0.0017).

Alexandria Engineering JournalVol. 145
Qingdao University (CN), Qingdao Agricultural University (CN), Shandong Women’s University (CN)
Quality Education
Openalex Percentile: Top 6%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

GDBERT-score: Semantic Graph-Enhanced DeBERTa for automated essay scoring in higher education — Tianjiao Yu, Tiantian Mi · Alexandria Engineering Journal (2026) | TGRS Research Map | TGRS