Transforming online grammar education: Integrating GETN V2 and RoBERTa embeddings for effective English grammar correction

The increasing demand for intelligent language learning systems, traditional grammar correction models often fail to capture the complex syntactic dependencies and contextual nuances present in learner-generated texts. These limitations hinder accurate detection and correction of grammatical errors particularly in academic writing. This paper proposes a novel grammar correction framework that integrates deep contextual embeddings from RoBERTa with syntactic graph structures using Graph Embedded Transformer Network (GETN V2). The input sentences are first pre-processed through normalization, tokenization, syntactic parsing and stop word removal using the ChatLang-8 dataset. RoBERTa is then applied to extract high-dimensional contextual embeddings for each token capturing semantic dependencies. These embeddings are fused with syntactic graphs derived from dependency parsing where grammatical relationships such as subject–verb and modifier-noun are represented as labeled edges. The GETN V2 encoder combines these inputs through multi-relational message passing and relation-aware attention mechanisms dynamically weighting syntactic dependencies using graph-augmented transformer layers. A dual-module architecture performs error detection and correction in such a way that the detection layer identifies grammatical inconsistencies via masked attention and classification blocks, while the correction module leverages the confidence estimator and correction generator to refine output. The system also incorporates a feedback loop with a confusion matrix to dynamically update error correction strategies. Experimental evaluation on benchmark datasets demonstrates that the proposed model achieves an accuracy of 88.26% with F0.5 scores exceeding 84% on syntactically grounded errors such as subject–verb agreement and verb tense. Furthermore, the model maintains low latency under high concurrency making it suitable for real-time educational deployment.

Authors

Institutions

Publication Details

Journal
Alexandria Engineering Journal
Published
2025-09-27
DOI
https://doi.org/10.1016/j.aej.2025.08.036
Primary Topic
Advanced Technologies in Various Fields
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Transforming online grammar education: Integrating GETN V2 and RoBERTa embeddings for effective English grammar correction

Yining Du
Alexandria Engineering Journal
Advanced Technologies in Various Fields
article

Transforming online grammar education: Integrating GETN V2 and RoBERTa embeddings for effective English grammar correction

Yining Du
article en

Abstract

The increasing demand for intelligent language learning systems, traditional grammar correction models often fail to capture the complex syntactic dependencies and contextual nuances present in learner-generated texts. These limitations hinder accurate detection and correction of grammatical errors particularly in academic writing. This paper proposes a novel grammar correction framework that integrates deep contextual embeddings from RoBERTa with syntactic graph structures using Graph Embedded Transformer Network (GETN V2). The input sentences are first pre-processed through normalization, tokenization, syntactic parsing and stop word removal using the ChatLang-8 dataset. RoBERTa is then applied to extract high-dimensional contextual embeddings for each token capturing semantic dependencies. These embeddings are fused with syntactic graphs derived from dependency parsing where grammatical relationships such as subject–verb and modifier-noun are represented as labeled edges. The GETN V2 encoder combines these inputs through multi-relational message passing and relation-aware attention mechanisms dynamically weighting syntactic dependencies using graph-augmented transformer layers. A dual-module architecture performs error detection and correction in such a way that the detection layer identifies grammatical inconsistencies via masked attention and classification blocks, while the correction module leverages the confidence estimator and correction generator to refine output. The system also incorporates a feedback loop with a confusion matrix to dynamically update error correction strategies. Experimental evaluation on benchmark datasets demonstrates that the proposed model achieves an accuracy of 88.26% with F0.5 scores exceeding 84% on syntactically grounded errors such as subject–verb agreement and verb tense. Furthermore, the model maintains low latency under high concurrency making it suitable for real-time educational deployment.

Alexandria Engineering JournalVol. 130
Xi'an University of Finance and Economics (CN)
Openalex Percentile: Top 86%
Advanced Technologies in Various Fields
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Transforming online grammar education: Integrating GETN V2 and RoBERTa embeddings for effective English grammar correction — Yining Du · Alexandria Engineering Journal (2025) | TGRS Research Map | TGRS