AI-Based Writing Assessment in Second Language Context: A Bibliometric Analysis of Trends in Coherence and Cohesion

The use of AI-based writing assessment in language education is growing rapidly, offering both opportunities and challenges in evaluating second language writing (L2). While these tools are increasingly common, most still focus on surface-level accuracy, such as grammar and spelling, and often overlook discourse-level elements like coherence and cohesion. These features are essential for L2 learners to produce texts with logical flow and organization. This study investigates research trends in AI-driven assessment of L2 writing from 2020 to 2025 through a bibliometric analysis of 332 articles retrieved from databases such as Scopus, JSTOR, ScienceDirect, and Emerald Insight. The analysis followed five key steps: setting objectives, selecting and cleaning data, performance analysis, keyword co-occurrence mapping, and interpretation. VOSviewer software was used to visualize thematic patterns and identify research gaps. Findings show a significant increase in AI-related research within language learning, yet coherence and cohesion remain underrepresented. Most studies emphasize technological aspects, such as system efficiency, tool development (e.g., ChatGPT), and AI innovation, rather than deeper writing features. The keyword analysis confirms this imbalance, highlighting a disconnect between research focus and educational priorities. This study calls for closer collaboration among educators, linguists, and AI developers to ensure assessment tools align with writing pedagogy. By mapping existing research trends and revealing neglected areas, this study contributes to improving AI-based writing assessment tools to better support meaning-making, structure, and clarity in second language writing.

Authors

Publication Details

Journal
Applied Research on English Education (AREE)
Published
2025-07-19
DOI
https://doi.org/10.26714/aree.3.2.2025.86-94
Primary Topic
Foreign Language Teaching Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI-Based Writing Assessment in Second Language Context: A Bibliometric Analysis of Trends in Coherence and Cohesion

Viqi Ardaniah, Sitti Kamila Meutia Sani
Applied Research on English Education (AREE)
Foreign Language Teaching Methods
article

AI-Based Writing Assessment in Second Language Context: A Bibliometric Analysis of Trends in Coherence and Cohesion

Viqi Ardaniah, Sitti Kamila Meutia Sani
article en

Abstract

The use of AI-based writing assessment in language education is growing rapidly, offering both opportunities and challenges in evaluating second language writing (L2). While these tools are increasingly common, most still focus on surface-level accuracy, such as grammar and spelling, and often overlook discourse-level elements like coherence and cohesion. These features are essential for L2 learners to produce texts with logical flow and organization. This study investigates research trends in AI-driven assessment of L2 writing from 2020 to 2025 through a bibliometric analysis of 332 articles retrieved from databases such as Scopus, JSTOR, ScienceDirect, and Emerald Insight. The analysis followed five key steps: setting objectives, selecting and cleaning data, performance analysis, keyword co-occurrence mapping, and interpretation. VOSviewer software was used to visualize thematic patterns and identify research gaps. Findings show a significant increase in AI-related research within language learning, yet coherence and cohesion remain underrepresented. Most studies emphasize technological aspects, such as system efficiency, tool development (e.g., ChatGPT), and AI innovation, rather than deeper writing features. The keyword analysis confirms this imbalance, highlighting a disconnect between research focus and educational priorities. This study calls for closer collaboration among educators, linguists, and AI developers to ensure assessment tools align with writing pedagogy. By mapping existing research trends and revealing neglected areas, this study contributes to improving AI-based writing assessment tools to better support meaning-making, structure, and clarity in second language writing.

Applied Research on English Education (AREE)Vol. 3(2)
Openalex Percentile: Top 81%
Foreign Language Teaching Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.