Proficiency Without Interaction: Comparing Stance and Engagement in LLM‐Generated and Human CEFR Writing

ABSTRACT This study compared the linguistic resources writers use to express attitudes, signal certainty, and interact with readers, that is, stance and engagement patterns. We examined these patterns in large language model (LLM)‐generated essays and human learner essays across Common European Framework of Reference for Languages (CEFR) levels A2 through C1. We analyzed 592 human essays alongside 4724 LLM responses to identical writing tasks produced by six models. Task‐controlled mixed‐effects models revealed systematic divergences that exceed what raw frequencies suggest, indicating that structural proficiency can mask functional misalignments. At A2, LLMs overused attitude markers (71% higher than humans) while underusing engagement markers (22% lower). At upper levels, gaps widened further: self‐mention collapsed to 41% of human rates at B2 and 27% at C1, engagement markers fell to 27% at both B2 and C1, and hedges and boosters dropped to approximately 61% of human rates at C1. These patterns held across all six models, indicating that CEFR‐conditioned generation produces a functional profile that is consistent across models but mismatched to human writing: it associates lower proficiency with evaluative excess and higher proficiency with suppressed interactional marking. When LLM texts serve as models or feedback sources in language teaching, practitioners can expect stance and engagement profiles to diverge from human learner writing in level‐dependent ways.

Authors

Institutions

Publication Details

Journal
International Journal of Applied Linguistics
Published
2026-08-24
DOI
https://doi.org/10.1111/ijal.70353
Primary Topic
Second Language Acquisition and Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Proficiency Without Interaction: Comparing Stance and Engagement in LLM‐Generated and Human CEFR Writing

Michele Del Carlo, Osamu Takeuchi
International Journal of Applied Linguistics
Second Language Acquisition and Learning
article

Proficiency Without Interaction: Comparing Stance and Engagement in LLM‐Generated and Human CEFR Writing

Michele Del Carlo, Osamu Takeuchi
article en

Abstract

ABSTRACT This study compared the linguistic resources writers use to express attitudes, signal certainty, and interact with readers, that is, stance and engagement patterns. We examined these patterns in large language model (LLM)‐generated essays and human learner essays across Common European Framework of Reference for Languages (CEFR) levels A2 through C1. We analyzed 592 human essays alongside 4724 LLM responses to identical writing tasks produced by six models. Task‐controlled mixed‐effects models revealed systematic divergences that exceed what raw frequencies suggest, indicating that structural proficiency can mask functional misalignments. At A2, LLMs overused attitude markers (71% higher than humans) while underusing engagement markers (22% lower). At upper levels, gaps widened further: self‐mention collapsed to 41% of human rates at B2 and 27% at C1, engagement markers fell to 27% at both B2 and C1, and hedges and boosters dropped to approximately 61% of human rates at C1. These patterns held across all six models, indicating that CEFR‐conditioned generation produces a functional profile that is consistent across models but mismatched to human writing: it associates lower proficiency with evaluative excess and higher proficiency with suppressed interactional marking. When LLM texts serve as models or feedback sources in language teaching, practitioners can expect stance and engagement profiles to diverge from human learner writing in level‐dependent ways.

International Journal of Applied Linguistics
Kansai University (JP)
Quality Education
Openalex Percentile: Top 4%
Second Language Acquisition and Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Proficiency Without Interaction: Comparing Stance and Engagement in LLM‐Generated and Human CEFR Writing — Michele Del Carlo, Osamu Takeuchi · International Journal of Applied Linguistics (2026) | TGRS Research Map | TGRS