Writing with a Reader in Mind

Recent research has highlighted the potential of large language models (LLMs) such as ChatGPT to support the development of ESP writing skills. However, concerns have also emerged about learners delegating writing tasks to these tools, potentially undermining learners’ motivation and autonomy. LLMs’ capacity to generate human-like text challenges the ability to ensure the authenticity of EFL students’ writing. Some studies have investigated LLM-generated text characteristics, comparing them with student writing. However, research on LLMs in EFL education remains limited. This paper seeks to address this gap and advance critical understanding of LLM-generated text. It reports on a small-scale study comparing three corpora: genuine undergraduate EFL student essays, suspected LLM-generated essays, and texts produced by ChatGPT 4.0 and DeepSeek-V3. The study examined patterns of interactive and interactional metadiscourse in the essays. Combining quantitative analysis with qualitative interpretation, it was found that although interactive features have limited explanatory power in distinguishing between LLM-generated text and genuine student essays, LLMs place strong emphasis on explicit cohesion, coherence and logical organization, favoring an objective and factual style. Most importantly, while they approximate human stance-taking, LLMs show very limited capacity to model audience and engage readers. This pattern was mirrored in the essays suspected to be LLM-generated. In contrast, genuine student writing was found to display a more personal tone and substantially greater reader engagement, regardless of target language proficiency.

Authors

Institutions

Publication Details

Journal
SHILAP Revista de lepidopterología
Published
2025-07-12
DOI
https://doi.org/10.13136/2281-4582/2025.i26.1705
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Writing with a Reader in Mind

Marco Bagni
SHILAP Revista de lepidopterología
Artificial Intelligence in Healthcare and Education
article

Writing with a Reader in Mind

Marco Bagni
article en

Abstract

Recent research has highlighted the potential of large language models (LLMs) such as ChatGPT to support the development of ESP writing skills. However, concerns have also emerged about learners delegating writing tasks to these tools, potentially undermining learners’ motivation and autonomy. LLMs’ capacity to generate human-like text challenges the ability to ensure the authenticity of EFL students’ writing. Some studies have investigated LLM-generated text characteristics, comparing them with student writing. However, research on LLMs in EFL education remains limited. This paper seeks to address this gap and advance critical understanding of LLM-generated text. It reports on a small-scale study comparing three corpora: genuine undergraduate EFL student essays, suspected LLM-generated essays, and texts produced by ChatGPT 4.0 and DeepSeek-V3. The study examined patterns of interactive and interactional metadiscourse in the essays. Combining quantitative analysis with qualitative interpretation, it was found that although interactive features have limited explanatory power in distinguishing between LLM-generated text and genuine student essays, LLMs place strong emphasis on explicit cohesion, coherence and logical organization, favoring an objective and factual style. Most importantly, while they approximate human stance-taking, LLMs show very limited capacity to model audience and engage readers. This pattern was mirrored in the essays suspected to be LLM-generated. In contrast, genuine student writing was found to display a more personal tone and substantially greater reader engagement, regardless of target language proficiency.

SHILAP Revista de lepidopterología
University of Modena and Reggio Emilia (IT)
Quality Education
Openalex Percentile: Top 41%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.