How Generative AI Is Reshaping Student Writing: A Data-Driven Perspective for Writing Instructors

Generative AI has rapidly entered college writing classrooms, raising practical questions about how student texts are changing and what that means for instruction. This study analyzes 255 final-draft analytical essays written in first-year writing classes across three instructional contexts—pre-Gen-AI (Winter/Spring 2022), AI-prohibited, and AI-permitted with specified uses (Winter/Spring 2024). We combined holistic quality ratings of essays with Coh-Metrix indices of writing volume, lexicality, referential cohesion, and syntax. Analytically, we estimated a regression of essay quality on class type and demographics, and MANCOVAs (with essay score and demographics as covariates) for the four linguistic constructs. Essay quality did not differ by AI policy. However, compared to 2022, essays of AI-permitted classes were organized into fewer but shorter paragraphs; displayed greater lexical diversity and used less frequent, less familiar vocabulary; showed lower local and global anaphor overlap (other cohesion indices were stable); and exhibited lower verb-phrase, passive, and negation densities but higher gerund density. We interpret these as selective redistributions of linguistic resources rather than uniform gains or losses. For instructors, the actionable implication is two-fold: leverage AI-era gains in lexical precision while explicitly teaching referential continuity and clause-level strategies that sustain argumentative coherence.

Authors

Institutions

Publication Details

Journal
Education Sciences
Published
2025-12-19
DOI
https://doi.org/10.3390/educsci16010001
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

How Generative AI Is Reshaping Student Writing: A Data-Driven Perspective for Writing Instructors

Bradley Queen, Penelope Collins, Maryam Eslami
Education Sciences
Artificial Intelligence in Healthcare and Education
article

How Generative AI Is Reshaping Student Writing: A Data-Driven Perspective for Writing Instructors

Bradley Queen, Penelope Collins, Maryam Eslami
article en

Abstract

Generative AI has rapidly entered college writing classrooms, raising practical questions about how student texts are changing and what that means for instruction. This study analyzes 255 final-draft analytical essays written in first-year writing classes across three instructional contexts—pre-Gen-AI (Winter/Spring 2022), AI-prohibited, and AI-permitted with specified uses (Winter/Spring 2024). We combined holistic quality ratings of essays with Coh-Metrix indices of writing volume, lexicality, referential cohesion, and syntax. Analytically, we estimated a regression of essay quality on class type and demographics, and MANCOVAs (with essay score and demographics as covariates) for the four linguistic constructs. Essay quality did not differ by AI policy. However, compared to 2022, essays of AI-permitted classes were organized into fewer but shorter paragraphs; displayed greater lexical diversity and used less frequent, less familiar vocabulary; showed lower local and global anaphor overlap (other cohesion indices were stable); and exhibited lower verb-phrase, passive, and negation densities but higher gerund density. We interpret these as selective redistributions of linguistic resources rather than uniform gains or losses. For instructors, the actionable implication is two-fold: leverage AI-era gains in lexical precision while explicitly teaching referential continuity and clause-level strategies that sustain argumentative coherence.

Education SciencesVol. 16(1)
University of California, Irvine (US)
Quality Education
Openalex Percentile: Top 40%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.