GenAI and Writing Age – Can we use it in detection of use?

This paper is the first step in answering the question can the authenticity of student work be confirmed, or challenged through assessing the writing age of submitted work. There have been numerous papers published on the subject of authenticity of student work with none offering very much hope for a robust solution. The work undertaken in this project has not been undertaken with the intention of trying to create a robust detection method but rather to explore the question of writing age which itself is a well established text analysis field. The project set out to ask the following questions: "What age does GenAI write at?" and "If a GenAI tool is prompted to write for a given age band how accurately does it achieve this?" The project used three commonly available GenAI tools and each was prompted to write a short assignment using the same prompt. The prompt was then modified to specify one of three target writing ages – University entry level (A level in the UK), Undergraduate and Postgraduate. The results suggests reading age analysis is an area worth exploring in detecting GenAI generated content in submitted assignments but may still be dependent on having a sample of authentic student writing as a comparator and a good understanding of the acceptability of AI as a proofreading and/or grammar improving tool. The study is limited in extensiveness the findings are however not promising.

Authors

Institutions

Publication Details

Published
2025-06-18
DOI
https://doi.org/10.1109/eaeeie65428.2025.11136537
Primary Topic
Digital Communication and Language
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

GenAI and Writing Age – Can we use it in detection of use?

Anthony Ward
Digital Communication and Language
article

GenAI and Writing Age – Can we use it in detection of use?

Anthony Ward
article en

Abstract

This paper is the first step in answering the question can the authenticity of student work be confirmed, or challenged through assessing the writing age of submitted work. There have been numerous papers published on the subject of authenticity of student work with none offering very much hope for a robust solution. The work undertaken in this project has not been undertaken with the intention of trying to create a robust detection method but rather to explore the question of writing age which itself is a well established text analysis field. The project set out to ask the following questions: "What age does GenAI write at?" and "If a GenAI tool is prompted to write for a given age band how accurately does it achieve this?" The project used three commonly available GenAI tools and each was prompted to write a short assignment using the same prompt. The prompt was then modified to specify one of three target writing ages – University entry level (A level in the UK), Undergraduate and Postgraduate. The results suggests reading age analysis is an area worth exploring in detecting GenAI generated content in submitted assignments but may still be dependent on having a sample of authentic student writing as a comparator and a good understanding of the acceptability of AI as a proofreading and/or grammar improving tool. The study is limited in extensiveness the findings are however not promising.

University of York (GB)
Quality Education
Openalex Percentile: Top 77%
Digital Communication and Language
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.