Agile product-focused scaffolding with teacher-orchestrated LLM use in postgraduate academic writing: a quasi-experimental mixed-methods study

Purpose This study examined whether Agile Product-Focused Scaffolding (APFS) with teacher-orchestrated large language model (LLM) use could support postgraduate academic writing, particularly method-related reasoning and transparent reporting, in a short research-writing course.Methodology A quasi-experimental mixed-methods design was implemented in a 9-week postgraduate academic writing course involving 89 Chinese postgraduates in two intact classes. The comparison group (n = 42) received lecture-centric instruction, whereas the APFS group (n = 47) received APFS combining staged sub-products, short-cycle checkpoints, rapid teacher feedback, and bounded LLM use. Data included pre- and post-test measures of knowledge, skills, and attitudes (KSA), analytic-rubric ratings of authentic group papers, and reflective diaries from the APFS group. Quantitative and qualitative findings were interpreted together to identify both overall and scaffold-targeted effects.Findings No significant between-group differences were found in post-test KSA or overall paper quality. However, the APFS group performed significantly better in Method Fit and Transparency, the rubric dimension most directly targeted by the intervention. Reflective diaries indicated that teacher scaffolding anchored research direction, clarified methodological choices, and externalised reasoning, while bounded LLM use supported outline refinement, instrument development, methodological clarification, and data-related tasks. The pattern therefore suggests a specific rather than broad instructional effect.Originality/value The study contributes a practical model for integrating LLMs into postgraduate academic writing through visible, checkpointed, teacher-orchestrated workflows. It highlights the importance of aligning AI use with clearly defined pedagogical purposes and shows how such orchestration may strengthen method-related reasoning and transparent reporting.

Authors

Institutions

Publication Details

Journal
Innovation in Language Learning and Teaching
Published
2026-11-17
DOI
https://doi.org/10.1080/17501229.2026.2764740
Primary Topic
EFL/ESL Teaching and Learning
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Agile product-focused scaffolding with teacher-orchestrated LLM use in postgraduate academic writing: a quasi-experimental mixed-methods study

Xiaoshu Xu, Yunfeng Zhang, 李翠玲, Ying Yi et al.
2 links
Innovation in Language Learning and Teaching
EFL/ESL Teaching and Learning
article

Agile product-focused scaffolding with teacher-orchestrated LLM use in postgraduate academic writing: a quasi-experimental mixed-methods study

Xiaoshu Xu, Yunfeng Zhang, 李翠玲, Ying Yi, Zhen Li
article en

Abstract

Purpose This study examined whether Agile Product-Focused Scaffolding (APFS) with teacher-orchestrated large language model (LLM) use could support postgraduate academic writing, particularly method-related reasoning and transparent reporting, in a short research-writing course.Methodology A quasi-experimental mixed-methods design was implemented in a 9-week postgraduate academic writing course involving 89 Chinese postgraduates in two intact classes. The comparison group (n = 42) received lecture-centric instruction, whereas the APFS group (n = 47) received APFS combining staged sub-products, short-cycle checkpoints, rapid teacher feedback, and bounded LLM use. Data included pre- and post-test measures of knowledge, skills, and attitudes (KSA), analytic-rubric ratings of authentic group papers, and reflective diaries from the APFS group. Quantitative and qualitative findings were interpreted together to identify both overall and scaffold-targeted effects.Findings No significant between-group differences were found in post-test KSA or overall paper quality. However, the APFS group performed significantly better in Method Fit and Transparency, the rubric dimension most directly targeted by the intervention. Reflective diaries indicated that teacher scaffolding anchored research direction, clarified methodological choices, and externalised reasoning, while bounded LLM use supported outline refinement, instrument development, methodological clarification, and data-related tasks. The pattern therefore suggests a specific rather than broad instructional effect.Originality/value The study contributes a practical model for integrating LLMs into postgraduate academic writing through visible, checkpointed, teacher-orchestrated workflows. It highlights the importance of aligning AI use with clearly defined pedagogical purposes and shows how such orchestration may strengthen method-related reasoning and transparent reporting.

Innovation in Language Learning and Teaching
Wenzhou University (CN), Wenzhou Medical University (CN), Macao Polytechnic University (MO), City University of Macau (MO)
National Office for Philosophy and Social Sciences, National Social Science Fund of China
Quality education
EFL/ESL Teaching and Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon