Synergizing Generative Pre-Trained Transformer (GPT) Chatbots in a Process-Based Writing Paradigm to Enhance University Students’ Writing Skills

Background: The combination of the process-based writing framework and GPT-based chatbots establishes a dynamic and interactive environment, leading students through the stages of planning, drafting, revising, and editing. This collaborative approach not only elevates writing skills but also cultivates critical thinking and self-reflection, thereby transforming the writing process into a more effective and engaging learning experience. Despite the potential synergy to revolutionize the writing process, there exists a surprising lack of research within the educational domain exploring the impact of this innovative approach. Purpose: This study investigates the influence of a GPT-based chatbot within a process-based writing framework on university EFL students’ writing skills, specifically focusing on components such as organization, content, coherence-cohesion, logical connection, and argumentation. Method: Employing a sequential mixed methods type of research with a pre- and post-test design, 30 university EFL students were selected via purposive sampling technique. They engaged in 10 sessions that incorporated GPT-based chatbots within a process-based writing framework. Data collections were through pre-and post- writing tests, writing quizzes, and semi-structured interviews. Results: The results highlighted substantial improvements in participants’ writing performance, evident through a noteworthy increase in post-writing test scores (x̄=17.03) in comparison to pre-writing test scores (x̄=9.13). The study identified a progressive enhancement in four out of five writing components - organization, content, coherence-cohesion, and argumentation - across the 1st to 4th quizzes. However, the ‘logical connection’ component experienced a temporary decline during the 2nd and 3rd writing quizzes, rebounding significantly in the 4th quiz. Notably, the most improved writing components were ‘content’ and ‘argumentation,’ while the component related to ‘logical connection’ exhibited the least improved one. Qualitative findings further underscored participants’ acknowledgment of the effectiveness of the strategy in facilitating their writing tasks. Conclusion: The integration of chatbots within a writing framework was concluded as a facilitative pedagogical approach, fostering a dynamic, personalized, and effective learning experience, contributing to the multifaceted improvement of their writing skills. As educators and practitioners consider innovative approaches, this study provides a compelling case for the effective utilization of GPT-based chatbots in fostering language proficiency and a more engaging learning experience.

Authors

Institutions

Publication Details

Journal
Journal of language and Education
Published
2024-09-30
DOI
https://doi.org/10.17323/jle.2024.18708
Citations
9
Primary Topic
AI in Service Interactions
Type
article
Field-Weighted Citation Impact
3.13
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Synergizing Generative Pre-Trained Transformer (GPT) Chatbots in a Process-Based Writing Paradigm to Enhance University Students’ Writing Skills

Roderick Julian Robillos
9 citations
Journal of language and Education
AI in Service Interactions
3.13
article

Synergizing Generative Pre-Trained Transformer (GPT) Chatbots in a Process-Based Writing Paradigm to Enhance University Students’ Writing Skills

Roderick Julian Robillos
article en
9 citations

Abstract

Background: The combination of the process-based writing framework and GPT-based chatbots establishes a dynamic and interactive environment, leading students through the stages of planning, drafting, revising, and editing. This collaborative approach not only elevates writing skills but also cultivates critical thinking and self-reflection, thereby transforming the writing process into a more effective and engaging learning experience. Despite the potential synergy to revolutionize the writing process, there exists a surprising lack of research within the educational domain exploring the impact of this innovative approach. Purpose: This study investigates the influence of a GPT-based chatbot within a process-based writing framework on university EFL students’ writing skills, specifically focusing on components such as organization, content, coherence-cohesion, logical connection, and argumentation. Method: Employing a sequential mixed methods type of research with a pre- and post-test design, 30 university EFL students were selected via purposive sampling technique. They engaged in 10 sessions that incorporated GPT-based chatbots within a process-based writing framework. Data collections were through pre-and post- writing tests, writing quizzes, and semi-structured interviews. Results: The results highlighted substantial improvements in participants’ writing performance, evident through a noteworthy increase in post-writing test scores (x̄=17.03) in comparison to pre-writing test scores (x̄=9.13). The study identified a progressive enhancement in four out of five writing components - organization, content, coherence-cohesion, and argumentation - across the 1st to 4th quizzes. However, the ‘logical connection’ component experienced a temporary decline during the 2nd and 3rd writing quizzes, rebounding significantly in the 4th quiz. Notably, the most improved writing components were ‘content’ and ‘argumentation,’ while the component related to ‘logical connection’ exhibited the least improved one. Qualitative findings further underscored participants’ acknowledgment of the effectiveness of the strategy in facilitating their writing tasks. Conclusion: The integration of chatbots within a writing framework was concluded as a facilitative pedagogical approach, fostering a dynamic, personalized, and effective learning experience, contributing to the multifaceted improvement of their writing skills. As educators and practitioners consider innovative approaches, this study provides a compelling case for the effective utilization of GPT-based chatbots in fostering language proficiency and a more engaging learning experience.

Journal of language and EducationVol. 10(3)
Khon Kaen University (TH)
Openalex Percentile: Top 7%
AI in Service Interactions
3.13
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.