In Search of the Prompt that Produces useful Written Corrective Feedback for L2 Composition Classes

The use of artificial intelligence (AI) in language education may be in its infancy, but technological advances, especially natural language processing, will lead to its widespread adoption far sooner than many may think. For example, large language models (LLMs) like ChatGPT are often used when individuals utilize AI systems. This means that researchers in second language learning must begin evaluating the utility of AI-based tools for second language instruction. This study describes the importance of prompt engineering in designing effective prompts for second-language writing feedback. This action research (AR) study revealed that prompts could constrain the usefulness of AI-generated feedback and suggests that, like LLMs, users are few-shot learners. Adapting the prompts and understanding the limitations and constraints that these prompts produce will allow instructors to design prompts to make ChatGPT and other AI-based applications more helpful to learners in second-language composition classes.

Authors

Publication Details

Journal
International Journal of Education (IJE)
Published
2024-12-28
DOI
https://doi.org/10.5121/ije2024.12402
Primary Topic
Educational Research and Pedagogy
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

In Search of the Prompt that Produces useful Written Corrective Feedback for L2 Composition Classes

James R. Brawn
International Journal of Education (IJE)
Educational Research and Pedagogy
article

In Search of the Prompt that Produces useful Written Corrective Feedback for L2 Composition Classes

James R. Brawn
article en

Abstract

The use of artificial intelligence (AI) in language education may be in its infancy, but technological advances, especially natural language processing, will lead to its widespread adoption far sooner than many may think. For example, large language models (LLMs) like ChatGPT are often used when individuals utilize AI systems. This means that researchers in second language learning must begin evaluating the utility of AI-based tools for second language instruction. This study describes the importance of prompt engineering in designing effective prompts for second-language writing feedback. This action research (AR) study revealed that prompts could constrain the usefulness of AI-generated feedback and suggests that, like LLMs, users are few-shot learners. Adapting the prompts and understanding the limitations and constraints that these prompts produce will allow instructors to design prompts to make ChatGPT and other AI-based applications more helpful to learners in second-language composition classes.

International Journal of Education (IJE)Vol. 12(4)
Openalex Percentile: Top 70%
Educational Research and Pedagogy
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.