Exploring the use of artificial intelligence (AI) in the delivery of effective feedback
Providing effective feedback in large settings presents significant challenges due to time and resource constraints. Given the importance of \nfeedback in competency-based higher education, innovative solutions are \nessential. This study explores the integration of artificial intelligence (AI) \nto enhance feedback delivery. The research focuses on the development \nof a custom prompt for GPT-4 within a no-code web application, designed \nto deliver AI-generated feedback to second-year accounting students on \ndiscussion or essay-style questions in a large competency-based intermediate accounting course in South Africa. The prompt aligns with the principles of effective feedback and was tested in a pilot evaluation. Results \nindicated that the AI-generated feedback generally adhered to these \nprinciples, though some variability was observed across the different \nfeedback dimensions. While challenges remain in consistently guiding AI \nto apply pedagogical best practices, the findings suggest that large language models can complement traditional feedback. Rigorous oversight \nof AI-generated feedback remains critical.
Authors
- Julia Venter
- Stephen A. Coetzee (ORCID: https://orcid.org/0000-0003-3092-0257)
- Astrid Schmulian (ORCID: https://orcid.org/0000-0003-4946-3076)
Institutions
- University of Pretoria (ZA)
Publication Details
- Journal
- Assessment & Evaluation in Higher Education
- Published
- 2024-10-20
- DOI
- https://doi.org/10.1080/02602938.2024.2415649
- Citations
- 48
- Primary Topic
- Student Assessment and Feedback
- Type
- article
- Field-Weighted Citation Impact
- 100.60