Use of ChatGPT for Assessment Feedback on a Complex Programming Assessment

This innovative practice paper explores the integration of ChatGPT into the feedback process for university programming courses, addressing the growing demand for efficient and consistent grading and feedback. The research involved a cohort of postgraduate students enrolled in a compulsory Java programming module. ChatGPT was utilized to generate feedback, which was then compared with traditional feedback methods. The results demonstrated that ChatGPT could produce quick, accurate, and human-like responses, significantly reducing the workload for faculty. Feedback generation was generally well-narrated and detailed, although occasional technical errors required manual adjustments. A survey conducted with the student cohort revealed that 75% of respondents preferred ChatGPT-generated feedback over traditional methods, appreciating its detailed and constructive nature. However, some students expressed a need for more specific guidance, such as code snippets. Lecturers also noted that while the AI feedback was efficient, it sometimes lacked the empathetic tone of human-generated comments. Despite these challenges, the overall response from both students and faculty was positive, highlighting the potential of ChatGPT to enhance the feedback process in programming education.

Authors

Institutions

Publication Details

Published
2025-03-15
DOI
https://doi.org/10.1109/isec64801.2025.11147424
Primary Topic
Online Learning and Analytics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Use of ChatGPT for Assessment Feedback on a Complex Programming Assessment

Aidan McGowan, Chris Smith, Neil Anderson
Online Learning and Analytics
article

Use of ChatGPT for Assessment Feedback on a Complex Programming Assessment

Aidan McGowan, Chris Smith, Neil Anderson
article en

Abstract

This innovative practice paper explores the integration of ChatGPT into the feedback process for university programming courses, addressing the growing demand for efficient and consistent grading and feedback. The research involved a cohort of postgraduate students enrolled in a compulsory Java programming module. ChatGPT was utilized to generate feedback, which was then compared with traditional feedback methods. The results demonstrated that ChatGPT could produce quick, accurate, and human-like responses, significantly reducing the workload for faculty. Feedback generation was generally well-narrated and detailed, although occasional technical errors required manual adjustments. A survey conducted with the student cohort revealed that 75% of respondents preferred ChatGPT-generated feedback over traditional methods, appreciating its detailed and constructive nature. However, some students expressed a need for more specific guidance, such as code snippets. Lecturers also noted that while the AI feedback was efficient, it sometimes lacked the empathetic tone of human-generated comments. Despite these challenges, the overall response from both students and faculty was positive, highlighting the potential of ChatGPT to enhance the feedback process in programming education.

Queen's University Belfast (GB)
Openalex Percentile: Top 73%
Online Learning and Analytics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.