ChatGPT in Programming Education: An Empirical Study on Its Impact on Student Performance, Creativity, and Teamwork

This study employs a two-part research design to explore the impact of ChatGPT on programming education for engineering undergraduates. Study 1 involved 56 third-year students who completed a questionnaire examining the frequency and purposes of ChatGPT use in text-based programming. While no statistically significant association was found between ChatGPT usage frequency and final grades, high-achieving students tended to use the tool less frequently, whereas lower-performing students relied on it more for support. Study 2 employed a counterbalanced repeated-measures design with nine first-year students divided into two groups, who developed desktop applications with and without ChatGPT. Project assessments and focus-group interviews were used to examine the effects of ChatGPT on creativity, confidence, effectiveness, and teamwork in visual programming. The results indicate that ChatGPT use was associated with reduced task completion time and increased coding efficiency; however, it was also linked to decreased creativity, greater reliance on ready-made solutions, and diminished code readability and collaborative engagement. These results highlight the need for teaching strategies that balance AI integration in programming education. The study recommends incorporating tasks based on the Reverse Bloom’s Taxonomy and activities that allow students to work with and without ChatGPT to encourage critical reflection and responsible AI use.