Evaluating the Educational Impact of AI-Generated Test Cases in a Test-Driven Development Environment for Python Beginners

Test automation and Test-Driven Development (TDD) have emerged as key strategies for improving code quality and learning effectiveness, while artificial intelligence tools such as GPT are increasingly applied to automated test case generation. However, simply increasing the number of test cases or relying on automation tools does not guarantee sufficient fault detection performance, and empirical evidence of their educational effectiveness for novices remains limited. This study implements a TDD-based practice environment for Python beginners and compares researcher-designed cases, GPT-generated cases, GPT with strategy-guided prompts (GPT+Strategy), and student-written cases. Results show that GPT+Strategy cases achieved higher fault detection and efficiency than even the researcher-designed cases. TDD-based practice strengthened learners’ logical thinking and error recognition skills. These findings provide practical implications for programming curriculum design, AI-assisted learning tool development, and software quality assurance education.

Authors

Publication Details

Journal
Korean Institute of Smart Media
Published
2025-09-30
DOI
https://doi.org/10.30693/smj.2025.14.9.55
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluating the Educational Impact of AI-Generated Test Cases in a Test-Driven Development Environment for Python Beginners

Jiyoung Song, Seungwoo Son
Korean Institute of Smart Media
Scientific Computing and Data Management
article

Evaluating the Educational Impact of AI-Generated Test Cases in a Test-Driven Development Environment for Python Beginners

Jiyoung Song, Seungwoo Son
article en

Abstract

Test automation and Test-Driven Development (TDD) have emerged as key strategies for improving code quality and learning effectiveness, while artificial intelligence tools such as GPT are increasingly applied to automated test case generation. However, simply increasing the number of test cases or relying on automation tools does not guarantee sufficient fault detection performance, and empirical evidence of their educational effectiveness for novices remains limited. This study implements a TDD-based practice environment for Python beginners and compares researcher-designed cases, GPT-generated cases, GPT with strategy-guided prompts (GPT+Strategy), and student-written cases. Results show that GPT+Strategy cases achieved higher fault detection and efficiency than even the researcher-designed cases. TDD-based practice strengthened learners’ logical thinking and error recognition skills. These findings provide practical implications for programming curriculum design, AI-assisted learning tool development, and software quality assurance education.

Korean Institute of Smart MediaVol. 14(9)
Openalex Percentile: Top 73%
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.