A Pilot Study Exploring the Application and Effects of AI Courseware in University Classes

This study is a pilot study that applied AI courseware to university classes and explored its effects. For this purpose, the study targeted students from two sections of the course ‘The World of Mathematics and Statistics’ offered in the first semester of 2025 at W University located in the Jeonbuk region. One class used AI courseware for the lessons, while the other class was conducted using the traditional teaching method. The AI courseware demonstration participation class evaluated the effects of applying AI courseware by using midterm scores as a pre-test and final scores as a post-test in the ‘World of Mathematics and Statistics’ subject class. The analysis method was carried out in three stages: the pre-test for equivalence, the independent samples t-test, and the analysis of covariance. As a result, there was a difference in final grades between the AI courseware class model group and the traditional class model group, and the class using AI courseware showed higher final grade averages than the traditional face-to-face class. However, the analysis of covariance showed that mid-term achievement predicted final achievement, but the effect of using AI courseware did not reach a statistically significant level. This can be presented as evidence that the use of AI platforms in higher education can contribute to learning outcomes, but it also indicates the need to explore measures in depth for them to be utilized as effective teaching and learning tools for more meaningful achievement improvement.