Efficacy of AI-Generated Feedback by SmallTalk2Me for Improving Speaking Skill of Saudi EFL Learners

Feedback is essential in language teaching and learning as it helps learners identify errors, reinforce correct usage, and guide their progress. Traditionally it was the job of a teacher, however, with the advent of Artificial Intelligence (AI) this task has become automated. This study evaluated the efficacy of AI-generated feedback provided by the SmallTalk2Me platform for improving speaking skill among Saudi EFL learners. Forty-four Saudi EFL learners participated in this quasi-experimental study. The data were derived from the IELTS speaking pre-test and post-test, while in between, the participants completed six practice activities over a period of three weeks (two activities each week). Two data sets were compiled: IELTS speaking band scores and proficiency (measured by words spoken per minute). The data were analyzed using paired t-tests to evaluate statistical significance. The study hypothesized that learners would achieve a higher mean score in the IELTS speaking post-test after completing language practices on SmallTalk2Me. This hypothesis was statistically supported, as the difference between the pre-test and post-test mean scores was significant (p < 0.05). The learners demonstrated a 12.12% improvement in their IELTS speaking test band scores, while an 11.18% increase was observed in their speaking proficiency between the first and the sixth practice activities. Following the intervention, a 25-item questionnaire was administered to evaluate the participants’ perception of AI-generated feedback, the efficacy of SmallTalk2Me, and the overall learning experience. Students found AI-generated feedback effective, motivating, and engaging. The study highlights the efficacy of AI-generated feedback provided by SmallTalk2Me and recommends the use of such AI platforms in the Saudi EFL scenario.