The Effectiveness of the 'REPLIKA' Application Compared to Visual Media in Reading Learning

This study investigates the effectiveness of the REPLIKA application, an AI-powered chatbot, in enhancing second language (L2) reading learning compared to traditional visual media. The integration of artificial intelligence in language learning offers personalized, interactive engagement, yet empirical studies comparing its impact against conventional instructional tools remain limited. This quasi-experimental research employed a nonequivalent control group pre-test and post-test design involving 38 fourth-semester English Education students at Yogyakarta State University. Participants were divided into an experimental group (REPLIKA) and a control group (visual media). Reading learning was assessed using the Critical Reading Skills Test (CRST), validated and tested for reliability through a pilot study with third-year students. Data analysis was conducted using SPSS, including descriptive statistics, normality and homogeneity tests, and independent samples t-tests. The findings revealed a significant difference between the two groups, with the experimental group showing greater improvement. The REPLIKA group’s mean score increased by 21.95 points, compared to 8.52 points in the visual media group. These results suggest that the REPLIKA application is more effective in supporting students' L2 reading skill, likely due to its adaptive features, immediate feedback, and interactive learning experience. The study highlights the potential of AI-based applications in addressing individual learning needs and enhancing reading outcomes in higher education contexts.