Revisiting the intensity and perceived quality of L2 engagement scale in a different context: An approximate replication of Teravainen-Goff ()

Abstract This study conducted an approximate replication of Teravainen-Goff (2023) to validate the Intensity and Perceived Quality of Engagement Scale for university students in the Japanese EFL context. Teravainen-Goff (2023) developed this scale based on an action-oriented definition of engagement and proposed a novel approach to measuring engagement among secondary school language learners in the UK. The study identified an 18-item, five-factor structure from a pool of 36 items through exploratory factor analysis (EFA). In this replication, we examined the validity and reliability of Teravainen-Goff’s scale in a different context, focusing on the replicability of the EFA results. We undertook this replication because engagement is context-dependent and EFA results can vary across samples. We compared the factorial structure with that of the initial study while modifying the target language and participant demographic. Results revealed a 22-item, six-factor structure with good fit. Although the same underlying factors emerged, several notable differences were observed. This approximate replication provided stronger evidence for the psychometric properties of the scale in a new context. Transparent documentation of modifications to the initial study and systematic comparison offered a promising approach to building robust evidence for engagement research and improving the rigour of questionnaire-based research overall.