Measuring Autonomous and Efficacious GenAI Use and GenAI Reliance in EFL Learning: Initial Scale Development and Validation

This study developed and examined initial validity evidence for a scale assessing autonomous and reliant use of generative artificial intelligence (GenAI) in English as a foreign language (EFL) learning. Participants were 416 students enrolled in required English courses at one Japanese university. The sample was randomly divided into an exploratory sample (n = 205) and an independent confirmatory sample (n = 211). Exploratory factor analysis of 10 initial items supported two factors: Autonomous and Efficacious GenAI Use (six items) and GenAI Reliance (three items). One of the ten items (REL4), which concerned worry about reliance, did not load meaningfully on either factor and was treated as an exploratory single item. The initial confirmatory factor analysis showed mixed fit. A post hoc model allowing a residual covariance between two autonomy items (AU1 and AU2) showed improved fit (robust CFI = .959, robust TLI = .940, robust RMSEA = .073, and SRMR = .060). Internal-consistency coefficients were .86 for Autonomous and Efficacious GenAI Use and .70 for GenAI Reliance, and the latent factor correlation was small and nonsignificant (r = .11, 95% CI [−.07, .30]). The heterotrait-monotrait ratio was .175, 95% CI [.132, .343]. These findings provide preliminary evidence that Autonomous and Efficacious GenAI Use and GenAI Reliance may represent distinct dimensions. Further validation with new, more diverse samples and external criteria is required.