Lay perspectives on mobile-assisted language learning research: An exploratory survey study

Commercial mobile language learning apps have great potential to improve app users’ proficiency while also offering flexible self-directed learning platforms to foreign language learners worldwide. Previous studies have provided empirical evidence regarding the effectiveness of these commercial apps; however, it remains unclear whether the reported effectiveness aligns with laypeople’s desired level of effectiveness and whether this evidence is based on experimental designs that laypeople perceive as appropriate. Addressing these gaps will allow researchers to critically reflect their research practices and thereby enhance their accountability. To this end, the present study recruited 194 respondents via Prolific and examined their desired effectiveness of language learning apps as well as their perceived appropriateness of experimental designs to evaluate the effectiveness of language learning apps. The results suggested that laypeople expressed interest in using language learning apps that are associated with at least small to medium effect size. Additionally, they regarded the presence of a control group, sample size, and attrition rate as the three most important components of experimental designs. These findings indicate that language learning apps do not necessarily have to produce large effect size for laypeople to consider using apps, and that future efficacy studies should include a control group, secure a good sample size, and report attrition rates to maintain accountability to potential app consumers.