Conceptualization and frequency of sampling (mal)practices in L2 inferential quantitative research
Abstract Poor sampling practices can constitute a questionable research practice when conducting L2 inferential quantitative research. The current study, a methodological synthesis ( N = 433 Scopus/Web of Science (WoS) reports: cluster random sampling) of sampling practices, revealed that L2 inferential quantitative researchers rarely employed randomized and/or effect size-driven sampling processes with only eight (1.8%) and ten (2.3%) of the reports being respectively satisfactory. Furthermore, just 33.9% of the reports featured multisite (convenience) samples. In models assessing what predicted multisite sampling, whether the report was ISLA-focused ( r s = −.33, p < .001) or single-authored ( r s = −.15, p < .001) incurred moderate and weak negative associations. Citation analysis metric values and the Scopus/WoS contrast had no associations. The findings of this study suggest the field’s sampling practices have room to improve and guidance for future improvement is offered.
Authors
- Ali H. Al‐Hoorie (ORCID: https://orcid.org/0000-0003-3810-5978)
- Christopher Nicklin (ORCID: https://orcid.org/0000-0002-8945-0678)
- Ashton Hahn (ORCID: https://orcid.org/0000-0003-3754-3626)
- Daniel R. Isbell (ORCID: https://orcid.org/0000-0001-5850-8809)
- Joseph P. Vitta (ORCID: https://orcid.org/0000-0002-5711-969X)
- Derek Canning (ORCID: https://orcid.org/0009-0004-5868-4502)
Institutions
- University of Hawaiʻi at Mānoa (US)
- Uppsala University (SE)
- Kyushu University (JP)
- Waseda University (JP)
- Seigakuin University (JP)
- Northern Arizona University (US)
- University of South Florida (US)
- Royal Commission for Jubail and Yanbu (SA)
- The University of Tokyo (JP)
- Indiana State University (US)
Publication Details
- Journal
- Journal of Second Language Studies
- Published
- 2025-08-18
- DOI
- https://doi.org/10.1075/jsls.00049.vit
- Citations
- 2
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 4.96