Conceptualization and frequency of sampling (mal)practices in L2 inferential quantitative research

Abstract Poor sampling practices can constitute a questionable research practice when conducting L2 inferential quantitative research. The current study, a methodological synthesis ( N = 433 Scopus/Web of Science (WoS) reports: cluster random sampling) of sampling practices, revealed that L2 inferential quantitative researchers rarely employed randomized and/or effect size-driven sampling processes with only eight (1.8%) and ten (2.3%) of the reports being respectively satisfactory. Furthermore, just 33.9% of the reports featured multisite (convenience) samples. In models assessing what predicted multisite sampling, whether the report was ISLA-focused ( r s = −.33, p < .001) or single-authored ( r s = −.15, p < .001) incurred moderate and weak negative associations. Citation analysis metric values and the Scopus/WoS contrast had no associations. The findings of this study suggest the field’s sampling practices have room to improve and guidance for future improvement is offered.

Authors

Institutions

Publication Details

Journal
Journal of Second Language Studies
Published
2025-08-18
DOI
https://doi.org/10.1075/jsls.00049.vit
Citations
2
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
4.96
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Conceptualization and frequency of sampling (mal)practices in L2 inferential quantitative research

Ali H. Al‐Hoorie, Christopher Nicklin, Ashton Hahn, Daniel R. Isbell et al.
2 citations
Journal of Second Language Studies
Natural Language Processing Techniques
4.96
article

Conceptualization and frequency of sampling (mal)practices in L2 inferential quantitative research

Ali H. Al‐Hoorie, Christopher Nicklin, Ashton Hahn, Daniel R. Isbell, Joseph P. Vitta, Derek Canning
article en
2 citations

Abstract

Abstract Poor sampling practices can constitute a questionable research practice when conducting L2 inferential quantitative research. The current study, a methodological synthesis ( N = 433 Scopus/Web of Science (WoS) reports: cluster random sampling) of sampling practices, revealed that L2 inferential quantitative researchers rarely employed randomized and/or effect size-driven sampling processes with only eight (1.8%) and ten (2.3%) of the reports being respectively satisfactory. Furthermore, just 33.9% of the reports featured multisite (convenience) samples. In models assessing what predicted multisite sampling, whether the report was ISLA-focused ( r s = −.33, p < .001) or single-authored ( r s = −.15, p < .001) incurred moderate and weak negative associations. Citation analysis metric values and the Scopus/WoS contrast had no associations. The findings of this study suggest the field’s sampling practices have room to improve and guidance for future improvement is offered.

Journal of Second Language StudiesVol. 8(2)
University of Hawaiʻi at Mānoa (US), Uppsala University (SE), Kyushu University (JP), Waseda University (JP), Seigakuin University (JP), Northern Arizona University (US), University of South Florida (US), Royal Commission for Jubail and Yanbu (SA), The University of Tokyo (JP), Indiana State University (US)
Openalex Percentile: Top 5%
Natural Language Processing Techniques
4.96
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Conceptualization and frequency of sampling (mal)practices in L2 inferential quantitative research — Ali H. Al‐Hoorie, Christopher Nicklin, et al. · Journal of Second Language Studies (2025) | TGRS Research Map | TGRS