‘Measuring’ methodological artefacts – thinking critically about surveys via knowledge of ‘biobanding’

Surveys can efficiently generate big datasets, but they can misrepresent participants' understandings. Our article discusses the potential for surveys to produce 'methodological artifacts' when measuring complex phenomena, via a project exploring parents' understandings of biobanding in youth sport. Although 99.5% of survey respondents (<i>n</i> = 389) indicated that they understood biobanding, follow-up interviews with 11 participants revealed this to be spurious data. This contrast between survey and interview responses highlights the limitations of surveys in capturing nuanced understandings. We argue that this misalignment between the object of study and the chosen method results in findings are 'methodological artifacts' rather than reasonable representations of social life. As such, the study demonstrates how seemingly simple survey questions about biobanding were actually attempting to tap into the complex processes of human knowledge production. Around this finding, we build an accessible and practical discussion of research philosophy that leads us to caution against developing knowledge claims based on 'wonky' epistemological foundations. And we encourage colleagues to carefully consider how their chosen methods might usually frame but also misrepresent, or unduly distort phenomena under investigation. We conclude by calling for deeper reflection on methodological choices, particularly when research is guided by the constraints of academic structures rather than scientific principles.