Diversity in Study Participants and a Critique of the “Representative Sample” in Human-Computer Interaction Research

We reflect on our experiences in improving the diversity of participants in our research, focusing on geographic diversity and countering WEIRDness. Our reflections are grounded in four studies conducted over two years, with more than 100 total participant engagements across more than 100 hours of user studies. Our samples included participants from the UK and the USA, but also from the Republic of Ireland, the Netherlands, Kenya, Nigeria, Ghana, Armenia, Israel, and Japan. We reflect on some of the challenges we encountered and what we have learnt about the benefits of geographic diversity. Finally, we discuss the scientific ideal of “representativeness” and consider whether it is possible, or appropriate, in small sample studies ($\mathbf{n} \sim 20$). We propose that representativeness is antagonised by the ideal of diversity. We seek alternative ways of understanding and articulating the epistemic value of diversity in Human-Computer Interaction (HCI) research.

Authors

Institutions

Publication Details

Published
2024-09-02
DOI
https://doi.org/10.1109/vl/hcc60511.2024.00062
Citations
2
Primary Topic
Focus Groups and Qualitative Methods
Type
article
Field-Weighted Citation Impact
2.26
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Diversity in Study Participants and a Critique of the “Representative Sample” in Human-Computer Interaction Research

Advait Sarkar
2 citations
Focus Groups and Qualitative Methods
2.26
article

Diversity in Study Participants and a Critique of the “Representative Sample” in Human-Computer Interaction Research

Advait Sarkar
article en
2 citations

Abstract

We reflect on our experiences in improving the diversity of participants in our research, focusing on geographic diversity and countering WEIRDness. Our reflections are grounded in four studies conducted over two years, with more than 100 total participant engagements across more than 100 hours of user studies. Our samples included participants from the UK and the USA, but also from the Republic of Ireland, the Netherlands, Kenya, Nigeria, Ghana, Armenia, Israel, and Japan. We reflect on some of the challenges we encountered and what we have learnt about the benefits of geographic diversity. Finally, we discuss the scientific ideal of “representativeness” and consider whether it is possible, or appropriate, in small sample studies ($\mathbf{n} \sim 20$). We propose that representativeness is antagonised by the ideal of diversity. We seek alternative ways of understanding and articulating the epistemic value of diversity in Human-Computer Interaction (HCI) research.

Vol. 1
University of Cambridge (GB), Microsoft Research (United Kingdom) (GB), University College London (GB)
Openalex Percentile: Top 10%
Focus Groups and Qualitative Methods
2.26
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.