Performing Rigor: Reflexivity in HCI/CSCW

Reflexivity has become a routine expectation in qualitative HCI, often expressed through positionality statements or defensive methodological claims. Yet these practices risk drifting into procedural forms that foreground researcher identity or procedural compliance rather than the systematic interpretive work through which qualitative insight is produced. We examine how longstanding tensions between interpretive and measurement-oriented approaches to qualitative inquiry are negotiated in contemporary HCI. Drawing on a citation analysis of 919 ACM publications referencing Reliability and Inter-Rater Reliability in Qualitative Research (2019), along with close readings of a CHI/CSCW subsample, we analyze how IRR is invoked as a methodological reference point for articulating qualitative rigor. We identify recurring configurations in which interpretive commitments coexist with expectations around coding, agreement, and validation. We argue that these configurations reflect a recurring tension within methodological discourse in how rigor is articulated and evaluated. In response, we propose generative reflexivity —a stance that centers interpretive humility, traces how understanding was produced, and foregrounds analytic process, rather than relying on identity disclosure or pseudo-quantitative coding practices.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Computer-Human Interaction
Published
2026-07-18
DOI
https://doi.org/10.1145/3831595
Primary Topic
Innovative Human-Technology Interaction
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Performing Rigor: Reflexivity in HCI/CSCW

Nora McDonald, John S. Seberger
ACM Transactions on Computer-Human Interaction
Innovative Human-Technology Interaction
article

Performing Rigor: Reflexivity in HCI/CSCW

Nora McDonald, John S. Seberger
article en

Abstract

Reflexivity has become a routine expectation in qualitative HCI, often expressed through positionality statements or defensive methodological claims. Yet these practices risk drifting into procedural forms that foreground researcher identity or procedural compliance rather than the systematic interpretive work through which qualitative insight is produced. We examine how longstanding tensions between interpretive and measurement-oriented approaches to qualitative inquiry are negotiated in contemporary HCI. Drawing on a citation analysis of 919 ACM publications referencing Reliability and Inter-Rater Reliability in Qualitative Research (2019), along with close readings of a CHI/CSCW subsample, we analyze how IRR is invoked as a methodological reference point for articulating qualitative rigor. We identify recurring configurations in which interpretive commitments coexist with expectations around coding, agreement, and validation. We argue that these configurations reflect a recurring tension within methodological discourse in how rigor is articulated and evaluated. In response, we propose generative reflexivity —a stance that centers interpretive humility, traces how understanding was produced, and foregrounds analytic process, rather than relying on identity disclosure or pseudo-quantitative coding practices.

ACM Transactions on Computer-Human Interaction
George Mason University (US), Drexel University (US)
Peace, Justice and strong institutions
Openalex Percentile: Top 6%
Innovative Human-Technology Interaction
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.