'I'm Categorizing LLM as a Productivity Tool': Examining Ethics of LLM Use in HCI Research Practices

Large language models are increasingly applied in real-world scenarios, including research and education. These models, however, come with well-known ethical issues, which may manifest in unexpected ways in human-computer interaction research due to the extensive engagement with human subjects. This paper reports on research practices related to LLM use, drawing on 16 semi-structured interviews and a survey with 50 HCI researchers. We discuss the ways in which LLMs are already being utilized throughout the entire HCI research pipeline, from ideation to system development and paper writing. While researchers described nuanced understandings of ethical issues, they were rarely or only partially able to identify and address those ethical concerns in their own projects. This lack of action and reliance on workarounds was explained through the perceived lack of control and distributed responsibility in the LLM supply chain, the conditional nature of engaging with ethics, and competing priorities. Finally, we reflect on the implications of our findings and present opportunities to shape emerging norms of engaging with large language models in HCI research.

Authors

Institutions

Publication Details

Journal
Proceedings of the ACM on Human-Computer Interaction
Published
2025-05-02
DOI
https://doi.org/10.1145/3711000
Citations
13
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
30.75
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

'I'm Categorizing LLM as a Productivity Tool': Examining Ethics of LLM Use in HCI Research Practices

Toby Jia-Jun Li, Shivani Kapania, Ruiyi Wang, Tianshi Li et al.
13 citations
Proceedings of the ACM on Human-Computer Interaction
Ethics and Social Impacts of AI
30.75
article

'I'm Categorizing LLM as a Productivity Tool': Examining Ethics of LLM Use in HCI Research Practices

Toby Jia-Jun Li, Shivani Kapania, Ruiyi Wang, Tianshi Li, Hong Shen
article en
13 citations

Abstract

Large language models are increasingly applied in real-world scenarios, including research and education. These models, however, come with well-known ethical issues, which may manifest in unexpected ways in human-computer interaction research due to the extensive engagement with human subjects. This paper reports on research practices related to LLM use, drawing on 16 semi-structured interviews and a survey with 50 HCI researchers. We discuss the ways in which LLMs are already being utilized throughout the entire HCI research pipeline, from ideation to system development and paper writing. While researchers described nuanced understandings of ethical issues, they were rarely or only partially able to identify and address those ethical concerns in their own projects. This lack of action and reliance on workarounds was explained through the perceived lack of control and distributed responsibility in the LLM supply chain, the conditional nature of engaging with ethics, and competing priorities. Finally, we reflect on the implications of our findings and present opportunities to shape emerging norms of engaging with large language models in HCI research.

Proceedings of the ACM on Human-Computer InteractionVol. 9(2)
University of Notre Dame (US), Northeastern University (US), Carnegie Mellon University (US)
Openalex Percentile: Top 0%
Ethics and Social Impacts of AI
30.75
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.