When Principles Compound: Lessons Learned from Implementing Best Practices in Ethical Dataset Curation

Scholars have proposed ethical principles and frameworks to support industry practitioners developing responsible AI. To enable these from theory to practice, a subset of research explores how practitioners actually enact abstract ethical concepts and guidance, surfacing factors that limit their efforts—e.g., organizational support—and informing ways to strengthen efforts towards safe and ethical AI in practice—e.g., practical checklists, educational workbooks. Curiously, this has been underexplored in relation to practitioners curating ethical datasets, the very foundation needed for fair ML technologies, despite the existence of various data ethics principles. It is unsurprising, then, that reports continue to emerge of ML datasets curated through questionable practices, including non-consensual web-scraping and exploitative labor practices. To address this gap, we describe the experiences of a project team curating FHIBE: a fair, human-centric benchmark dataset for computer vision technologies, grounded in recommendations by data ethics and fair ML scholars. Using an ethnographic lens, we share the team’s motivation and the set of principles FHIBE was based on, the challenges team members faced trying to execute multiple principles at once, and the ways they adapted in lieu of resources or insights from preceding scholarship. By tracing one team’s end-to-end data curation efforts, we offer new insights into practitioners’ realities translating data ethics, to inform valuable avenues for HCI and policy researchers to address in the future.

Authors

Institutions

Publication Details

Journal
Proceedings of the ACM on Human-Computer Interaction
Published
2026-11-16
DOI
https://doi.org/10.1145/3857842
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

When Principles Compound: Lessons Learned from Implementing Best Practices in Ethical Dataset Curation

Alice Xiang, Angie Zhang, Morgan Klaus Scheuerman
Proceedings of the ACM on Human-Computer Interaction
Ethics and Social Impacts of AI
article

When Principles Compound: Lessons Learned from Implementing Best Practices in Ethical Dataset Curation

Alice Xiang, Angie Zhang, Morgan Klaus Scheuerman
article en

Abstract

Scholars have proposed ethical principles and frameworks to support industry practitioners developing responsible AI. To enable these from theory to practice, a subset of research explores how practitioners actually enact abstract ethical concepts and guidance, surfacing factors that limit their efforts—e.g., organizational support—and informing ways to strengthen efforts towards safe and ethical AI in practice—e.g., practical checklists, educational workbooks. Curiously, this has been underexplored in relation to practitioners curating ethical datasets, the very foundation needed for fair ML technologies, despite the existence of various data ethics principles. It is unsurprising, then, that reports continue to emerge of ML datasets curated through questionable practices, including non-consensual web-scraping and exploitative labor practices. To address this gap, we describe the experiences of a project team curating FHIBE: a fair, human-centric benchmark dataset for computer vision technologies, grounded in recommendations by data ethics and fair ML scholars. Using an ethnographic lens, we share the team’s motivation and the set of principles FHIBE was based on, the challenges team members faced trying to execute multiple principles at once, and the ways they adapted in lieu of resources or insights from preceding scholarship. By tracing one team’s end-to-end data curation efforts, we offer new insights into practitioners’ realities translating data ethics, to inform valuable avenues for HCI and policy researchers to address in the future.

Proceedings of the ACM on Human-Computer InteractionVol. 11(2)
The University of Sydney (AU), Austin Graduate School of Theology (US), Austin Independent School District (US), The University of Texas at Austin (US)
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon