How Our AI-assisted Qualitative Analysis Failed

The authors describe how their Generative Artificial Intelligence (GAI)-assisted qualitative research project failed to produce publishable results. Based on this experience, they argue for the value of embracing and reflecting on failure in GAI-assisted qualitative research. To frame this argument, they draw on two theories of generative failure: failing forward, which uses failures to iterate on designs to meet existing criteria, and failing sideways, which reconsiders the criteria for success. Using a fail-forward perspective, the authors describe how they might revise their research methods for data preparation, process documentation, and task delegation to create more reliable results. Then, using a fail-sideways perspective, they reexamine criteria for publishable results to reimagine the study more fundamentally.

Authors

Institutions

Publication Details

Published
2024-10-20
DOI
https://doi.org/10.1145/3641237.3691672
Citations
2
Primary Topic
Qualitative Research Methods and Applications
Type
article
Field-Weighted Citation Impact
4.19
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

How Our AI-assisted Qualitative Analysis Failed

Luke Thominet, Vanessa Kraemer Sohan, Jacqueline Amorim, Kristine Acosta
2 citations
Qualitative Research Methods and Applications
4.19
article

How Our AI-assisted Qualitative Analysis Failed

Luke Thominet, Vanessa Kraemer Sohan, Jacqueline Amorim, Kristine Acosta
article en
2 citations

Abstract

The authors describe how their Generative Artificial Intelligence (GAI)-assisted qualitative research project failed to produce publishable results. Based on this experience, they argue for the value of embracing and reflecting on failure in GAI-assisted qualitative research. To frame this argument, they draw on two theories of generative failure: failing forward, which uses failures to iterate on designs to meet existing criteria, and failing sideways, which reconsiders the criteria for success. Using a fail-forward perspective, the authors describe how they might revise their research methods for data preparation, process documentation, and task delegation to create more reliable results. Then, using a fail-sideways perspective, they reexamine criteria for publishable results to reimagine the study more fundamentally.

Florida International University (US)
Openalex Percentile: Top 6%
Qualitative Research Methods and Applications
4.19
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.