Discipline-Driven AI: Training a GPT to Qualitatively Code for Technical and Professional Communication Research

This project reports on the process used to train an AI model for qualitative coding and lessons learned for AI utilization in discipline-specific qualitative research. Interdisciplinary scholars are assessing the role of AI in qualitative coding processes, analyzing tools such as Cody [1], PaTAT [2] and ChatGPT3 [3]. Early findings suggest that emerging AI technology may contribute to qualitative coding by providing new insights [2] and increasing intercoder reliability [1], among other benefits. Though important, the sustained attention to the outcomes of AI-assisted coding provides little insight into the processes, successes, and failures during the training process. By focusing on process, researchers can better formulate strategies for AI-assisted coding. This project highlights researchers’ experiences training an AI with a disciplinary-specific knowledge base to support qualitative coding.

Authors

Institutions

Publication Details

Published
2024-10-20
DOI
https://doi.org/10.1145/3641237.3691686
Citations
2
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.69
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Discipline-Driven AI: Training a GPT to Qualitatively Code for Technical and Professional Communication Research

H.C. Willers, Mark A. Hannah, Amber Hedquist
2 citations
Natural Language Processing Techniques
0.69
article

Discipline-Driven AI: Training a GPT to Qualitatively Code for Technical and Professional Communication Research

H.C. Willers, Mark A. Hannah, Amber Hedquist
article en
2 citations

Abstract

This project reports on the process used to train an AI model for qualitative coding and lessons learned for AI utilization in discipline-specific qualitative research. Interdisciplinary scholars are assessing the role of AI in qualitative coding processes, analyzing tools such as Cody [1], PaTAT [2] and ChatGPT3 [3]. Early findings suggest that emerging AI technology may contribute to qualitative coding by providing new insights [2] and increasing intercoder reliability [1], among other benefits. Though important, the sustained attention to the outcomes of AI-assisted coding provides little insight into the processes, successes, and failures during the training process. By focusing on process, researchers can better formulate strategies for AI-assisted coding. This project highlights researchers’ experiences training an AI with a disciplinary-specific knowledge base to support qualitative coding.

Arizona State University (US)
Quality Education
Openalex Percentile: Top 24%
Natural Language Processing Techniques
0.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.