Using generative AI to support qualitative coding of reflections on inclusion by students in Swedish special education programmes

This exploratory study examined the possibilities and limitations of using generative AI as a supplementary tool for qualitative coding of written reflections produced by students in Swedish special education programmes. The empirical material comprised 99 responses to a debate article on inclusion and special educational perspectives. A theory-informed coding framework distinguished compensatory, relational and dilemma perspectives as non-exhaustive, potentially overlapping ideal types in naturally occurring texts. Two human raters independently coded a stratified random subsample of 20 texts, with ChatGPT as an additional coder using a specified prompting procedure. Human–human agreement was 80% (Cohen’s kappa = 0.70); agreement between each human rater and ChatGPT was 65% (kappa = 0.46 and 0.42). Under the tested configuration, ChatGPT identified no compensatory cases and tended to interpret peripheral forms of inclusion as dilemma-oriented. A post hoc prompt refinement, informed by errors in the same subsample and applied only to six compensatory cases, changed several outputs but provided no independent test of improved performance. Findings therefore concern this model-prompt-data configuration rather than large language models’ inherent capabilities. Agreement, systematic disagreement and prompt sensitivity can inform methodological reflection, underscoring the need for transparent procedures, held-out validation and human interpretive judgement in normatively complex qualitative analysis.

Authors

Institutions

Publication Details

Journal
Journal of Psychology and AI
Published
2026-11-18
DOI
https://doi.org/10.1080/29974100.2026.2764415
Primary Topic
Computational and Text Analysis Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Using generative AI to support qualitative coding of reflections on inclusion by students in Swedish special education programmes

Tobias Björklund, Peter Ingemar Karlsudd
4 links
Journal of Psychology and AI
Computational and Text Analysis Methods
article

Using generative AI to support qualitative coding of reflections on inclusion by students in Swedish special education programmes

Tobias Björklund, Peter Ingemar Karlsudd
article en

Abstract

This exploratory study examined the possibilities and limitations of using generative AI as a supplementary tool for qualitative coding of written reflections produced by students in Swedish special education programmes. The empirical material comprised 99 responses to a debate article on inclusion and special educational perspectives. A theory-informed coding framework distinguished compensatory, relational and dilemma perspectives as non-exhaustive, potentially overlapping ideal types in naturally occurring texts. Two human raters independently coded a stratified random subsample of 20 texts, with ChatGPT as an additional coder using a specified prompting procedure. Human–human agreement was 80% (Cohen’s kappa = 0.70); agreement between each human rater and ChatGPT was 65% (kappa = 0.46 and 0.42). Under the tested configuration, ChatGPT identified no compensatory cases and tended to interpret peripheral forms of inclusion as dilemma-oriented. A post hoc prompt refinement, informed by errors in the same subsample and applied only to six compensatory cases, changed several outputs but provided no independent test of improved performance. Findings therefore concern this model-prompt-data configuration rather than large language models’ inherent capabilities. Agreement, systematic disagreement and prompt sensitivity can inform methodological reflection, underscoring the need for transparent procedures, held-out validation and human interpretive judgement in normatively complex qualitative analysis.

Journal of Psychology and AIVol. 2(1)
Linnaeus University (SE)
Quality education
Computational and Text Analysis Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon