AI in Qualitative Health Research Appraisal: Comparative Study
The findings demonstrate that AI models exhibit both promise and limitations as evaluators of qualitative research quality. While they enhance efficiency, AI models struggle with reaching consensus in areas requiring nuanced interpretation, particularly for contextual criteria. The study underscores the importance of hybrid frameworks that integrate AI scalability with human oversight, especially for contextual judgment. Future research should prioritize developing AI training protocols that emphasize qualitative epistemology, benchmarking AI performance against expert panels to validate accuracy thresholds, and establishing ethical guidelines for disclosing AI's role in systematic reviews. As qualitative methodologies evolve alongside AI capabilities, the path forward lies in collaborative human-AI workflows that leverage AI's efficiency while preserving human expertise for interpretive tasks.
Authors
- August Landerholm
Institutions
- Mälardalen University (SE)
Publication Details
- Journal
- JMIR Formative Research
- Published
- 2025-05-15
- DOI
- https://doi.org/10.2196/72815
- Citations
- 1
- Primary Topic
- Delphi Technique in Research
- Type
- article
- Field-Weighted Citation Impact
- 4.20