Regulatory solutions to alleviate the risks of generative AI models in qualitative research

Generative AI models, with their enhanced capacity for conversation, will soon find widespread applications in qualitative research, especially in the disciplines of social science and public policy. Although researchers guarantee the confidentiality of the data, the tools they use for data analysis are largely their choice and remain unregulated, raising serious ethical concerns. Prior research has established the potentially hazardous effects of such transformative architecture on research integrity and ethics; however, the interventions required to alleviate the risks that impact the 3Rs–Reviewers, Researchers, and Research Respondents–have not yet been studied. Initially, we analysed the potential risks associated with Large Language Models (such as GPTs) by examining scientific publications. We then had a ‘risk workshop’ with four qualitative researchers, followed by open-ended interviews with seven individuals from the 3 R impact groups to develop the various risk scenarios. We compare these risks to the AI-related policies of the European Union, Singapore, the United States, the United Kingdom and China to identify regulatory gaps. The research output illustrates potential regulatory interventions on a continuum, with nodality-based soft laws at one end and more extensive regulatory interventions (hard laws) at the other for various LLM applications in qualitative research.

Authors

Institutions

Publication Details

Journal
Journal of Asian Public Policy
Published
2024-09-08
DOI
https://doi.org/10.1080/17516234.2024.2399098
Citations
2
Primary Topic
Focus Groups and Qualitative Methods
Type
article
Field-Weighted Citation Impact
2.26
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Regulatory solutions to alleviate the risks of generative AI models in qualitative research

Kira Matus, Vishnu Sivarudran Pillai
2 citations
Journal of Asian Public Policy
Focus Groups and Qualitative Methods
2.26
article

Regulatory solutions to alleviate the risks of generative AI models in qualitative research

Kira Matus, Vishnu Sivarudran Pillai
article en
2 citations

Abstract

Generative AI models, with their enhanced capacity for conversation, will soon find widespread applications in qualitative research, especially in the disciplines of social science and public policy. Although researchers guarantee the confidentiality of the data, the tools they use for data analysis are largely their choice and remain unregulated, raising serious ethical concerns. Prior research has established the potentially hazardous effects of such transformative architecture on research integrity and ethics; however, the interventions required to alleviate the risks that impact the 3Rs–Reviewers, Researchers, and Research Respondents–have not yet been studied. Initially, we analysed the potential risks associated with Large Language Models (such as GPTs) by examining scientific publications. We then had a ‘risk workshop’ with four qualitative researchers, followed by open-ended interviews with seven individuals from the 3 R impact groups to develop the various risk scenarios. We compare these risks to the AI-related policies of the European Union, Singapore, the United States, the United Kingdom and China to identify regulatory gaps. The research output illustrates potential regulatory interventions on a continuum, with nodality-based soft laws at one end and more extensive regulatory interventions (hard laws) at the other for various LLM applications in qualitative research.

Journal of Asian Public PolicyVol. 18(2)
Hong Kong University of Science and Technology (HK), GITAM University (IN)
Openalex Percentile: Top 10%
Focus Groups and Qualitative Methods
2.26
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.