Mixed-Methods & AI for Methodological Literature Reviews

In the Generative AI (GenAI) era, social researchers have explored different tools for different phases of research projects. Despite AI and GenAI being highly relevant topics in current literature, few researchers have addressed the question of how to explore GenAI tools based on human-AI collaboration to improve the quality of methodological literature reviews. Based on a real project as a sample, “a competence framework for social researchers integrating GenAI”, we propose a detailed analytical model that triangulates evidence from both quantitative and qualitative data analyses. A mixed-methods approach is looked at, with a focus on the qualitative dimension (quant-QUAL). The bibliometric analysis is added to the framework analysis. The steps we follow are: (1) bibliometric analysis of Scopus publications (434 with the primary string; 84 with the secondary string from 2021-2024); (2) qualitative analysis of 32 publications using inclusion/exclusion criteria to develop initial categories via Chain-of-Thought prompting with Gemini and ChatGPT; (3) indexing using webQDA; (4) pattern interpretation and categorisation using ChatGPT and webQDA; and (5) mapping and interpretation to identify patterns and connections. These results came from social researchers working together with AI, which helped figure out the pros and cons of using GenAI in different stages of the methodological literature review. During the construction of the model, the researchers identified as a limitation the fact that they did not collect data from all meetings so that their analysis could improve the framework presented.