Pitfalls, benefits, and comparative analysis of artificial intelligence ChatBots in the systematic review process

Abstract The transformative potential of artificial intelligence (AI) ChatBots, leveraging natural language processing for information retrieval and knowledge synthesis, has garnered attention across diverse fields, including research. Recognizing AI's importance, researchers and policymakers are actively engaged in its development. However, a notable gap persists in understanding the efficacy of various AI‐ChatBots specifically within the rigorous process of conducting systematic literature reviews (SLRs). To address this, this study aims to provide a comparative analysis of different AI‐ChatBots against traditional manual approaches in executing SLRs. Employing a case study methodology focused on the International Transactions in Operational Research journal, this research evaluates the benefits and pitfalls of integrating AI across various stages of the SLR process. The findings of this study will offer novel empirical evidence regarding the application of AI‐ChatBots in SLR processes, thereby informing both researchers and policymakers on the practical implications and future directions of AI integration in academic research.