Exploring the Integration of Artificial Intelligence in Delphi Studies: A Comparative Analysis of Human and AI Expert Panels

This study compares the outcomes of two Delphi technique implementations investigating cybersecurity threats to online education: a traditional human expert panel from a 2014 study and a virtual panel generated using ChatGPT-4. The research evaluated whether artificial intelligence (AI) can produce results comparable to human experts in Delphi studies. Through a three-round process, both panels identified and prioritized key cybersecurity concerns. Results revealed significant overlap in core concerns, with both panels emphasizing training, data security, and system infrastructure as critical priorities. The AI panel introduced novel perspectives, such as collaboration and continuous improvement, while maintaining alignment with the human panel's recommendations. These findings suggest that AI can expedite-Delphi studies and produce meaningful insights, albeit with limitations in contextual understanding and practical nuance. This research contributes to methodological advancements in Delphi studies, offering implications for incorporating AI into expert-driven research.