Conversational AI agents in education: an umbrella review of current utilization, challenges, and future directions for ethical and responsible use

Abstract The use of Conversational AI (CAI) agents within education has seen a rise with the rapid integration of generative AI (GenAI). The generative ability of the application combined with conversational capabilities has enhanced the perceived and actual usefulness of CAI applications. Given this development, it is critical to undertake a comprehensive review to understand the actual application domains, challenges, and efforts within this area. A range of empirical studies as well as reviews have been undertaken in recent years, but the current understanding remains fragmented. To better understand the current state-of-the-art, current trends and future implications of CAI on education, we conducted an umbrella review (UR) to systematically synthesize findings from thirty-four review articles. Articles were collected through a search across five major databases. They were screened using predefined eligibility criteria focusing on CAI agents used across educational domains and contexts. The PRISMA framework for transparent reporting is followed throughout the process and a thematic analysis has been undertaken to analyze the data. The results show that CAI utilization is concentrated in pedagogical applications such as teaching support, psychological engagement, and metacognitive development, while administrative functions, research assistance, and specialized training remain underdeveloped. Technical limitations and concerns with educational impact dominate discussions. Ethically, human-AI relationship concerns persist across all CAI generations, while academic integrity and data privacy represent emerging areas of concern. The review reveals gaps in CAI frameworks: lack of end-to-end design guidance, weak CAI specific usability methods, unclear pedagogical guidance and classroom implementation strategies, and limited AI literacy support. The article concludes by proposing a roadmap for ethical CAI implementation in education and identifying priority areas for future research.