Systematic Review of Chatbot Development in Health and Education: Technologies, Frameworks, and Evaluation Metrics

Chatbots have emerged as valuable tools in public service domains such as healthcare and education, supporting information delivery, training, and user engagement. Despite growing adoption, development practices remain fragmented. This paper presents a Systematic Literature Review (SLR) of 27 studies to identify trends, challenges, and research gaps in chatbot development, focusing on technological approaches, frameworks, evaluation methodologies, and language distribution. Findings reveal a strong preference for open-source frameworks, particularly Rasa, valued for flexibility and scalability, while TensorFlow is often used for custom ML-based implementations. English dominates as the primary development language, with limited representation of Spanish, despite its global importance. Most studies apply quantitative (performance-based) metrics such as F1-score and accuracy; only one combines quantitative and qualitative evaluations, reflecting a lack of standardized assessment approaches. Additional gaps include the absence of hybrid evaluation frameworks, limited attention to Responsible AI principles, and scarce discussion on deployment requirements. Future research should prioritize multilingual chatbot models, integrate hybrid evaluation frameworks, and promote transparency to ensure scalability, ethical AI practices, and user-centered design.

Authors

Institutions

Publication Details

Published
2025-06-18
DOI
https://doi.org/10.1109/icedeg65568.2025.11081666
Citations
3
Primary Topic
AI in Service Interactions
Type
article
Field-Weighted Citation Impact
7.44
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Systematic Review of Chatbot Development in Health and Education: Technologies, Frameworks, and Evaluation Metrics

Villie Morocho, Christian Ordoñez-Crespo, Verónica Viloria-Ramírez
3 citations
AI in Service Interactions
7.44
article

Systematic Review of Chatbot Development in Health and Education: Technologies, Frameworks, and Evaluation Metrics

Villie Morocho, Christian Ordoñez-Crespo, Verónica Viloria-Ramírez
article en
3 citations

Abstract

Chatbots have emerged as valuable tools in public service domains such as healthcare and education, supporting information delivery, training, and user engagement. Despite growing adoption, development practices remain fragmented. This paper presents a Systematic Literature Review (SLR) of 27 studies to identify trends, challenges, and research gaps in chatbot development, focusing on technological approaches, frameworks, evaluation methodologies, and language distribution. Findings reveal a strong preference for open-source frameworks, particularly Rasa, valued for flexibility and scalability, while TensorFlow is often used for custom ML-based implementations. English dominates as the primary development language, with limited representation of Spanish, despite its global importance. Most studies apply quantitative (performance-based) metrics such as F1-score and accuracy; only one combines quantitative and qualitative evaluations, reflecting a lack of standardized assessment approaches. Additional gaps include the absence of hybrid evaluation frameworks, limited attention to Responsible AI principles, and scarce discussion on deployment requirements. Future research should prioritize multilingual chatbot models, integrate hybrid evaluation frameworks, and promote transparency to ensure scalability, ethical AI practices, and user-centered design.

University of Cuenca (EC)
Openalex Percentile: Top 3%
AI in Service Interactions
7.44
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Systematic Review of Chatbot Development in Health and Education: Technologies, Frameworks, and Evaluation Metrics — Villie Morocho, Christian Ordoñez-Crespo, et al. · (2025) | TGRS Research Map | TGRS