Towards responsible AI for education: Hybrid human-AI to confront the elephant in the room

Despite significant advancements in AI-driven educational systems and ongoing calls for responsible AI for education, several critical issues remain unresolved—acting as elephant in the room within AI in education, learning analytics, educational data mining, learning sciences, and educational psychology communities. This critical analysis identifies and examines nine persistent challenges across the conceptual, methodological, and ethical dimensions that continue to undermine the fairness, transparency, and effectiveness of current AI methods and applications in education. These include: 1) the lack of clarity around what AI for education truly means—often ignoring the distinct purposes, strengths, and limitations of different AI families—and the trend of equating it with domain-agnostic, company-driven large language models; 2) the widespread neglect of essential learning processes such as motivation, emotion, and (meta)cognition in AI-driven learner modelling and their contextual nature; 3) limited integration of domain knowledge and lack of stakeholder involvement in AI design and development; 4) continued use of non-sequential machine learning models on temporal educational data; 5) misuse of non-sequential metrics to evaluate sequential models; 6) using unreliable explainable AI methods to provide explanations for black-box models; 7) ignoring ethical guidelines in addressing data inconsistencies during model training; 8) use of mainstream AI methods for pattern discovery and learning analytics without systematic benchmarking; and 9) overemphasis on global prescriptions while overlooking localized, student-specific recommendations. Supported by theoretical and empirical research, we demonstrate how hybrid AI methods—specifically neural-symbolic AI—can address the elephant in the room and serve as the foundation for responsible, trustworthy AI systems in education. • Nine persistent challenges in current AI for education identified and analyzed. • Inadequate stakeholder involvement and ethical oversight in AI development process. • Ignoring motivation, emotion, and (meta)cognition in AI-driven learner modelling. • Misusing non-sequential models and metrics for sequential or temporal data. • Hybrid human-AI positioned as foundation for responsible AI for education.

Authors

Institutions

Publication Details

Journal
Computers and Education Artificial Intelligence
Published
2025-12-01
DOI
https://doi.org/10.1016/j.caeai.2025.100524
Citations
1
Primary Topic
Intelligent Tutoring Systems and Adaptive Learning
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Towards responsible AI for education: Hybrid human-AI to confront the elephant in the room

Raija Hämäläinen, Eve Kikas, Yeongwook Yang, Danial Hooshyar et al.
1 citations
Computers and Education Artificial Intelligence
Intelligent Tutoring Systems and Adaptive Learning
2.48
article

Towards responsible AI for education: Hybrid human-AI to confront the elephant in the room

Raija Hämäläinen, Eve Kikas, Yeongwook Yang, Danial Hooshyar, Roger Azevedo, Dragan Gašević, Tommi Kärkkäinen, Gustav Šír
article en
1 citations

Abstract

Despite significant advancements in AI-driven educational systems and ongoing calls for responsible AI for education, several critical issues remain unresolved—acting as elephant in the room within AI in education, learning analytics, educational data mining, learning sciences, and educational psychology communities. This critical analysis identifies and examines nine persistent challenges across the conceptual, methodological, and ethical dimensions that continue to undermine the fairness, transparency, and effectiveness of current AI methods and applications in education. These include: 1) the lack of clarity around what AI for education truly means—often ignoring the distinct purposes, strengths, and limitations of different AI families—and the trend of equating it with domain-agnostic, company-driven large language models; 2) the widespread neglect of essential learning processes such as motivation, emotion, and (meta)cognition in AI-driven learner modelling and their contextual nature; 3) limited integration of domain knowledge and lack of stakeholder involvement in AI design and development; 4) continued use of non-sequential machine learning models on temporal educational data; 5) misuse of non-sequential metrics to evaluate sequential models; 6) using unreliable explainable AI methods to provide explanations for black-box models; 7) ignoring ethical guidelines in addressing data inconsistencies during model training; 8) use of mainstream AI methods for pattern discovery and learning analytics without systematic benchmarking; and 9) overemphasis on global prescriptions while overlooking localized, student-specific recommendations. Supported by theoretical and empirical research, we demonstrate how hybrid AI methods—specifically neural-symbolic AI—can address the elephant in the room and serve as the foundation for responsible, trustworthy AI systems in education. • Nine persistent challenges in current AI for education identified and analyzed. • Inadequate stakeholder involvement and ethical oversight in AI development process. • Ignoring motivation, emotion, and (meta)cognition in AI-driven learner modelling. • Misusing non-sequential models and metrics for sequential or temporal data. • Hybrid human-AI positioned as foundation for responsible AI for education.

Computers and Education Artificial IntelligenceVol. 9
University of Central Florida (US), Gangneung–Wonju National University (KR), Tallinn University (EE), Czech Technical University in Prague (CZ), Monash University (AU), University of Jyväskylä (FI)
Openalex Percentile: Top 8%
Intelligent Tutoring Systems and Adaptive Learning
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.