Embodied AI-Guided Interactive Digital Teachers for Education

Traditional education is considered incapable of providing prompt feedback, facilitating proactive learning, and giving indiscriminate responses.This has been observed in both in-person classes and online courses, especially when students' questions fall outside the instructors' knowledge base or are considered trivial by instructors.Nowadays, the advent of large language models (LLMs) has transformed knowledge acquisition.The LLM-based chatbots enable fast learning through interactive question-answering, which serves as an effective supplement to traditional educational approaches and even shows potential for replacement.To utilize such advancements in education, we propose MAGI, a novel system providing Embodied AI-Guided Interactive digital teachers for education, which integrates LLM-based chatbot technology.To ensure MAGI generates answers without hallucination, we employ a novel retrieval-augmented generation (RAG) paradigm to organize and retrieve useful educational documents for the LLM.Moreover, we create animatable 3D avatars powered by text-to-speech and audioto-motion models to provide students with interactive conversation experiences.We highlight the possibility of MAGI to enhance education accessibility and improve the overall learning experience.

Authors

Publication Details

Published
2024-11-22
DOI
https://doi.org/10.1145/3680533.3697070
Citations
9
Primary Topic
Intelligent Tutoring Systems and Adaptive Learning
Type
article
Field-Weighted Citation Impact
3.13
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Embodied AI-Guided Interactive Digital Teachers for Education

Pan Hui, Zhuoran Zhao, Jia Sun, Zhizhuo Yin
9 citations
Intelligent Tutoring Systems and Adaptive Learning
3.13
article

Embodied AI-Guided Interactive Digital Teachers for Education

Pan Hui, Zhuoran Zhao, Jia Sun, Zhizhuo Yin
article en
9 citations

Abstract

Traditional education is considered incapable of providing prompt feedback, facilitating proactive learning, and giving indiscriminate responses.This has been observed in both in-person classes and online courses, especially when students' questions fall outside the instructors' knowledge base or are considered trivial by instructors.Nowadays, the advent of large language models (LLMs) has transformed knowledge acquisition.The LLM-based chatbots enable fast learning through interactive question-answering, which serves as an effective supplement to traditional educational approaches and even shows potential for replacement.To utilize such advancements in education, we propose MAGI, a novel system providing Embodied AI-Guided Interactive digital teachers for education, which integrates LLM-based chatbot technology.To ensure MAGI generates answers without hallucination, we employ a novel retrieval-augmented generation (RAG) paradigm to organize and retrieve useful educational documents for the LLM.Moreover, we create animatable 3D avatars powered by text-to-speech and audioto-motion models to provide students with interactive conversation experiences.We highlight the possibility of MAGI to enhance education accessibility and improve the overall learning experience.

Quality Education
Openalex Percentile: Top 7%
Intelligent Tutoring Systems and Adaptive Learning
3.13
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Embodied AI-Guided Interactive Digital Teachers for Education — Pan Hui, Zhuoran Zhao, et al. · (2024) | TGRS Research Map | TGRS