A Study on the Application of AI Tutors Integrating Multimodal Data in Predicting Student Behavior

As higher education management undergoes a smart transformation, the precise prediction of student behavior has become a critical component in achieving targeted education. Traditional counseling mechanisms often rely on human experience, making it difficult to promptly and accurately identify potential risky behaviors among students. This paper proposes an artificial intelligence (AI) counselor system that integrates multi-modal data, comprehensively utilizing behavioral data, text data, and emotional signals generated by students across multiple scenarios such as learning platforms, social interactions, and classroom performance, to achieve intelligent prediction and dynamic intervention of student behavior. The system employs a multi-modal fusion mechanism to construct a deep learning model integrating Transformers and long short-term memory (LSTMs), comprehensively modeling and analyzing changes in students' learning attitudes, fluctuations in psychological states, and withdrawal risks. Experimental results demonstrate that the AI counseling system, which integrates text, behavioral, and emotional modalities and incorporates an attention mechanism, achieves significant performance in student behavior prediction tasks, with an F1-score of 0.853, outperforming all ablation comparison models. This study not only improves prediction accuracy and model stability but also validates the feasibility of multi-modal information collaboration in educational scenarios. This research provides theoretical support and technical pathways for the construction of intelligent intervention mechanisms in higher education institutions, offering promising prospects for widespread application.

Authors

Institutions

Publication Details

Published
2025-07-11
DOI
https://doi.org/10.1109/idsac65763.2025.11170151
Primary Topic
Education and Learning Interventions
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Study on the Application of AI Tutors Integrating Multimodal Data in Predicting Student Behavior

Bin Gong, Yimin Shao
Education and Learning Interventions
article

A Study on the Application of AI Tutors Integrating Multimodal Data in Predicting Student Behavior

Bin Gong, Yimin Shao
article en

Abstract

As higher education management undergoes a smart transformation, the precise prediction of student behavior has become a critical component in achieving targeted education. Traditional counseling mechanisms often rely on human experience, making it difficult to promptly and accurately identify potential risky behaviors among students. This paper proposes an artificial intelligence (AI) counselor system that integrates multi-modal data, comprehensively utilizing behavioral data, text data, and emotional signals generated by students across multiple scenarios such as learning platforms, social interactions, and classroom performance, to achieve intelligent prediction and dynamic intervention of student behavior. The system employs a multi-modal fusion mechanism to construct a deep learning model integrating Transformers and long short-term memory (LSTMs), comprehensively modeling and analyzing changes in students' learning attitudes, fluctuations in psychological states, and withdrawal risks. Experimental results demonstrate that the AI counseling system, which integrates text, behavioral, and emotional modalities and incorporates an attention mechanism, achieves significant performance in student behavior prediction tasks, with an F1-score of 0.853, outperforming all ablation comparison models. This study not only improves prediction accuracy and model stability but also validates the feasibility of multi-modal information collaboration in educational scenarios. This research provides theoretical support and technical pathways for the construction of intelligent intervention mechanisms in higher education institutions, offering promising prospects for widespread application.

Guangdong Polytechnic of Science and Technology (CN)
Openalex Percentile: Top 62%
Education and Learning Interventions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Study on the Application of AI Tutors Integrating Multimodal Data in Predicting Student Behavior — Bin Gong, Yimin Shao · (2025) | TGRS Research Map | TGRS