Automatic recognition and assessment of students’ high-order thinking skills in online learning environments based on multimodal deep learning
Scalable prediction of rubric-consistent proxy indicators related to students’ high-order thinking skills in online learning environments is important for supporting process-oriented learning analytics and personalized educational intervention. However, existing assessment methods often rely on manual scoring, single-source learning evidence, or shallow multimodal fusion strategies, which makes it difficult to capture the complex relationships among students’ textual expression, learning behavior, task performance, and interaction patterns. To address these limitations, this paper proposes MHTA-Net, a multimodal network for predicting rubric-derived high-order thinking proxy targets through multimodal encoding, Mamba-based selective fusion, and KAN-based multi-task prediction. Specifically, the multimodal learning feature encoder extracts heterogeneous representations from textual expressions, behavioral sequences, assessment records, and interaction features. The Mamba-based selective fusion module models cross-modal dependencies and selectively retains informative evidence states from heterogeneous learning traces, while the KAN-based multi-task module maps the fused representation to an overall rubric-derived proxy level and dimension-specific proxy scores for analysis, evaluation, and creation. Experiments are conducted on the constructed MOOCCubeX-HOTS benchmark, which contains 12,486 learner-course instances derived from public MOOC data. The proposed MHTA-Net achieves the best overall performance, with an Accuracy of 0.876, a Macro-F1 of 0.862, an AUC of 0.923, an MAE of 4.96, an RMSE of 6.42, and a PCC of 0.842. Ablation experiments, dimension-level analysis, missing-modality robustness evaluation, visualization, and case studies further demonstrate the predictive effectiveness, robustness, and output transparency of the proposed model. The results indicate that MHTA-Net provides a feasible framework for multidimensional prediction of rubric-derived proxy indicators related to high-order thinking in online learning environments, rather than an independently validated measurement of latent cognitive ability.
Authors
- Zongyi Liu (ORCID: https://orcid.org/0000-0002-2394-750X)
- Hui Li
- Guo Li Zhou
Institutions
- National University of Malaysia (MY)
Publication Details
- Journal
- Scientific Reports
- Published
- 2026-11-18
- DOI
- https://doi.org/10.1038/s41598-026-79580-1
- Primary Topic
- Online Learning and Analytics
- Type
- article
- Field-Weighted Citation Impact
- 0.00