Enhancing Real-Time Student Emotion Recognition in Online Classrooms Using LSTM and CNN Hybrid Models”
This study aims to design and implement a hybrid model based on Long Short-Term Memory (LSTM) and Convolutional Neural Networks (CNN) for real-time emotion recognition in online classrooms. The system analyzes students’ facial expressions during online learning, capturing their emotional changes in real time and providing immediate feedback to teachers, enabling dynamic adjustments to the teaching content. The model was trained and tested using real datasets, and it demonstrated high accuracy in recognizing typical emotional states such as happiness, confusion, and frustration. Experimental results show that the LSTM-CNN hybrid model excels in both emotion recognition accuracy and system response time, providing emotion feedback within milliseconds, ensuring real-time functionality. After implementing the system, student engagement and classroom interaction significantly improved, with data showing an overall learning effectiveness increase of approximately 12%. This study provides an effective technological solution for personalized teaching in online classrooms and offers strong support for large-scale educational applications in the future.
Authors
- Jinhai Tang (ORCID: https://orcid.org/0000-0003-2016-4216)
- Cheng Wang (ORCID: https://orcid.org/0000-0002-7181-4939)
- Shaoke
Institutions
- Macau University of Science and Technology (MO)
Publication Details
- Published
- 2024-11-04
- DOI
- https://doi.org/10.1109/csrswtc64338.2024.10811602
- Citations
- 1
- Primary Topic
- IoT-based Smart Home Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.21