Multimodal Emotion Recognition in Educational Environments Using Artificial Intelligence and Forensic Psychology

This study explores how multimodal emotion recognition can be leveraged in educational environments, combining AI methodologies with forensic psychology to improve human-computer interaction and behavioral analysis. The research used a mixed-methods approach, gathering data through facial expression analysis, speech signal processing, and annotated datasets. For the technical side, the team applied advanced machine learning algorithms—specifically, support vector machines and deep learning architectures—for classifying emotional states.The multimodal fusion model, which incorporates both facial and speech data, achieved 91% accuracy, outperforming any single-modality method. This really highlights the advantage of integrating multiple sources of information.These findings suggest that multimodal systems could play a significant role in real-time educational assessment and behavioral prediction, especially in multilingual settings. By bringing forensic psychology into the mix, the system gains a more nuanced perspective on student emotions—making it a valuable tool for adaptive learning platforms and early intervention strategies.

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-08-14
DOI
https://doi.org/10.5281/zenodo.16868575
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal Emotion Recognition in Educational Environments Using Artificial Intelligence and Forensic Psychology

Zenodo (CERN European Organization for Nuclear Research)
Emotion and Mood Recognition
article

Multimodal Emotion Recognition in Educational Environments Using Artificial Intelligence and Forensic Psychology

article en

Abstract

This study explores how multimodal emotion recognition can be leveraged in educational environments, combining AI methodologies with forensic psychology to improve human-computer interaction and behavioral analysis. The research used a mixed-methods approach, gathering data through facial expression analysis, speech signal processing, and annotated datasets. For the technical side, the team applied advanced machine learning algorithms—specifically, support vector machines and deep learning architectures—for classifying emotional states.The multimodal fusion model, which incorporates both facial and speech data, achieved 91% accuracy, outperforming any single-modality method. This really highlights the advantage of integrating multiple sources of information.These findings suggest that multimodal systems could play a significant role in real-time educational assessment and behavioral prediction, especially in multilingual settings. By bringing forensic psychology into the mix, the system gains a more nuanced perspective on student emotions—making it a valuable tool for adaptive learning platforms and early intervention strategies.

Zenodo (CERN European Organization for Nuclear Research)
Quality Education
Openalex Percentile: Top 53%
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Multimodal Emotion Recognition in Educational Environments Using Artificial Intelligence and Forensic Psychology · Zenodo (CERN European Organization for Nuclear Research) (2025) | TGRS Research Map | TGRS