Multimodal Emotion Recognition in Educational Environments Using Artificial Intelligence and Forensic Psychology

This study explores how multimodal emotion recognition can be leveraged ineducational environments, combining AI methodologies with forensic psychology to improvehuman-computer interaction and behavioral analysis. The research used a mixed-methodsapproach, gathering data through facial expression analysis, speech signal processing, andannotated datasets. For the technical side, the team applied advanced machine learningalgorithms—specifically, support vector machines and deep learning architectures—forclassifying emotional states.The multimodal fusion model, which incorporates both facial andspeech data, achieved 91% accuracy, outperforming any single-modality method. This reallyhighlights the advantage of integrating multiple sources of information.These findings suggestthat multimodal systems could play a significant role in real-time educational assessment andbehavioral prediction, especially in multilingual settings. By bringing forensic psychology intothe mix, the system gains a more nuanced perspective on student emotions—making it avaluable tool for adaptive learning platforms and early intervention strategies.

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-08-14
DOI
https://doi.org/10.5281/zenodo.16881097
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal Emotion Recognition in Educational Environments Using Artificial Intelligence and Forensic Psychology

Zenodo (CERN European Organization for Nuclear Research)
Emotion and Mood Recognition
article

Multimodal Emotion Recognition in Educational Environments Using Artificial Intelligence and Forensic Psychology

article en

Abstract

This study explores how multimodal emotion recognition can be leveraged ineducational environments, combining AI methodologies with forensic psychology to improvehuman-computer interaction and behavioral analysis. The research used a mixed-methodsapproach, gathering data through facial expression analysis, speech signal processing, andannotated datasets. For the technical side, the team applied advanced machine learningalgorithms—specifically, support vector machines and deep learning architectures—forclassifying emotional states.The multimodal fusion model, which incorporates both facial andspeech data, achieved 91% accuracy, outperforming any single-modality method. This reallyhighlights the advantage of integrating multiple sources of information.These findings suggestthat multimodal systems could play a significant role in real-time educational assessment andbehavioral prediction, especially in multilingual settings. By bringing forensic psychology intothe mix, the system gains a more nuanced perspective on student emotions—making it avaluable tool for adaptive learning platforms and early intervention strategies.

Zenodo (CERN European Organization for Nuclear Research)
Quality Education
Openalex Percentile: Top 45%
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Multimodal Emotion Recognition in Educational Environments Using Artificial Intelligence and Forensic Psychology · Zenodo (CERN European Organization for Nuclear Research) (2025) | TGRS Research Map | TGRS