Multi-Modal Emotion Recognition Using Ensemble Deep Learning and DeepNet Model

Human speech signals are a vital source for determining human emotions. Classic datasets of human speech signals can be explored for many applications in healthcare, gaming, and advertisement domains. Emotion recognition using Deep Learning (DL) algorithms can facilitate the assessment of well-informed decision-making. Existing DL algorithms have limitations in their predictive performance as they do not leverage feature engineering in their approach. In this work, we propose a novel DeepNet Base Audio Emotion Recognition Framework to achieve automation in the identification of human emotions by means of supervised learning to enhance predictive performance. Proposed DeepNet incorporates algorithms namely the DeepNet Base Audio Emotion Recognition Framework algorithm to efficiently identify features having discriminative capability and Recognition (DeepNet) algorithm which uses Multi-Layer Perceptron for automatic emotion recognition. DeepNet algorithms are trained on the RAVDESS dataset for empirical study which has a broad collection of distinct natural human emotions such as angry, neutral, disgust, fear, surprise, sad, and happiness. Further, a web-application is designed to recognize human emotion based on the saved DeepNet model. Results from the application suggest that the DeepNet algorithm outperformed standard algorithms such as Bi-LSTM and Ensemble Model-D tested on the same dataset. Bi-LSTM process the data forward and backwards using Bi-directional layers from input to output. Whereas the ensemble models built various assorted base model, but fails to interpret generalization type error, Bi-LSTM achieves an accuracy of 81.53%, while the Ensemble Model-D reaches 85.22%. The performance efficiency of the proposed DeepNet algorithm-based DeepNet model has 88.9% better predictive performance than the conventionalexisting algorithm.

Authors

Institutions

Publication Details

Journal
The International Journal of Maritime Engineering
Published
2026-11-13
DOI
https://doi.org/10.5750/ijme.v168ia6(s).2021
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Multi-Modal Emotion Recognition Using Ensemble Deep Learning and DeepNet Model

Shaik Abdul Khalandar Basha, P S Ramesh
1 links
The International Journal of Maritime Engineering
Emotion and Mood Recognition
article

Multi-Modal Emotion Recognition Using Ensemble Deep Learning and DeepNet Model

Shaik Abdul Khalandar Basha, P S Ramesh
article en

Abstract

Human speech signals are a vital source for determining human emotions. Classic datasets of human speech signals can be explored for many applications in healthcare, gaming, and advertisement domains. Emotion recognition using Deep Learning (DL) algorithms can facilitate the assessment of well-informed decision-making. Existing DL algorithms have limitations in their predictive performance as they do not leverage feature engineering in their approach. In this work, we propose a novel DeepNet Base Audio Emotion Recognition Framework to achieve automation in the identification of human emotions by means of supervised learning to enhance predictive performance. Proposed DeepNet incorporates algorithms namely the DeepNet Base Audio Emotion Recognition Framework algorithm to efficiently identify features having discriminative capability and Recognition (DeepNet) algorithm which uses Multi-Layer Perceptron for automatic emotion recognition. DeepNet algorithms are trained on the RAVDESS dataset for empirical study which has a broad collection of distinct natural human emotions such as angry, neutral, disgust, fear, surprise, sad, and happiness. Further, a web-application is designed to recognize human emotion based on the saved DeepNet model. Results from the application suggest that the DeepNet algorithm outperformed standard algorithms such as Bi-LSTM and Ensemble Model-D tested on the same dataset. Bi-LSTM process the data forward and backwards using Bi-directional layers from input to output. Whereas the ensemble models built various assorted base model, but fails to interpret generalization type error, Bi-LSTM achieves an accuracy of 81.53%, while the Ensemble Model-D reaches 85.22%. The performance efficiency of the proposed DeepNet algorithm-based DeepNet model has 88.9% better predictive performance than the conventionalexisting algorithm.

The International Journal of Maritime EngineeringVol. 168(A6(S))
Vellore Institute of Technology University (IN)
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon