Evaluating the Impact of Dataset Variability on Malayalam Emotion Detection System

Text emotion detection has become an increasingly important area of research, with applications ranging from sentiment analysis to enhanced human-computer interaction. The performance of emotion detection systems can, however, vary widely depending on the datasets used for training and evaluation. An emotion detection (ED) system is evaluated, comparing its performance across two datasets that differ in origin, structure, and emotional category, is presented in this paper. We employed a range of evaluation metrics, including accuracy, precision, recall, and F1-score, to analyze the system's performance. The results highlight the impact of dataset char-acteristics on the effectiveness of ED models, revealing notable differences between the two datasets. The performance of the ED system is significantly influenced by factors such as the diversity of emotions and the quality of annotations. This insight contributes to the development of more adaptable and reliable ED systems across a variety of domains. A discussion of future research directions is included at the end of the paper.

Authors

Institutions

Publication Details

Published
2025-02-07
DOI
https://doi.org/10.1109/etis64005.2025.10961861
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluating the Impact of Dataset Variability on Malayalam Emotion Detection System

K. R. Remesh Babu, K Anuja, P. C. Reghu Raj
Emotion and Mood Recognition
article

Evaluating the Impact of Dataset Variability on Malayalam Emotion Detection System

K. R. Remesh Babu, K Anuja, P. C. Reghu Raj
article en

Abstract

Text emotion detection has become an increasingly important area of research, with applications ranging from sentiment analysis to enhanced human-computer interaction. The performance of emotion detection systems can, however, vary widely depending on the datasets used for training and evaluation. An emotion detection (ED) system is evaluated, comparing its performance across two datasets that differ in origin, structure, and emotional category, is presented in this paper. We employed a range of evaluation metrics, including accuracy, precision, recall, and F1-score, to analyze the system's performance. The results highlight the impact of dataset char-acteristics on the effectiveness of ED models, revealing notable differences between the two datasets. The performance of the ED system is significantly influenced by factors such as the diversity of emotions and the quality of annotations. This insight contributes to the development of more adaptable and reliable ED systems across a variety of domains. A discussion of future research directions is included at the end of the paper.

APJ Abdul Kalam Technological University (IN)
Openalex Percentile: Top 92%
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Evaluating the Impact of Dataset Variability on Malayalam Emotion Detection System — K. R. Remesh Babu, K Anuja, et al. · (2025) | TGRS Research Map | TGRS