A novel deep learning framework with advanced feature engineering for hate speech detection in accented Malayalam speech

The rapid proliferation of hate speech in digital spaces necessitates robust and language-specific detection frameworks, especially for underrepresented languages such as Malayalam. This study introduces a comprehensive deep learning framework for detecting hate speech in accented Malayalam speech, integrating advanced feature engineering, class balancing, and robustness evaluation. A diverse dataset was curated from Malayalam YouTube videos and movies to capture phonetic, dialectal, and prosodic variations. Distinct acoustic features-including Zero Crossing Rate (ZCR), Short-Time Fourier Transform (STFT), Mel-Frequency Cepstral Coefficients (MFCC), Root Mean Square (RMS), and Mel Spectrogram-were extracted, producing 162 feature vectors per utterance. Data augmentation techniques, including noise injection, time stretching, and pitch shifting, were applied to enhance diversity. A customized 1D Convolutional Neural Network (CNN) was developed for binary classification of hate and non-hate speech. Building upon the initial study, this extended research introduces SMOTE-based class balancing, speaker-independent validation, and robustness testing using Gaussian noise to simulate real-world acoustic distortions. Multiple models, including CNN, Support Vector Machine(SVM), Random Forest, XGBoost, and LightGBM, were evaluated under stratified, hold-out, and noise-perturbed conditions. The CNN achieved an accuracy of 95.3%, F1-score of 0.966, and AUC of 0.998 on the noisy hold-out set, demonstrating strong generalization and noise resilience. These results confirm that the integration of balanced learning, multi-level validation, and robustness evaluation significantly enhances the reliability of hate speech detection in accented and low-resource Malayalam speech, establishing a transferable framework for multilingual content moderation. To address potential overfitting and data leakage risks noted in the initial evaluations, this extended study introduces cross-dataset validation, detailed speaker-independent and hold-out testing, and rigorous noise robustness analysis. The findings are revalidated using augmented and balanced data under multiple evaluation settings to ensure reliability and generalizability.

Authors

Institutions

Publication Details

Journal
Humanities and Social Sciences Communications
Published
2025-12-01
DOI
https://doi.org/10.1057/s41599-025-06268-8
Primary Topic
Hate Speech and Cyberbullying Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A novel deep learning framework with advanced feature engineering for hate speech detection in accented Malayalam speech

Rizwana Kallooravi Thandil, V. K. Muneer, K Houlath, Sabique P.V
Humanities and Social Sciences Communications
Hate Speech and Cyberbullying Detection
article

A novel deep learning framework with advanced feature engineering for hate speech detection in accented Malayalam speech

Rizwana Kallooravi Thandil, V. K. Muneer, K Houlath, Sabique P.V
article en

Abstract

The rapid proliferation of hate speech in digital spaces necessitates robust and language-specific detection frameworks, especially for underrepresented languages such as Malayalam. This study introduces a comprehensive deep learning framework for detecting hate speech in accented Malayalam speech, integrating advanced feature engineering, class balancing, and robustness evaluation. A diverse dataset was curated from Malayalam YouTube videos and movies to capture phonetic, dialectal, and prosodic variations. Distinct acoustic features-including Zero Crossing Rate (ZCR), Short-Time Fourier Transform (STFT), Mel-Frequency Cepstral Coefficients (MFCC), Root Mean Square (RMS), and Mel Spectrogram-were extracted, producing 162 feature vectors per utterance. Data augmentation techniques, including noise injection, time stretching, and pitch shifting, were applied to enhance diversity. A customized 1D Convolutional Neural Network (CNN) was developed for binary classification of hate and non-hate speech. Building upon the initial study, this extended research introduces SMOTE-based class balancing, speaker-independent validation, and robustness testing using Gaussian noise to simulate real-world acoustic distortions. Multiple models, including CNN, Support Vector Machine(SVM), Random Forest, XGBoost, and LightGBM, were evaluated under stratified, hold-out, and noise-perturbed conditions. The CNN achieved an accuracy of 95.3%, F1-score of 0.966, and AUC of 0.998 on the noisy hold-out set, demonstrating strong generalization and noise resilience. These results confirm that the integration of balanced learning, multi-level validation, and robustness evaluation significantly enhances the reliability of hate speech detection in accented and low-resource Malayalam speech, establishing a transferable framework for multilingual content moderation. To address potential overfitting and data leakage risks noted in the initial evaluations, this extended study introduces cross-dataset validation, detailed speaker-independent and hold-out testing, and rigorous noise robustness analysis. The findings are revalidated using augmented and balanced data under multiple evaluation settings to ensure reliability and generalizability.

Humanities and Social Sciences CommunicationsVol. 13(1)
University of Calicut (IN), University of Madras (IN), Madras Institute of Development Studies (IN), Indian Institute of Technology Madras (IN), Kerala School of Mathematics (IN), Sacred Heart College (IN)
Openalex Percentile: Top 80%
Hate Speech and Cyberbullying Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.