A novel deep learning framework with advanced feature engineering for hate speech detection in accented Malayalam speech
The rapid proliferation of hate speech in digital spaces necessitates robust and language-specific detection frameworks, especially for underrepresented languages such as Malayalam. This study introduces a comprehensive deep learning framework for detecting hate speech in accented Malayalam speech, integrating advanced feature engineering, class balancing, and robustness evaluation. A diverse dataset was curated from Malayalam YouTube videos and movies to capture phonetic, dialectal, and prosodic variations. Distinct acoustic features-including Zero Crossing Rate (ZCR), Short-Time Fourier Transform (STFT), Mel-Frequency Cepstral Coefficients (MFCC), Root Mean Square (RMS), and Mel Spectrogram-were extracted, producing 162 feature vectors per utterance. Data augmentation techniques, including noise injection, time stretching, and pitch shifting, were applied to enhance diversity. A customized 1D Convolutional Neural Network (CNN) was developed for binary classification of hate and non-hate speech. Building upon the initial study, this extended research introduces SMOTE-based class balancing, speaker-independent validation, and robustness testing using Gaussian noise to simulate real-world acoustic distortions. Multiple models, including CNN, Support Vector Machine(SVM), Random Forest, XGBoost, and LightGBM, were evaluated under stratified, hold-out, and noise-perturbed conditions. The CNN achieved an accuracy of 95.3%, F1-score of 0.966, and AUC of 0.998 on the noisy hold-out set, demonstrating strong generalization and noise resilience. These results confirm that the integration of balanced learning, multi-level validation, and robustness evaluation significantly enhances the reliability of hate speech detection in accented and low-resource Malayalam speech, establishing a transferable framework for multilingual content moderation. To address potential overfitting and data leakage risks noted in the initial evaluations, this extended study introduces cross-dataset validation, detailed speaker-independent and hold-out testing, and rigorous noise robustness analysis. The findings are revalidated using augmented and balanced data under multiple evaluation settings to ensure reliability and generalizability.
Authors
- Rizwana Kallooravi Thandil (ORCID: https://orcid.org/0000-0001-9305-681X)
- V. K. Muneer
- K Houlath
- Sabique P.V
Institutions
- University of Calicut (IN)
- University of Madras (IN)
- Madras Institute of Development Studies (IN)
- Indian Institute of Technology Madras (IN)
- Kerala School of Mathematics (IN)
- Sacred Heart College (IN)
Publication Details
- Journal
- Humanities and Social Sciences Communications
- Published
- 2025-12-01
- DOI
- https://doi.org/10.1057/s41599-025-06268-8
- Primary Topic
- Hate Speech and Cyberbullying Detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00