Advancing cyberbullying detection in low-resource languages: a transformer- stacking framework for Bengali

Cyberbullying on social networks has emerged as a pressing global issue, yet research in low-resource languages such as Bengali remains underdeveloped due to the scarcity of high-quality datasets, linguistic resources, and targeted methodologies. Many existing approaches overlook essential language-specific preprocessing, neglect the integration of advanced transformer-based models, and do not adequately address model validation, scalability, and adaptability. To address these limitations, this study introduces three Bengali-specific preprocessing strategies to enhance feature representation. It then proposes <i>Transformer-stacking</i>, an effective hybrid detection framework that combines three transformer models, XLM-R-base, multilingual BERT, and Bangla-Bert-Base, via a stacking strategy with a multi-layer perceptron classifier. The framework is evaluated on a publicly available Bengali cyberbullying dataset comprising 44,001 samples across both binary (<i>Sub-task A</i>) and multiclass (<i>Sub-task B</i>) classification settings. <i>Transformer-stacking</i> achieves an F1-score of 93.61% and an accuracy of 93.62% for <i>Sub-task A</i>, and an F1-score and accuracy of 89.23% for <i>Sub-task B</i>, outperforming eight baseline transformer models, four transformer ensemble techniques, and recent state-of-the-art methods. These improvements are statistically validated using McNemar's test. Furthermore, experiments on two external Bengali datasets, focused on hate speech and abusive language, demonstrate the model's scalability and adaptability. Overall, <i>Transformer-stacking</i> offers an effective and generalizable solution for Bengali cyberbullying detection, establishing a new benchmark in this underexplored domain.