NLP with Transformers for toxicity detection: corpus construction and evaluation for MisProfesores.com platform
The growth of social networks as mass media has enabled faster and closer interaction between users, but it also presents challenges, such as the risk of spreading hate speech. Early detection of such harmful posts is critical. This article presents a methodology to create a unique corpus of Spanish-language comments collected from MisProfesores.com platform, covering all states in Mexico. This process resulted in a dataset of 18,000 unlabeled samples and 853 manually labeled samples. In addition to describing the corpus construction process, the results of the evaluation of different models trained with these data are presented, as well as their comparison with previous works for toxicity detection, highlighting the relevance of the Spanish corpus development for specific tasks. As a result, our Transformer-based model performed better than the state-of-the-art models in the binary toxicity classification, reaching a value of 0.9649 in accuracy and 0.9645 in F1 score.
Authors
- Ramón Zataraín Cabada (ORCID: https://orcid.org/0000-0002-4524-3511)
- María Lucía Barrón Estrada (ORCID: https://orcid.org/0000-0002-3856-9361)
- Víctor Manuel Bátiz Beltrán (ORCID: https://orcid.org/0000-0003-4356-9793)
- Ramón Alberto Camacho Sapien (ORCID: https://orcid.org/0009-0003-9367-7730)
- Néstor Leyva López (ORCID: https://orcid.org/0000-0002-2767-5708)
Institutions
- Instituto Tecnológico de Culiacán (MX)
Publication Details
- Journal
- International Journal of Combinatorial Optimization Problems and Informatics.
- Published
- 2025-03-25
- DOI
- https://doi.org/10.61467/2007.1558.2025.v16i2.534
- Primary Topic
- Hate Speech and Cyberbullying Detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00