Exploratory Research on Harmful Speech Detection based on Large Language Models
With the rapid expansion of online platforms, harmful speech has emerged as a critical issue, challenging mental health and social order. As the amount of online review and content posting generated daily continues to increase, there is a pressing need for developing automated systems/models to detect and address harmful speech. Despite the achievement of harmful speech detection models based on machine learning and deep learning, the challenges of accurately identifying harmful content still remain. This study thus investigates the application of Large Language Models (LLMs) for harmful speech detection. We fine-tuned three LLMs, Llama3.1, Qwen2, and Qwen2.5 using a meticulously curated dataset of harmful speech examples. The experimental results revealed that the improved models attained higher performance levels, achieving accuracy rates above 80 %. This highlights the potential of LLMs to identify complex language patterns and context effectively when detecting harmful content in the context of Chinese language. Our fine-tuned models contribute to fostering safer online environments, and this research will serve as a reference for future advancements in harmful speech detection systems/models.
Authors
- Xuyang Guo (ORCID: https://orcid.org/0000-0002-5881-714X)
- Caihua Liu (ORCID: https://orcid.org/0000-0001-9108-0357)
- Shufeng Kong
Institutions
- Sun Yat-sen University (CN)
- Guilin University of Electronic Technology (CN)
Publication Details
- Published
- 2024-10-25
- DOI
- https://doi.org/10.1109/icbaie63306.2024.11117011
- Primary Topic
- Educational Reforms and Innovations
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Ministry of Education of the People's Republic of China