Exploratory Research on Harmful Speech Detection based on Large Language Models

With the rapid expansion of online platforms, harmful speech has emerged as a critical issue, challenging mental health and social order. As the amount of online review and content posting generated daily continues to increase, there is a pressing need for developing automated systems/models to detect and address harmful speech. Despite the achievement of harmful speech detection models based on machine learning and deep learning, the challenges of accurately identifying harmful content still remain. This study thus investigates the application of Large Language Models (LLMs) for harmful speech detection. We fine-tuned three LLMs, Llama3.1, Qwen2, and Qwen2.5 using a meticulously curated dataset of harmful speech examples. The experimental results revealed that the improved models attained higher performance levels, achieving accuracy rates above 80 %. This highlights the potential of LLMs to identify complex language patterns and context effectively when detecting harmful content in the context of Chinese language. Our fine-tuned models contribute to fostering safer online environments, and this research will serve as a reference for future advancements in harmful speech detection systems/models.

Authors

Institutions

Publication Details

Published
2024-10-25
DOI
https://doi.org/10.1109/icbaie63306.2024.11117011
Primary Topic
Educational Reforms and Innovations
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exploratory Research on Harmful Speech Detection based on Large Language Models

Xuyang Guo, Caihua Liu, Shufeng Kong
Educational Reforms and Innovations
article

Exploratory Research on Harmful Speech Detection based on Large Language Models

Xuyang Guo, Caihua Liu, Shufeng Kong
article en

Abstract

With the rapid expansion of online platforms, harmful speech has emerged as a critical issue, challenging mental health and social order. As the amount of online review and content posting generated daily continues to increase, there is a pressing need for developing automated systems/models to detect and address harmful speech. Despite the achievement of harmful speech detection models based on machine learning and deep learning, the challenges of accurately identifying harmful content still remain. This study thus investigates the application of Large Language Models (LLMs) for harmful speech detection. We fine-tuned three LLMs, Llama3.1, Qwen2, and Qwen2.5 using a meticulously curated dataset of harmful speech examples. The experimental results revealed that the improved models attained higher performance levels, achieving accuracy rates above 80 %. This highlights the potential of LLMs to identify complex language patterns and context effectively when detecting harmful content in the context of Chinese language. Our fine-tuned models contribute to fostering safer online environments, and this research will serve as a reference for future advancements in harmful speech detection systems/models.

Sun Yat-sen University (CN), Guilin University of Electronic Technology (CN)
Ministry of Education of the People's Republic of China
Reduced inequalities
Openalex Percentile: Top 61%
Educational Reforms and Innovations
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Exploratory Research on Harmful Speech Detection based on Large Language Models — Xuyang Guo, Caihua Liu, et al. · (2024) | TGRS Research Map | TGRS