Enhancing Chinese Sarcasm Detection with a Large-Scale Manually Annotated Dataset and a Hybrid Deep Learning Model

Sarcasm detection is a critical aspect of sentiment analysis on social media platforms, where expressions often convey meanings that deviate from their literal interpretations. Traditional natural language processing (NLP) models struggle with sarcasm detection, as they frequently fail to capture the nuanced aspects of sentiment and contextual cues. Although Chinese is considered a high-resource language, detecting sarcasm remains challenging due to the absence of large-scale, annotated datasets and sarcasm's complex, context-dependent, and culturally nuanced nature. This paper presents a multi-dimensional approach to sarcasm detection in Chinese, effectively addressing these challenges. We introduce the Chinese TikTok Sarcasm Dataset (CTSD), a relatively large-scale, manually annotated collection of sarcastic comments sourced from Douyin (the Chinese version of TikTok), to address data scarcity. We demonstrate the effectiveness of the new dataset through extensive experiments using state-of-the-art models. Initially, we fine-tune several pre-trained language models (PLMs), and subsequently, we introduce a hybrid deep learning model, BERTWWM-CNN-BiLSTM, which combines the power of BERT-wwm for rich contextual embeddings, Convolutional Neural Networks (CNN) to capture local n-gram features, and Bidirectional Long Short-Term Memory Networks (BiLSTM) for learning long-range dependencies. Experimental results show that BERTWWM-CNN-BiLSTM outperforms baseline models, achieving an F1 score of 79.07% and an AUC of 85.51%, reflecting improvements of 3.58% and 10.63%, respectively. These findings highlight the potential of our approach in enhancing sarcasm detection in social media text.

Authors

Publication Details

Journal
Tsinghua Science & Technology
Published
2025-09-01
DOI
https://doi.org/10.26599/tst.2025.9010146
Primary Topic
Identification and Quantification in Food
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Chinese Sarcasm Detection with a Large-Scale Manually Annotated Dataset and a Hybrid Deep Learning Model

Kaibing Yang, Rafiul Haq, Yan Zeng, Zhao Xi-ping et al.
Tsinghua Science & Technology
Identification and Quantification in Food
article

Enhancing Chinese Sarcasm Detection with a Large-Scale Manually Annotated Dataset and a Hybrid Deep Learning Model

Kaibing Yang, Rafiul Haq, Yan Zeng, Zhao Xi-ping, Zixuan Wang, Wenqi Cao, Zhiyong Feng
article en

Abstract

Sarcasm detection is a critical aspect of sentiment analysis on social media platforms, where expressions often convey meanings that deviate from their literal interpretations. Traditional natural language processing (NLP) models struggle with sarcasm detection, as they frequently fail to capture the nuanced aspects of sentiment and contextual cues. Although Chinese is considered a high-resource language, detecting sarcasm remains challenging due to the absence of large-scale, annotated datasets and sarcasm's complex, context-dependent, and culturally nuanced nature. This paper presents a multi-dimensional approach to sarcasm detection in Chinese, effectively addressing these challenges. We introduce the Chinese TikTok Sarcasm Dataset (CTSD), a relatively large-scale, manually annotated collection of sarcastic comments sourced from Douyin (the Chinese version of TikTok), to address data scarcity. We demonstrate the effectiveness of the new dataset through extensive experiments using state-of-the-art models. Initially, we fine-tune several pre-trained language models (PLMs), and subsequently, we introduce a hybrid deep learning model, BERTWWM-CNN-BiLSTM, which combines the power of BERT-wwm for rich contextual embeddings, Convolutional Neural Networks (CNN) to capture local n-gram features, and Bidirectional Long Short-Term Memory Networks (BiLSTM) for learning long-range dependencies. Experimental results show that BERTWWM-CNN-BiLSTM outperforms baseline models, achieving an F1 score of 79.07% and an AUC of 85.51%, reflecting improvements of 3.58% and 10.63%, respectively. These findings highlight the potential of our approach in enhancing sarcasm detection in social media text.

Tsinghua Science & Technology
National Natural Science Foundation of China
Openalex Percentile: Top 78%
Identification and Quantification in Food
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Enhancing Chinese Sarcasm Detection with a Large-Scale Manually Annotated Dataset and a Hybrid Deep Learning Model — Kaibing Yang, Rafiul Haq, et al. · Tsinghua Science & Technology (2025) | TGRS Research Map | TGRS