CDCM: A counterfactual debiased calibration method based on knowledge distillation for stance detection

The stance detection task aims to accurately identify users' attitudes toward specific targets in social media texts. Recent knowledge distillation methods have shown promise by leveraging inter-class relational information from soft labels. However, they often overlook unintended bias-high-frequency and sentiment words-in training data, causing teacher models to over-rely on shallow lexical cues and weakening semantic learning. To address this, we propose CDCM, a counterfactual debiasing calibration method based on knowledge distillation. CDCM formulates stance detection within a structural causal model, identifies confounders, and uses factual-counterfactual reasoning to extract and remove bias via element-wise subtraction. Moreover, we design an adaptive sentiment lexicon construction strategy and a high-frequency feature threshold mechanism to mitigate lexical interference. Experimental results show that the CDCM algorithm effectively improves the performance.

Institutions

Publication Details

Journal
iScience
Published
2025-12-19
DOI
https://doi.org/10.1016/j.isci.2025.114473
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CDCM: A counterfactual debiased calibration method based on knowledge distillation for stance detection

iScience
Sentiment Analysis and Opinion Mining
article

CDCM: A counterfactual debiased calibration method based on knowledge distillation for stance detection

article en

Abstract

The stance detection task aims to accurately identify users' attitudes toward specific targets in social media texts. Recent knowledge distillation methods have shown promise by leveraging inter-class relational information from soft labels. However, they often overlook unintended bias-high-frequency and sentiment words-in training data, causing teacher models to over-rely on shallow lexical cues and weakening semantic learning. To address this, we propose CDCM, a counterfactual debiasing calibration method based on knowledge distillation. CDCM formulates stance detection within a structural causal model, identifies confounders, and uses factual-counterfactual reasoning to extract and remove bias via element-wise subtraction. Moreover, we design an adaptive sentiment lexicon construction strategy and a high-frequency feature threshold mechanism to mitigate lexical interference. Experimental results show that the CDCM algorithm effectively improves the performance.

iScienceVol. 29(2)
Xinjiang University (CN), Tsinghua University (CN)
Quality Education
Openalex Percentile: Top 19%
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

CDCM: A counterfactual debiased calibration method based on knowledge distillation for stance detection · iScience (2025) | TGRS Research Map | TGRS