Debiased Contrastive Learning for Label Enhancement

Label Distribution Learning (LDL) is an effective paradigm for solving label ambiguity issues. When applying LDL, the specific label distribution dataset is often necessary. Unfortunately, most existing datasets include only logical label and obtaining label distribution is costly. To address this problem, Label Enhancement (LE) is used to recover label distribution from logical label. The existing LE methods only focus on mining label relevant information while neglecting the label irrelevant information. The learned label irrelevant information will confuse the prediction of model and reduce the performance and robustness. To address this limitation, we propose a novel LE method called Debiased Contrastive Learning for Label Enhancement (LE-DCL). Specifically, LE-DCL simultaneously learns label relevant information and removes label irrelevant information, which can improve the recovery performance and reduce the negative impact of irrelevant information. To help model identify relevant and irrelevant information accurately and prevent model overfitting, we also introduce a contrastive loss. Finally, we recover the label distribution based on the learned latent representation. Experiments on real-world datasets validate the effectiveness of our method.

Authors

Institutions

Publication Details

Published
2024-11-28
DOI
https://doi.org/10.1109/cbd65573.2024.00056
Primary Topic
Text and Document Classification Technologies
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Debiased Contrastive Learning for Label Enhancement

Jiaxi Zhang, Genlin Ji, Zilong Xu, Chao Tan et al.
Text and Document Classification Technologies
article

Debiased Contrastive Learning for Label Enhancement

Jiaxi Zhang, Genlin Ji, Zilong Xu, Chao Tan, Anning Song
article en

Abstract

Label Distribution Learning (LDL) is an effective paradigm for solving label ambiguity issues. When applying LDL, the specific label distribution dataset is often necessary. Unfortunately, most existing datasets include only logical label and obtaining label distribution is costly. To address this problem, Label Enhancement (LE) is used to recover label distribution from logical label. The existing LE methods only focus on mining label relevant information while neglecting the label irrelevant information. The learned label irrelevant information will confuse the prediction of model and reduce the performance and robustness. To address this limitation, we propose a novel LE method called Debiased Contrastive Learning for Label Enhancement (LE-DCL). Specifically, LE-DCL simultaneously learns label relevant information and removes label irrelevant information, which can improve the recovery performance and reduce the negative impact of irrelevant information. To help model identify relevant and irrelevant information accurately and prevent model overfitting, we also introduce a contrastive loss. Finally, we recover the label distribution based on the learned latent representation. Experiments on real-world datasets validate the effectiveness of our method.

Nanjing Normal University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 76%
Text and Document Classification Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Debiased Contrastive Learning for Label Enhancement — Jiaxi Zhang, Genlin Ji, et al. · (2024) | TGRS Research Map | TGRS