A Noise-Weighted Unsupervised Denoising Approach for Distant Supervision Relation Extraction

Distant supervision relation extraction (DS-RE) provides an efficient way to construct large-scale training data by automatically aligning knowledge base relations with unstructured texts. However, this process inevitably introduces erroneous labels because sentences containing the same entity pair do not always express the corresponding knowledge base relations. To address this problem, this paper proposes a noise-weighted unsupervised denoising framework that integrates sentence-level prior confidence estimation, multi-factor representation learning, fine-grained noise detection, and clustering-based label generation. The framework first estimates noise-aware prior weights by matching sentence instances with semantically similar relation triples. It then incorporates lexical, positional, and entity-type factors to enhance sentence representations. For detected noisy instances, an unsupervised clustering-based label generation module is used to regenerate relation labels rather than directly discarding them. Experimental results on the DSRED dataset show that the proposed method achieves 89.7% Precision, 90.6% Recall, 90.1% F1-score, and a PR-AUC of 0.942±0.004, outperforming the strongest baseline EFEAPN by 1.7 percentage points in F1-score. Statistical analysis further shows that the PR-AUC improvement remains significant after Bonferroni correction (padj=0.0094). Module-level ablation experiments, sensitivity analysis, and clustering quality evaluation further verify the effectiveness of the noise weighting and clustering-based label generation modules. Supplementary experiments with Transformer-based encoders and cross-dataset evaluation further show that the main performance gain comes from the proposed denoising framework rather than from a specific sentence encoder.

Authors

Institutions

Publication Details

Journal
Symmetry
Published
2026-05-08
DOI
https://doi.org/10.3390/sym18050810
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Noise-Weighted Unsupervised Denoising Approach for Distant Supervision Relation Extraction

X C Liu, 郑茜聪, Liang Wang, Yue Wang et al.
Symmetry
Topic Modeling
article

A Noise-Weighted Unsupervised Denoising Approach for Distant Supervision Relation Extraction

X C Liu, 郑茜聪, Liang Wang, Yue Wang, Siyu Zhu, Yixuan Li, Jiayu Wu, Youde Du, Jiaping Chen
article en

Abstract

Distant supervision relation extraction (DS-RE) provides an efficient way to construct large-scale training data by automatically aligning knowledge base relations with unstructured texts. However, this process inevitably introduces erroneous labels because sentences containing the same entity pair do not always express the corresponding knowledge base relations. To address this problem, this paper proposes a noise-weighted unsupervised denoising framework that integrates sentence-level prior confidence estimation, multi-factor representation learning, fine-grained noise detection, and clustering-based label generation. The framework first estimates noise-aware prior weights by matching sentence instances with semantically similar relation triples. It then incorporates lexical, positional, and entity-type factors to enhance sentence representations. For detected noisy instances, an unsupervised clustering-based label generation module is used to regenerate relation labels rather than directly discarding them. Experimental results on the DSRED dataset show that the proposed method achieves 89.7% Precision, 90.6% Recall, 90.1% F1-score, and a PR-AUC of 0.942±0.004, outperforming the strongest baseline EFEAPN by 1.7 percentage points in F1-score. Statistical analysis further shows that the PR-AUC improvement remains significant after Bonferroni correction (padj=0.0094). Module-level ablation experiments, sensitivity analysis, and clustering quality evaluation further verify the effectiveness of the noise weighting and clustering-based label generation modules. Supplementary experiments with Transformer-based encoders and cross-dataset evaluation further show that the main performance gain comes from the proposed denoising framework rather than from a specific sentence encoder.

SymmetryVol. 18(5)
China Aerospace Science and Technology Corporation (CN), China Railway Shanghai Design Institute Group (China) (CN), China Railway Group (China) (CN), Jiangmen Polytechnic (CN), Beijing Information Science & Technology University (CN)
China Railway
Quality Education
Openalex Percentile: Top 5%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.