Confidence-aware semi-supervised siamese graph networks for semantic text similarity in low-resource Urdu

Accurate detection of semantically similar texts underpins applications such as plagiarism detection and content recommendation, yet remains challenging in low-resource languages like Urdu due to limited labeled data and noisy annotations. We introduce Siamese Graph-Based Semi-Supervised Learning (SGSSL), a framework that expands training diversity through back-translation and masked-word prediction, and learns from unlabeled data via confidence-aware pseudo-labeling with consistency regularization. At its core, SGSSL employs a Siamese Graph Neural Network that fuses Graph Convolutional Networks and Graph Attention Networks to capture fine-grained relational signals between sentences. A bottleneck feature-refinement layer and a Transformer Encoder with multi-head self-attention mitigate GNN over-smoothing while modeling long-range dependencies. We further leverage Urdu RoBERTa embeddings for deep contextual semantics. Our hybrid confidence-based filtering integrates probabilistic confidence, semantic similarity, and model uncertainty to select high-quality pseudo-labels. Evaluated on six benchmark datasets for text reuse and paraphrase detection (binary and ternary classification), SGSSL consistently outperforms strong baselines. On the USTRC dataset, SGSSL attains an accuracy of 0.722, an 8.1% absolute gain over the best baseline, demonstrating effectiveness for low-resource settings.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-06-17
DOI
https://doi.org/10.1038/s41598-026-50399-0
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Confidence-aware semi-supervised siamese graph networks for semantic text similarity in low-resource Urdu

Salahuddin Unar, Anil Ahmed, Degen Huang, Mobeen Nazar et al.
Scientific Reports
Natural Language Processing Techniques
article

Confidence-aware semi-supervised siamese graph networks for semantic text similarity in low-resource Urdu

Salahuddin Unar, Anil Ahmed, Degen Huang, Mobeen Nazar, Li Guo
article en

Abstract

Accurate detection of semantically similar texts underpins applications such as plagiarism detection and content recommendation, yet remains challenging in low-resource languages like Urdu due to limited labeled data and noisy annotations. We introduce Siamese Graph-Based Semi-Supervised Learning (SGSSL), a framework that expands training diversity through back-translation and masked-word prediction, and learns from unlabeled data via confidence-aware pseudo-labeling with consistency regularization. At its core, SGSSL employs a Siamese Graph Neural Network that fuses Graph Convolutional Networks and Graph Attention Networks to capture fine-grained relational signals between sentences. A bottleneck feature-refinement layer and a Transformer Encoder with multi-head self-attention mitigate GNN over-smoothing while modeling long-range dependencies. We further leverage Urdu RoBERTa embeddings for deep contextual semantics. Our hybrid confidence-based filtering integrates probabilistic confidence, semantic similarity, and model uncertainty to select high-quality pseudo-labels. Evaluated on six benchmark datasets for text reuse and paraphrase detection (binary and ternary classification), SGSSL consistently outperforms strong baselines. On the USTRC dataset, SGSSL attains an accuracy of 0.722, an 8.1% absolute gain over the best baseline, demonstrating effectiveness for low-resource settings.

Scientific Reports
Qilu University of Technology (CN), Yango University (CN), Wuyi University (CN), University of Kuala Lumpur (MY), Wuyi University (CN)
Openalex Percentile: Top 5%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.