Cross-domain adversarial transformer with soft-label filtering mechanism for unsupervised diagnosis of autoimmune diseases

• Raman spectroscopy provides rapid, non-invasive, and highly sensitive measurement capabilities. The unsupervised learning model developed in this study effectively leverages these features, enabling efficient disease classification without the need for extensive annotations, thereby broadening its clinical applications. • A novel domain adaptation framework was proposed to facilitate knowledge transfer among autoimmune diseases with diagnostic challenges. This framework enables unsupervised training of auxiliary diagnostic models for target diseases. • The proposed model incorporates cross-attention mechanisms for cross-domain feature extraction, introduces an innovative soft label filtering mechanism, and integrates an anti-learning module to mitigate category-biased prediction distributions in the target domain, achieving effective cross-domain feature alignment. With the growing application of artificial intelligence (AI) in medical diagnostics, there is an increasing demand for unsupervised models capable of operating with limited labeled data. Raman spectroscopy, renowned for its rapid and non-destructive measurement capabilities, faces significant challenges in clinical adoption due to the scarcity of reliable labels, particularly for complex conditions such as autoimmune diseases. This study introduces a cross-domain adversarial Transformer equipped with a soft-label filter to address these limitations. The model utilizes serum Raman spectra and incorporates an unsupervised domain adaptation algorithm, employing cross-attention for feature extraction and adversarial training for feature alignment. To mitigate category distribution bias in target domain predictions, a soft-label filter combining smooth labeling and dynamic thresholding is implemented, adaptively enhancing pseudo-label quality. Experimental results demonstrate the model's efficacy, achieving an average accuracy of 83.28 % across multiple autoimmune disease datasets, surpassing the best baseline by 15.42 %. Ablation studies confirm that the soft-label filter improves prediction balance, increasing F1 scores and G-means by 9.71 % and 7.64 %, respectively. This work presents a novel framework for unsupervised training in AI-assisted diagnostics and offers a practical solution to challenges in future research.

Authors

Institutions

Publication Details

Journal
Results in Engineering
Published
2025-09-01
DOI
https://doi.org/10.1016/j.rineng.2025.107070
Primary Topic
Spectroscopy Techniques in Biomedical and Chemical Research
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Cross-domain adversarial transformer with soft-label filtering mechanism for unsupervised diagnosis of autoimmune diseases

Xinya Chen, Wentao Qin, Zhiyuan Chen, Xiaoyi Lv et al.
Results in Engineering
Spectroscopy Techniques in Biomedical and Chemical Research
article

Cross-domain adversarial transformer with soft-label filtering mechanism for unsupervised diagnosis of autoimmune diseases

Xinya Chen, Wentao Qin, Zhiyuan Chen, Xiaoyi Lv, Yang Liu, Chen Chen, Cheng Chen, Xue Wu, Ziyang Zhang
article en

Abstract

• Raman spectroscopy provides rapid, non-invasive, and highly sensitive measurement capabilities. The unsupervised learning model developed in this study effectively leverages these features, enabling efficient disease classification without the need for extensive annotations, thereby broadening its clinical applications. • A novel domain adaptation framework was proposed to facilitate knowledge transfer among autoimmune diseases with diagnostic challenges. This framework enables unsupervised training of auxiliary diagnostic models for target diseases. • The proposed model incorporates cross-attention mechanisms for cross-domain feature extraction, introduces an innovative soft label filtering mechanism, and integrates an anti-learning module to mitigate category-biased prediction distributions in the target domain, achieving effective cross-domain feature alignment. With the growing application of artificial intelligence (AI) in medical diagnostics, there is an increasing demand for unsupervised models capable of operating with limited labeled data. Raman spectroscopy, renowned for its rapid and non-destructive measurement capabilities, faces significant challenges in clinical adoption due to the scarcity of reliable labels, particularly for complex conditions such as autoimmune diseases. This study introduces a cross-domain adversarial Transformer equipped with a soft-label filter to address these limitations. The model utilizes serum Raman spectra and incorporates an unsupervised domain adaptation algorithm, employing cross-attention for feature extraction and adversarial training for feature alignment. To mitigate category distribution bias in target domain predictions, a soft-label filter combining smooth labeling and dynamic thresholding is implemented, adaptively enhancing pseudo-label quality. Experimental results demonstrate the model's efficacy, achieving an average accuracy of 83.28 % across multiple autoimmune disease datasets, surpassing the best baseline by 15.42 %. Ablation studies confirm that the soft-label filter improves prediction balance, increasing F1 scores and G-means by 9.71 % and 7.64 %, respectively. This work presents a novel framework for unsupervised training in AI-assisted diagnostics and offers a practical solution to challenges in future research.

Results in EngineeringVol. 27
DHC Software (China) (CN), People's Hospital of Xinjiang Uygur Autonomous Region (CN), Karamay Central Hospital of Xinjiang (CN), Xinjiang University (CN)
Science and Technology Development Fund
Openalex Percentile: Top 84%
Spectroscopy Techniques in Biomedical and Chemical Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.