Cross-domain adversarial transformer with soft-label filtering mechanism for unsupervised diagnosis of autoimmune diseases
• Raman spectroscopy provides rapid, non-invasive, and highly sensitive measurement capabilities. The unsupervised learning model developed in this study effectively leverages these features, enabling efficient disease classification without the need for extensive annotations, thereby broadening its clinical applications. • A novel domain adaptation framework was proposed to facilitate knowledge transfer among autoimmune diseases with diagnostic challenges. This framework enables unsupervised training of auxiliary diagnostic models for target diseases. • The proposed model incorporates cross-attention mechanisms for cross-domain feature extraction, introduces an innovative soft label filtering mechanism, and integrates an anti-learning module to mitigate category-biased prediction distributions in the target domain, achieving effective cross-domain feature alignment. With the growing application of artificial intelligence (AI) in medical diagnostics, there is an increasing demand for unsupervised models capable of operating with limited labeled data. Raman spectroscopy, renowned for its rapid and non-destructive measurement capabilities, faces significant challenges in clinical adoption due to the scarcity of reliable labels, particularly for complex conditions such as autoimmune diseases. This study introduces a cross-domain adversarial Transformer equipped with a soft-label filter to address these limitations. The model utilizes serum Raman spectra and incorporates an unsupervised domain adaptation algorithm, employing cross-attention for feature extraction and adversarial training for feature alignment. To mitigate category distribution bias in target domain predictions, a soft-label filter combining smooth labeling and dynamic thresholding is implemented, adaptively enhancing pseudo-label quality. Experimental results demonstrate the model's efficacy, achieving an average accuracy of 83.28 % across multiple autoimmune disease datasets, surpassing the best baseline by 15.42 %. Ablation studies confirm that the soft-label filter improves prediction balance, increasing F1 scores and G-means by 9.71 % and 7.64 %, respectively. This work presents a novel framework for unsupervised training in AI-assisted diagnostics and offers a practical solution to challenges in future research.
Authors
- Xinya Chen (ORCID: https://orcid.org/0009-0005-3072-5568)
- Wentao Qin (ORCID: https://orcid.org/0000-0002-3422-6599)
- Zhiyuan Chen (ORCID: https://orcid.org/0000-0001-9897-8848)
- Xiaoyi Lv (ORCID: https://orcid.org/0000-0001-6855-7428)
- Yang Liu (ORCID: https://orcid.org/0000-0002-0857-9905)
- Chen Chen (ORCID: https://orcid.org/0000-0003-1406-5721)
- Cheng Chen (ORCID: https://orcid.org/0000-0001-9773-2993)
- Xue Wu (ORCID: https://orcid.org/0000-0002-4800-8226)
- Ziyang Zhang (ORCID: https://orcid.org/0000-0001-9543-2567)
Institutions
- DHC Software (China) (CN)
- People's Hospital of Xinjiang Uygur Autonomous Region (CN)
- Karamay Central Hospital of Xinjiang (CN)
- Xinjiang University (CN)
Publication Details
- Journal
- Results in Engineering
- Published
- 2025-09-01
- DOI
- https://doi.org/10.1016/j.rineng.2025.107070
- Primary Topic
- Spectroscopy Techniques in Biomedical and Chemical Research
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Science and Technology Development Fund