Enhanced Fault Diagnosis Using Large Language Models and Probabilistic Label Fusion
Fault diagnosis is crucial for ensuring the reliability of manufacturing systems. However, a large proportion of unlabeled data remains unused, which presents a challenge that limits fault diagnosis performance. While some semi-supervised methods focus on leveraging unlabeled data, they rely solely on statistical properties and lack domain knowledge, leading to performance bottlenecks. In this paper, we propose a fault diagnosis framework that leverages Large Language Models (LLMs), which contain vast amounts of prior knowledge, to enhance Classification performance. We train a base classifier on labeled data, generate pseudo-labels for unlabeled data, and fine-tune LLaMA3 to infer another set of pseudo-labels. By merging these labels and adjusting sample weights, we create an augmented training set, which improves model performance. Our approach outperforms traditional methods as demonstrated on the Tennessee Eastman Process dataset.
Authors
- Shanshan Yao (ORCID: https://orcid.org/0000-0002-2076-162X)
- P. Wang (ORCID: https://orcid.org/0000-0001-9353-6952)
- Jiayu Shi (ORCID: https://orcid.org/0009-0006-6491-4719)
- Qunlong Chen (ORCID: https://orcid.org/0009-0002-6481-3054)
- Weiwei He
- Jing Li (ORCID: https://orcid.org/0000-0001-7538-246X)
- Qin Wei (ORCID: https://orcid.org/0000-0002-0450-8771)
- Jian Wang (ORCID: https://orcid.org/0000-0002-8494-154X)
Institutions
- Shanghai International Studies University (CN)
- Shanghai Jiao Tong University (CN)
Publication Details
- Journal
- IFAC-PapersOnLine
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1016/j.ifacol.2025.09.401
- Primary Topic
- Machine Fault Diagnosis Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00