LLM-PCDiff: LLM-Guided Physics-Constrained Diffusion Model for Data Augmentation in Imbalanced Bearing Fault Diagnosis
Abstract In industrial applications, the extreme imbalance in the distribution between healthy and faulty classes severely limit the generalization capabilities of diagnostic models. Generative Adversarial Networks (GANs) are susceptible to mode collapse, and while Stable Diffusion models can generate high-fidelity images, they lack the domain-specific prior knowledge required for bearing fault diagnosis. Consequently, this research introduces a novel data generation framework, termed the Large Language Model-guided Physics-Constrained Diffusion model (LLM-PCDiff). The proposed framework consists of three core components. First, features are extracted from vibration signals, and a Large Language Model (LLM) is fine-tuned using a lightweight Low-Rank Adaptation (LoRA) strategy. This enables the LLM to generate dual guidance information, comprising both semantic fault descriptions and soft labels. Second, a composite loss function is formulated by integrating physical constraints with a conditional Wasserstein distance, embedding the physical prior knowledge of bearing fault characteristic frequencies into the generative process. Finally, the Variational Autoencoder (VAE) and text encoder of the Stable Diffusion model are frozen, while only the noice prediction network undergoes parameter fine-tuning, leveraging time-frequency diagrams, prompt descriptions, and soft labels to optimize the generation parameters. Experimental results demonstrate that the sample quality of the LLM-PCDiff framework is significantly superior to that of both GAN-based and DDPM-based models. By synergizing the semantic understanding capabilities of LLMs with the high-quality generation capacity of an enhanced diffusion model, this study provides a novel data augmentation strategy for imbalanced bearing fault diagnosis.
Authors
- Youren Wang (ORCID: https://orcid.org/0000-0001-6196-6245)
- Zhang Zhai (ORCID: https://orcid.org/0009-0008-4581-9630)
- Yuehua Chen (ORCID: https://orcid.org/0009-0006-1343-7449)
- Zhen Xu (ORCID: https://orcid.org/0009-0009-4546-6086)
- Teng Xiong (ORCID: https://orcid.org/0009-0005-1149-0505)
Institutions
- Nanjing University of Aeronautics and Astronautics (CN)
Publication Details
- Journal
- Engineering Research Express
- Published
- 2026-11-17
- DOI
- https://doi.org/10.1088/2631-8695/aec368
- Primary Topic
- Machine Fault Diagnosis Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- National Major Science and Technology Projects of China