LLM-PCDiff: LLM-Guided Physics-Constrained Diffusion Model for Data Augmentation in Imbalanced Bearing Fault Diagnosis

Abstract In industrial applications, the extreme imbalance in the distribution between healthy and faulty classes severely limit the generalization capabilities of diagnostic models. Generative Adversarial Networks (GANs) are susceptible to mode collapse, and while Stable Diffusion models can generate high-fidelity images, they lack the domain-specific prior knowledge required for bearing fault diagnosis. Consequently, this research introduces a novel data generation framework, termed the Large Language Model-guided Physics-Constrained Diffusion model (LLM-PCDiff). The proposed framework consists of three core components. First, features are extracted from vibration signals, and a Large Language Model (LLM) is fine-tuned using a lightweight Low-Rank Adaptation (LoRA) strategy. This enables the LLM to generate dual guidance information, comprising both semantic fault descriptions and soft labels. Second, a composite loss function is formulated by integrating physical constraints with a conditional Wasserstein distance, embedding the physical prior knowledge of bearing fault characteristic frequencies into the generative process. Finally, the Variational Autoencoder (VAE) and text encoder of the Stable Diffusion model are frozen, while only the noice prediction network undergoes parameter fine-tuning, leveraging time-frequency diagrams, prompt descriptions, and soft labels to optimize the generation parameters. Experimental results demonstrate that the sample quality of the LLM-PCDiff framework is significantly superior to that of both GAN-based and DDPM-based models. By synergizing the semantic understanding capabilities of LLMs with the high-quality generation capacity of an enhanced diffusion model, this study provides a novel data augmentation strategy for imbalanced bearing fault diagnosis.

Authors

Institutions

Publication Details

Journal
Engineering Research Express
Published
2026-11-17
DOI
https://doi.org/10.1088/2631-8695/aec368
Primary Topic
Machine Fault Diagnosis Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

LLM-PCDiff: LLM-Guided Physics-Constrained Diffusion Model for Data Augmentation in Imbalanced Bearing Fault Diagnosis

Youren Wang, Zhang Zhai, Yuehua Chen, Zhen Xu et al.
5 links
Engineering Research Express
Machine Fault Diagnosis Techniques
article

LLM-PCDiff: LLM-Guided Physics-Constrained Diffusion Model for Data Augmentation in Imbalanced Bearing Fault Diagnosis

Youren Wang, Zhang Zhai, Yuehua Chen, Zhen Xu, Teng Xiong
article en

Abstract

Abstract In industrial applications, the extreme imbalance in the distribution between healthy and faulty classes severely limit the generalization capabilities of diagnostic models. Generative Adversarial Networks (GANs) are susceptible to mode collapse, and while Stable Diffusion models can generate high-fidelity images, they lack the domain-specific prior knowledge required for bearing fault diagnosis. Consequently, this research introduces a novel data generation framework, termed the Large Language Model-guided Physics-Constrained Diffusion model (LLM-PCDiff). The proposed framework consists of three core components. First, features are extracted from vibration signals, and a Large Language Model (LLM) is fine-tuned using a lightweight Low-Rank Adaptation (LoRA) strategy. This enables the LLM to generate dual guidance information, comprising both semantic fault descriptions and soft labels. Second, a composite loss function is formulated by integrating physical constraints with a conditional Wasserstein distance, embedding the physical prior knowledge of bearing fault characteristic frequencies into the generative process. Finally, the Variational Autoencoder (VAE) and text encoder of the Stable Diffusion model are frozen, while only the noice prediction network undergoes parameter fine-tuning, leveraging time-frequency diagrams, prompt descriptions, and soft labels to optimize the generation parameters. Experimental results demonstrate that the sample quality of the LLM-PCDiff framework is significantly superior to that of both GAN-based and DDPM-based models. By synergizing the semantic understanding capabilities of LLMs with the high-quality generation capacity of an enhanced diffusion model, this study provides a novel data augmentation strategy for imbalanced bearing fault diagnosis.

Engineering Research Express
Nanjing University of Aeronautics and Astronautics (CN)
National Natural Science Foundation of China, National Major Science and Technology Projects of China
Machine Fault Diagnosis Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon