Research on Probabilistic Contrastive Learning and Quadratic Convolutional Neural Network for Intelligent Diagnosis of Long-Tailed Bearing Data

Deep learning methods have demonstrated impressive effectiveness in diagnosing bearing faults. Nevertheless, their performance tends to decline significantly in the presence of long-tailed distributions, where certain fault types are underrepresented, which is common in industrial environments where fault occurrences are rare. To address the challenges posed by long-tailed data in fault diagnosis, this paper proposes the Probabilistic Contrastive Quadratic Network (PCQNet), a novel framework designed to enhance the diagnostic capabilities of neural networks under class imbalance conditions. PCQNet consists of three core components: a quadratic convolutional residual network that strengthens feature representations through higher-order interactions; a Probabilistic Contrastive Loss (PCL) that models class features using the von Mises-Fisher (vMF) distribution, combining class expectations and prior probabilities to adaptively balance the contributions of each class, effectively mitigating long-tail bias; and a logit-adjusted cross-entropy loss that improves the discrimination ability for minority classes while enhancing classification fairness. The parabolic decay formula dynamically adjusts the dominance of these two loss functions during training, ensuring the model achieves both effective feature learning and accurate classification.The effectiveness of PCQNet is validated on one public dataset and two self-constructed datasets, demonstrating its superior performance in handling long-tailed data. Analysis of the attention mechanism derived from quadratic neurons further explains the excellent feature extraction capability of the quadratic network. Building on this analysis, ablation studies further verify the independent contributions and synergistic effects of each module, confirming their critical roles in improving diagnostic performance.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Instrumentation and Measurement
Published
2025-01-01
DOI
https://doi.org/10.1109/tim.2025.3619659
Citations
1
Primary Topic
Geoscience and Mining Technology
Type
article
Field-Weighted Citation Impact
1.30
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Probabilistic Contrastive Learning and Quadratic Convolutional Neural Network for Intelligent Diagnosis of Long-Tailed Bearing Data

Jiayu Yan, Liju Liu, yunheng chen, Zikang Cao et al.
1 citations
IEEE Transactions on Instrumentation and Measurement
Geoscience and Mining Technology
1.30
article

Research on Probabilistic Contrastive Learning and Quadratic Convolutional Neural Network for Intelligent Diagnosis of Long-Tailed Bearing Data

Jiayu Yan, Liju Liu, yunheng chen, Zikang Cao, Haorong Wu, Baozhu Zhao, Yushuo Tan, Wenbin Zhang, Han Xu, Yue Lu
article en
1 citations

Abstract

Deep learning methods have demonstrated impressive effectiveness in diagnosing bearing faults. Nevertheless, their performance tends to decline significantly in the presence of long-tailed distributions, where certain fault types are underrepresented, which is common in industrial environments where fault occurrences are rare. To address the challenges posed by long-tailed data in fault diagnosis, this paper proposes the Probabilistic Contrastive Quadratic Network (PCQNet), a novel framework designed to enhance the diagnostic capabilities of neural networks under class imbalance conditions. PCQNet consists of three core components: a quadratic convolutional residual network that strengthens feature representations through higher-order interactions; a Probabilistic Contrastive Loss (PCL) that models class features using the von Mises-Fisher (vMF) distribution, combining class expectations and prior probabilities to adaptively balance the contributions of each class, effectively mitigating long-tail bias; and a logit-adjusted cross-entropy loss that improves the discrimination ability for minority classes while enhancing classification fairness. The parabolic decay formula dynamically adjusts the dominance of these two loss functions during training, ensuring the model achieves both effective feature learning and accurate classification.The effectiveness of PCQNet is validated on one public dataset and two self-constructed datasets, demonstrating its superior performance in handling long-tailed data. Analysis of the attention mechanism derived from quadratic neurons further explains the excellent feature extraction capability of the quadratic network. Building on this analysis, ablation studies further verify the independent contributions and synergistic effects of each module, confirming their critical roles in improving diagnostic performance.

IEEE Transactions on Instrumentation and MeasurementVol. 74
Kunming University of Science and Technology (CN), Kunming University (CN), Xidian University (CN), Shijiazhuang University (CN)
Openalex Percentile: Top 16%
Geoscience and Mining Technology
1.30
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.