Nonlinear Activation Functions are Not Necessary: A Lightweight Nonlinear Activation Free Network Based on Multiscale Large Kernel Attention Mechanism for Fault Diagnosis

In recent years, there has been a notable advancement in the field of fault diagnosis, with the introduction of Transformer and Convolutional Neural Networks. These two approaches have demonstrated distinct advantages in global and local feature extraction, respectively. Nevertheless, the introduction of the multihead self-attention mechanism and cross-channel convolutional mechanism has led to a notable increase in the system complexity of the networks, resulting in higher hardware requirements, limited industry applications, and the potential for comparative analyses between methods to be hindered. Accordingly, this paper proposes a novel lightweight fault diagnosis framework, designated MSLKA-NAFNet, with the objective of addressing the limitations identified in current research. First, a plainNet is constructed using the most common components (e.g., convolutional blocks, ReLU, shot-cut); second, a multi-scale large kernel attention (MSLKA) mechanism is designed to extract the global information of the vibration signals through a large receptive field, which is added to the plainNet along with other state-of-the-art methodological components, to propose a simple and efficient baseline. To further simplify the network complexity, basic multiplication operations are used instead of nonlinear activation functions (e.g., Sigmoid, ReLU, GELU) to transform baseline into a nonlinear activation free network. The results on three challenging rotating machinery benchmark tests show that the proposed framework is not only more advantageous in terms of lightweight and robustness compared to state-of-the-art algorithms, but also proves that the nonlinear activation functions are non-essential for fault diagnosis tasks.