A multi-scale and multi-modal convolutional neural network for condition monitoring of transmission line

Abstract Monitoring the fatigue damage of transmission lines is crucial for stable power system operation. However, existing model-driven methods face challenges such as high computational complexity and reliance on expert knowledge, while data-driven methods require large amounts of abnormal state data. To address these issues, a multi-scale and multi-modal convolutional neural network (CNN) is proposed for real-time condition monitoring of transmission lines. Key steps include: firstly, empirical Fourier decomposition is used to decompose the original signals, extracting multi-scale state information at different frequency scales. Then, time-domain, frequency-domain, and time–frequency domain analyses are performed on the decomposed signals to capture multi-modal information. Based on this, a multi-modal fusion network is proposed based on a CNN to extract shallow and deep features, with a fully connected layer used for multi-modal feature fusion. Notably, the algorithm is implemented on a microprocessor for practical application. Experimental results show that the proposed model achieves a diagnostic accuracy of 93.06%, outperforming classical networks. It also surpasses models trained solely on time, frequency, or time–frequency features by 25.18%, 21.8%, and 19.3%, respectively.