Comparison of Deep Learning Architectures for Fault Diagnosis of Cross-Speed Rotor Unbalance Based on Leave-One-Speed-Out Validation

Intelligent fault diagnosis of rotating machinery typically assumes that training and test data share the same operating speed, an assumption that rarely holds in industrial end-of-line testing, where a rotor must be certified across a range of shaft speeds. In this paper, we expose this assumption through a systematic benchmark of four deep learning architectures (TCN, 1D-CNN, BiLSTM, and CNN-BiLSTM) on a laboratory rotor testbench with three operating speeds (1000, 2000, and 3000 rpm) and four unbalance fault classes. Under within-speed 5-fold cross-validation, all four models achieve a perfect macro-F1 of 1.000, offering no basis for architecture selection. Under Leave-One-Speed-Out (LOSO) evaluation (train on two speeds, test on the held-out speed), performance drops substantially and diverges across models: BiLSTM 0.180, TCN 0.270, 1D-CNN 0.271, and CNN-BiLSTM 0.401. We trace the LOSO gap to the unbalance centrifugal force law F = meω2, which makes speed-confounded features unreliable under cross-speed testing. CNN-BiLSTM improves the mean LOSO macro-F1 by 48% relative to the stronger single-module baseline, 1D-CNN. Although CNN-BiLSTM achieves the highest LOSO performance among the evaluated architectures, it still does not surpass the physics-informed LightGBM baseline of 0.487. Therefore, the primary contribution of this work is not to solve cross-speed diagnosis, but to demonstrate that conventional same-speed evaluation substantially overestimates model capability and that LOSO provides a more deployment-relevant benchmark for future algorithm development.