A Hybrid Attention-Enhanced Transformer for Short-Term Attitude Vibration Prediction of Robotic Aerial Work Platforms

Robotic Aerial Work Platforms (RAWPs) are subjected to multi-source excitations including wind gusts and inertial loads, which result in strongly nonlinear and time-varying coupled triaxial attitude vibrations. Conventional recurrent architectures such as LSTM and GRU suffer from gradient vanishing when processing long sequences, while Transformer utilize self-attention mechanisms to learn simple periodic correlations; however, the vibrations in RAWPs exhibit a complex time-series pattern composed of low-frequency oscillations superimposed with high-frequency impacts and accumulates errors through autoregressive decoding. To address these limitations, this paper proposes an improved Transformer model featuring dual-channel periodic positional encoding and global–local hybrid multi-head attention for one-shot multi-step long-sequence prediction of RAWPs attitude vibrations. The proposed method designs a dual-channel independent sine–cosine positional encoding with a tunable periodic modulation factor to explicitly embed the multi-scale periodicity priors of vibration signals and introduces a global–local hybrid attention mechanism that parallelly extracts transient amplitude impact features in the time domain and periodic fluctuation features in the frequency domain. A full-scale aerial experimental platform is established to collect triaxial vibration data under two operating conditions at a sampling frequency of 20 Hz. The results determine the optimal periodic modulation factor and input window length, and ablation studies validate the synergistic gains of the two proposed modules. Comparative results demonstrate that the proposed model achieves substantially reduced prediction errors. In terms of pitch angle, the proposed model achieves a performance improvement of 53.89% over Transformer, 52.11% over LSTM, and 57.67% over GRU. The proposed model effectively provides a reliable data-driven prediction framework for attitude monitoring and active vibration suppression of aerial work platforms.

Authors

Institutions

Publication Details

Journal
Machines
Published
2026-08-25
DOI
https://doi.org/10.3390/machines14090964
Primary Topic
Machine Fault Diagnosis Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Hybrid Attention-Enhanced Transformer for Short-Term Attitude Vibration Prediction of Robotic Aerial Work Platforms

Mingming Lv, Mengyao Si, Wei Zhong, Jiayu Guo et al.
Machines
Machine Fault Diagnosis Techniques
article

A Hybrid Attention-Enhanced Transformer for Short-Term Attitude Vibration Prediction of Robotic Aerial Work Platforms

Mingming Lv, Mengyao Si, Wei Zhong, Jiayu Guo, Haonan Hu
article en

Abstract

Robotic Aerial Work Platforms (RAWPs) are subjected to multi-source excitations including wind gusts and inertial loads, which result in strongly nonlinear and time-varying coupled triaxial attitude vibrations. Conventional recurrent architectures such as LSTM and GRU suffer from gradient vanishing when processing long sequences, while Transformer utilize self-attention mechanisms to learn simple periodic correlations; however, the vibrations in RAWPs exhibit a complex time-series pattern composed of low-frequency oscillations superimposed with high-frequency impacts and accumulates errors through autoregressive decoding. To address these limitations, this paper proposes an improved Transformer model featuring dual-channel periodic positional encoding and global–local hybrid multi-head attention for one-shot multi-step long-sequence prediction of RAWPs attitude vibrations. The proposed method designs a dual-channel independent sine–cosine positional encoding with a tunable periodic modulation factor to explicitly embed the multi-scale periodicity priors of vibration signals and introduces a global–local hybrid attention mechanism that parallelly extracts transient amplitude impact features in the time domain and periodic fluctuation features in the frequency domain. A full-scale aerial experimental platform is established to collect triaxial vibration data under two operating conditions at a sampling frequency of 20 Hz. The results determine the optimal periodic modulation factor and input window length, and ablation studies validate the synergistic gains of the two proposed modules. Comparative results demonstrate that the proposed model achieves substantially reduced prediction errors. In terms of pitch angle, the proposed model achieves a performance improvement of 53.89% over Transformer, 52.11% over LSTM, and 57.67% over GRU. The proposed model effectively provides a reliable data-driven prediction framework for attitude monitoring and active vibration suppression of aerial work platforms.

MachinesVol. 14(9)
Jiangsu University of Science and Technology (CN), Heilongjiang Academy of Agricultural Machinery Engineering (CN)
Affordable and clean energy
Openalex Percentile: Top 14%
Machine Fault Diagnosis Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.