A Multihead ProbSparse Self-Attention Mechanism-Based High-Precision and High-Robustness Reconstruction Model for Missing Ocean Data
Ocean sensor networks (OSNs) can sense long-time series data, which plays a crucial role in tasks that rely on massive sensory data such as ocean ecosystem monitoring and maritime regulation. Unfortunately, ocean nodes are prone to failures, and harsh ocean channels, and natural environments can interfere with the data collection and transmission process, which can lead to large-scale loss of ocean sensory data. Based upon the comprehensive and in-depth analysis of the ocean’s time-varying dynamic environment, we proposed a multihead ProbSparse self-attention mechanism (MPSM)-based Model to predict and reconstruct missing ocean data. Specifically, MPSM can learn key features of ocean observation data on both sides of missing gaps with a dual encoder architecture. Subsequently, the MPSM can efficiently capture intersequence dependencies in parallel with lower computational complexity. Moreover, its residual connection will enhance the model’s expressive ability and alleviate gradient vanishing. Simulation experiment results demonstrate that the metrics of MPSM are lower than the selected benchmark algorithms on different ocean datasets, which means MPSM has a stronger robust and generalizability. MPSM can provide high-precision, low-latency missing data restoration capabilities for marine monitoring scenarios. It enhances the continuity and reliability of ocean observation systems.
Authors
- Jiangfeng Xian (ORCID: https://orcid.org/0000-0002-5141-9085)
- Xiaojun Mei (ORCID: https://orcid.org/0000-0002-1831-4329)
- Feng Wang (ORCID: https://orcid.org/0000-0002-0040-9290)
- Huafeng Wu (ORCID: https://orcid.org/0000-0002-3150-3407)
- Yu-Xuan Zhang (ORCID: https://orcid.org/0009-0005-8211-8639)
- Qiannan Zhang (ORCID: https://orcid.org/0000-0003-4846-7550)
- Kun Zhang (ORCID: https://orcid.org/0000-0003-0054-2099)
Institutions
- Harbin Engineering University (CN)
- Shanghai Maritime University (CN)
Publication Details
- Journal
- IEEE Sensors Journal
- Published
- 2025-02-28
- DOI
- https://doi.org/10.1109/jsen.2025.3543963
- Citations
- 3
- Primary Topic
- Geological and Geophysical Studies
- Type
- article
- Field-Weighted Citation Impact
- 7.04
Funders
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- National Key Research and Development Program of China