Hydroformer: Frequency Domain Enhanced Multi‐Attention Transformer for Monthly Lake Level Reconstruction With Low Data Input Requirements

Abstract Lake level changes are critical indicators of hydrological balance and climate change, yet long‐term monthly lake level reconstruction is challenging with incomplete or short‐term data. Data‐driven models, while promising, struggle with nonstationary lake level changes and complex dependencies on meteorological factors, limiting their applicability. Here, we introduce the Hydroformer, a frequency domain enhanced multi‐attention Transformer model designed for monthly lake level reconstruction, utilizing reanalysis data. This model features two innovative mechanisms: (a) Frequency‐Enhanced Attention (FEA) for capturing long‐term temporal dependence, and (b) Causality‐based Cross‐dimensional Attention (CCA) to elucidate how specific meteorological factors influence lake level. Seasonal and trend patterns of catchment meteorological factors and lake level are initially identified by a time series decomposition block, then independently learned and refined within the model. Tested across 50 lakes globally, the Hydroformer excelled in reconstruction periods ranging from half to three times the training‐test length. The model exhibited good performance even when training data missing rates were below 50%, particularly in lakes with significant seasonal fluctuations. The Hydroformer demonstrated robust generalization across lakes of varying sizes, from 10.11 to 18,135 km 2 , with median values for R 2 , MAE, MSE, and RMSE at 0.813, 0.313, 0.215, and 0.4, respectively. Furthermore, the Hydroformer outperformed data‐driven models, improving MSE by 29.2% and MAE by 24.4% compared to the next best model, the FEDformer. Our method proposes a novel approach for reconstructing long‐term water level changes and managing lake resources under climate change.

Authors

Institutions

Publication Details

Journal
Water Resources Research
Published
2024-09-30
DOI
https://doi.org/10.1029/2024wr037166
Citations
12
Primary Topic
Underwater Acoustics Research
Type
article
Field-Weighted Citation Impact
5.77

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Hydroformer: Frequency Domain Enhanced Multi‐Attention Transformer for Monthly Lake Level Reconstruction With Low Data Input Requirements

Jiahua Wei, Shengling Hou, Yue Wu, Yang Shi et al.
12 citations
Water Resources Research
Underwater Acoustics Research
5.77
article

Hydroformer: Frequency Domain Enhanced Multi‐Attention Transformer for Monthly Lake Level Reconstruction With Low Data Input Requirements

Jiahua Wei, Shengling Hou, Yue Wu, Yang Shi, Wenqian Zhang, Jiaqi Xu, He Wang, Minglei Hou
article en
12 citations

Abstract

Abstract Lake level changes are critical indicators of hydrological balance and climate change, yet long‐term monthly lake level reconstruction is challenging with incomplete or short‐term data. Data‐driven models, while promising, struggle with nonstationary lake level changes and complex dependencies on meteorological factors, limiting their applicability. Here, we introduce the Hydroformer, a frequency domain enhanced multi‐attention Transformer model designed for monthly lake level reconstruction, utilizing reanalysis data. This model features two innovative mechanisms: (a) Frequency‐Enhanced Attention (FEA) for capturing long‐term temporal dependence, and (b) Causality‐based Cross‐dimensional Attention (CCA) to elucidate how specific meteorological factors influence lake level. Seasonal and trend patterns of catchment meteorological factors and lake level are initially identified by a time series decomposition block, then independently learned and refined within the model. Tested across 50 lakes globally, the Hydroformer excelled in reconstruction periods ranging from half to three times the training‐test length. The model exhibited good performance even when training data missing rates were below 50%, particularly in lakes with significant seasonal fluctuations. The Hydroformer demonstrated robust generalization across lakes of varying sizes, from 10.11 to 18,135 km 2 , with median values for R 2 , MAE, MSE, and RMSE at 0.813, 0.313, 0.215, and 0.4, respectively. Furthermore, the Hydroformer outperformed data‐driven models, improving MSE by 29.2% and MAE by 24.4% compared to the next best model, the FEDformer. Our method proposes a novel approach for reconstructing long‐term water level changes and managing lake resources under climate change.

Water Resources ResearchVol. 60(10)
Qinghai University (CN), Ministry of Water Resources of the People's Republic of China (CN), Tsinghua University (CN)
National Natural Science Foundation of China, National Key Research and Development Program of China
Openalex Percentile: Top 3%
Underwater Acoustics Research
5.77
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.