Machine Learning Reveals Hidden Bias in ERA5 Cloud Heights Over Earth's Third Pole

Abstract Accurate cloud base height (CBH) over the Tibetan Plateau—Earth's Third Pole—is essential for monsoon dynamics, glacial melt, and water security, yet ERA5 systematically underestimates it. Here, we present a two‐step machine learning framework to mitigate this hidden bias. Step 1 refines the ERA5 diagnostic informed by 3 years of ground‐based Lidar observations (October 2021–December 2024), reducing the site‐level MBE from 1.8 to 0.1 km and improving the regional correlation with CALIPSO from 0.25 to 0.40. Step 2 applies an Optuna‐optimized XGBoost model trained on high‐confidence CALIPSO observations, fusing the refined ERA5 data with vertical atmospheric profiles and surface attributes. The final product achieved a test‐set RMSE of 1.87 km ( R 2 = 0.71, MBE = −0.02 km), with seasonal correlations reaching 0.72–0.86 and southern plateau bias reduced to −0.11 km, a 97.9% improvement. This approach enables reliable, long‐term CBH reconstruction, key to better climate modeling and water assessments across High Mountain Asia.

Authors

Institutions

Publication Details

Journal
Geophysical Research Letters
Published
2026-05-12
DOI
https://doi.org/10.1029/2025gl121301
Primary Topic
Atmospheric aerosols and clouds
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Machine Learning Reveals Hidden Bias in ERA5 Cloud Heights Over Earth's Third Pole

Lu Pan, D. R. Lu, Yan Qiu, Yue Wang et al.
Geophysical Research Letters
Atmospheric aerosols and clouds
article

Machine Learning Reveals Hidden Bias in ERA5 Cloud Heights Over Earth's Third Pole

Lu Pan, D. R. Lu, Yan Qiu, Yue Wang, Y.H. BI, Y Tian, X. Wu, Y. B. Pan, W. Zhao, T. Q. Wang
article en

Abstract

Abstract Accurate cloud base height (CBH) over the Tibetan Plateau—Earth's Third Pole—is essential for monsoon dynamics, glacial melt, and water security, yet ERA5 systematically underestimates it. Here, we present a two‐step machine learning framework to mitigate this hidden bias. Step 1 refines the ERA5 diagnostic informed by 3 years of ground‐based Lidar observations (October 2021–December 2024), reducing the site‐level MBE from 1.8 to 0.1 km and improving the regional correlation with CALIPSO from 0.25 to 0.40. Step 2 applies an Optuna‐optimized XGBoost model trained on high‐confidence CALIPSO observations, fusing the refined ERA5 data with vertical atmospheric profiles and surface attributes. The final product achieved a test‐set RMSE of 1.87 km ( R 2 = 0.71, MBE = −0.02 km), with seasonal correlations reaching 0.72–0.86 and southern plateau bias reduced to −0.11 km, a 97.9% improvement. This approach enables reliable, long‐term CBH reconstruction, key to better climate modeling and water assessments across High Mountain Asia.

Geophysical Research LettersVol. 53(10)
China Meteorological Administration (CN), Chengdu University of Information Technology (CN), Institute of Atmospheric Physics (CN), University of Chinese Academy of Sciences (CN)
National Natural Science Foundation of China
Climate action
Openalex Percentile: Top 5%
Atmospheric aerosols and clouds
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Machine Learning Reveals Hidden Bias in ERA5 Cloud Heights Over Earth's Third Pole — Lu Pan, D. R. Lu, et al. · Geophysical Research Letters (2026) | TGRS Research Map | TGRS