Comparison of indicators to evaluate the performance of climate models

Abstract The evaluation of climate models is a crucial step in climate studies. It consists of quantifying the resemblance of model outputs to reference data to identify models with superior capacity to replicate specific climate variables. Clearly, the choice of the evaluation indicator significantly impacts the results, underscoring the importance of selecting an indicator that properly captures the characteristics of a “good model”. This study examines the behaviour of six indicators, considering spatial correlation, distribution mean, variance and shape. Monthly data for precipitation, temperature and teleconnection patterns in Central America were utilized in the analysis. A new multicomponent measure was selected based on these criteria to assess the performance of 32 CMIP6 models in reproducing the annual seasonal cycle of these variables. The top six models were determined using multicriteria methods. It was found that even the best model reproduces one derived climatic variable poorly in this region. The proposed measure and selection method can contribute to enhancing the accuracy of climatological research based on climate models.

Authors

Institutions

Publication Details

Journal
International Journal of Climatology
Published
2024-10-07
DOI
https://doi.org/10.1002/joc.8619
Citations
1
Primary Topic
Climate variability and models
Type
article
Field-Weighted Citation Impact
0.28
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparison of indicators to evaluate the performance of climate models

Hugo G. Hidalgo, Mario J. Gómez, Luis A. Barboza, Eric J. Alfaro
1 citations
International Journal of Climatology
Climate variability and models
0.28
article

Comparison of indicators to evaluate the performance of climate models

Hugo G. Hidalgo, Mario J. Gómez, Luis A. Barboza, Eric J. Alfaro
article en
1 citations

Abstract

Abstract The evaluation of climate models is a crucial step in climate studies. It consists of quantifying the resemblance of model outputs to reference data to identify models with superior capacity to replicate specific climate variables. Clearly, the choice of the evaluation indicator significantly impacts the results, underscoring the importance of selecting an indicator that properly captures the characteristics of a “good model”. This study examines the behaviour of six indicators, considering spatial correlation, distribution mean, variance and shape. Monthly data for precipitation, temperature and teleconnection patterns in Central America were utilized in the analysis. A new multicomponent measure was selected based on these criteria to assess the performance of 32 CMIP6 models in reproducing the annual seasonal cycle of these variables. The top six models were determined using multicriteria methods. It was found that even the best model reproduces one derived climatic variable poorly in this region. The proposed measure and selection method can contribute to enhancing the accuracy of climatological research based on climate models.

International Journal of ClimatologyVol. 44(13)
Universidad de Costa Rica (CR)
Climate action
Openalex Percentile: Top 41%
Climate variability and models
0.28
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.