Rethinking success and quality in ecological forecasting

Ecological forecasts are increasingly required to inform science, policy and action in the face of rapid environmental and societal change. However, differences in how developers and end-users judge the value of ecological forecasts may limit their utility and uptake in real-world decision-making. Here, we use a participatory approach to propose a novel, holistic framework for the evaluation of ecological forecasts along two intersecting axes: quality and success. Quality is defined by the defensible development and predictive performance of ecological forecasts, while success captures the usefulness of a forecast in achieving its intended aim. We propose twelve shared criteria for evaluating quality and success spanning the forecasting process, set-up, and outputs while capturing forecast development, communication, performance, and operationality. Together, these criteria provide a common basis for the co-development of ecological forecasts, and better connect science with forecast-informed decision-making.

Authors

Institutions

Publication Details

Published
2026-10-28
DOI
https://doi.org/10.32942/x24m6b
Primary Topic
Forecasting Techniques and Applications
Type
preprint

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Rethinking success and quality in ecological forecasting

Sandro Bertolino, Luke C. Evans, Valentin Journé, Nigel G. Yoccoz et al.
2 links
Forecasting Techniques and Applications
preprint

Rethinking success and quality in ecological forecasting

Sandro Bertolino, Luke C. Evans, Valentin Journé, Nigel G. Yoccoz, James W. Pearce‐Higgins, Cara A. Gallagher, Emily G. Simmonds, Solène Marion, Gerbrand Koren, Joe F. Langley, Adam Devenish, Maria Paniw, Victoria Boult
preprint en

Abstract

Ecological forecasts are increasingly required to inform science, policy and action in the face of rapid environmental and societal change. However, differences in how developers and end-users judge the value of ecological forecasts may limit their utility and uptake in real-world decision-making. Here, we use a participatory approach to propose a novel, holistic framework for the evaluation of ecological forecasts along two intersecting axes: quality and success. Quality is defined by the defensible development and predictive performance of ecological forecasts, while success captures the usefulness of a forecast in achieving its intended aim. We propose twelve shared criteria for evaluating quality and success spanning the forecasting process, set-up, and outputs while capturing forecast development, communication, performance, and operationality. Together, these criteria provide a common basis for the co-development of ecological forecasts, and better connect science with forecast-informed decision-making.

Consejo Superior de Investigaciones Científicas (ES), Royal Society for the Protection of Birds (GB), Kyushu University (JP), Royal Botanic Garden Edinburgh (GB), Utrecht University (NL), Aarhus University (DK), Joint Nature Conservation Committee (GB), Estación Biológica de Doñana (ES), UK Centre for Ecology & Hydrology (GB), Conservation Leadership Programme (GB), University of Turin (IT), University of Reading (GB), UiT The Arctic University of Norway (NO), University of Edinburgh (GB)
British Ecological Society, European Commission, University of Edinburgh, Norges Forskningsråd, Directorate for Biological Sciences, HORIZON EUROPE Framework Programme, Agencia Estatal de Investigación, NextGenerationEU
Life on land
Forecasting Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon