Nonparametric quantification of uncertainty in multistep upscaling approaches: A case study on estimating forest biomass in the Brazilian Amazon

The use of multistep upscaling approaches in which field data are combined with data from multiple remote sensors that operate at different spatial scales (e.g., UAV LiDAR, GEDI, and Landsat) is becoming increasingly popular. In these approaches, a series of models are fitted linking the information from these different sensors, often resulting in improved predictions over large areas. Quantifying the uncertainty associated with individual models can be challenging as these models may not generate uncertainty estimates (e.g., machine learning models such as random forest), a problem that is further exacerbated if the results from multiple models are combined within a multistep upscaling methodology. In this article, we describe a nonparametric conformal approach to quantify uncertainty. This approach is straight-forward to apply, is computationally inexpensive (differently from bootstrapping), and generates improved predictive intervals. Importantly, this methodology can be used regardless of the number of models adopted in the upscaling approach and the nature of the intermediate models, as long as the final model can generate predictive intervals. We illustrate the improved empirical coverage of the conformalized predictive intervals using simulated data for a two-step upscaling scenario involving field, UAV LiDAR, and Landsat data. This simulation exercise shows how increasing uncertainty in the first stage model (which relates biomass field data to UAV LiDAR data) leads to an increase in the severity of uncertainty underestimation by naïve predictive intervals. On the other hand, conformalized predictive intervals do not exhibit this shortcoming. Finally, we illustrate uncertainty quantification for a multistep upscaling methodology using data from a large-scale carbon project in the Brazilian Amazon. Our validation exercise using these empirical data confirms the improved performance of the conformalized predictive intervals. We expect that the conformal approach described here will be key for uncertainty quantification as multistep upscaling approaches become increasingly more common. • Multistep upscaling approaches are becoming increasingly popular • Uncertainty quantification (UQ) for these approaches is challenging • A nonparametric UQ methodology was developed for multistep upscaling approaches • UQ is illustrated for an upscaling approach with field, drone, and Landsat data • Our UQ methodology will find wide use in the RS community

Authors

Institutions

Publication Details

Journal
Science of Remote Sensing
Published
2024-12-07
DOI
https://doi.org/10.1016/j.srs.2024.100180
Citations
2
Primary Topic
Forest ecology and management
Type
article
Field-Weighted Citation Impact
1.38
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Nonparametric quantification of uncertainty in multistep upscaling approaches: A case study on estimating forest biomass in the Brazilian Amazon

Danilo Roberti Alves de Almeida, Leo Haneda, Rafael Izbicki, Silvio Henrique Menezes Gomes et al.
2 citations
Science of Remote Sensing
Forest ecology and management
1.38
article

Nonparametric quantification of uncertainty in multistep upscaling approaches: A case study on estimating forest biomass in the Brazilian Amazon

Danilo Roberti Alves de Almeida, Leo Haneda, Rafael Izbicki, Silvio Henrique Menezes Gomes, Bruna Marcacini Azevedo, Denis Valle, Renan Akio Kamimura, Carlos Alberto Silva, Arthur Sanchez
article en
2 citations

Abstract

The use of multistep upscaling approaches in which field data are combined with data from multiple remote sensors that operate at different spatial scales (e.g., UAV LiDAR, GEDI, and Landsat) is becoming increasingly popular. In these approaches, a series of models are fitted linking the information from these different sensors, often resulting in improved predictions over large areas. Quantifying the uncertainty associated with individual models can be challenging as these models may not generate uncertainty estimates (e.g., machine learning models such as random forest), a problem that is further exacerbated if the results from multiple models are combined within a multistep upscaling methodology. In this article, we describe a nonparametric conformal approach to quantify uncertainty. This approach is straight-forward to apply, is computationally inexpensive (differently from bootstrapping), and generates improved predictive intervals. Importantly, this methodology can be used regardless of the number of models adopted in the upscaling approach and the nature of the intermediate models, as long as the final model can generate predictive intervals. We illustrate the improved empirical coverage of the conformalized predictive intervals using simulated data for a two-step upscaling scenario involving field, UAV LiDAR, and Landsat data. This simulation exercise shows how increasing uncertainty in the first stage model (which relates biomass field data to UAV LiDAR data) leads to an increase in the severity of uncertainty underestimation by naïve predictive intervals. On the other hand, conformalized predictive intervals do not exhibit this shortcoming. Finally, we illustrate uncertainty quantification for a multistep upscaling methodology using data from a large-scale carbon project in the Brazilian Amazon. Our validation exercise using these empirical data confirms the improved performance of the conformalized predictive intervals. We expect that the conformal approach described here will be key for uncertainty quantification as multistep upscaling approaches become increasingly more common. • Multistep upscaling approaches are becoming increasingly popular • Uncertainty quantification (UQ) for these approaches is challenging • A nonparametric UQ methodology was developed for multistep upscaling approaches • UQ is illustrated for an upscaling approach with field, drone, and Landsat data • Our UQ methodology will find wide use in the RS community

Science of Remote SensingVol. 11
Universidade Federal de São Carlos (BR), Sugarcane Research Center (Brazil) (BR), University of Florida (US), Methodist University of Piracicaba (BR), Forest Science and Research Institute (BR)
Life in Land
Openalex Percentile: Top 17%
Forest ecology and management
1.38
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.