Global sensitivity analyses for test planning with black‐box models for Mars Sample Return

This work describes sensitivity analyses performed on complex black-box models used to support experimental test planning under limited resources in the context of the Mars Sample Return program, which aims at bringing to Earth rock, regolith, and atmospheric samples from Mars. We develop a systematic workflow that allows the analysts to simultaneously obtain quantitative insights on key drivers of uncertainty, the direction of impact, and the presence of interactions. We apply optimal transport-based global sensitivity measures to tackle the multivariate nature of the output and we rely on sensitivity measures that do not require independence between the model inputs for the univariate output case. On the modeling side, we apply multifidelity techniques that leverage low-fidelity models to speed up the calculations and make up for the limited amount of high-fidelity samples, while keeping the latter in the loop for accuracy guarantees. The sensitivity analysis reveals insights useful to understand the model's behavior and identify the factors to focus on during testing, in order to maximize the informational value extracted from these tests and ensure mission success even with limited resources.

Authors

Institutions

Publication Details

Journal
Risk Analysis
Published
2025-03-13
DOI
https://doi.org/10.1111/risa.70010
Citations
2
Primary Topic
Probabilistic and Robust Engineering Design
Type
article
Field-Weighted Citation Impact
2.80

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Global sensitivity analyses for test planning with black‐box models for Mars Sample Return

Aaron Siddens, Elmar Plischke, Giuseppe Cataldo, Emanuele Borgonovo et al.
2 citations
Risk Analysis
Probabilistic and Robust Engineering Design
2.80
article

Global sensitivity analyses for test planning with black‐box models for Mars Sample Return

Aaron Siddens, Elmar Plischke, Giuseppe Cataldo, Emanuele Borgonovo, Kevin Carpenter, Martin Nado
article en
2 citations

Abstract

This work describes sensitivity analyses performed on complex black-box models used to support experimental test planning under limited resources in the context of the Mars Sample Return program, which aims at bringing to Earth rock, regolith, and atmospheric samples from Mars. We develop a systematic workflow that allows the analysts to simultaneously obtain quantitative insights on key drivers of uncertainty, the direction of impact, and the presence of interactions. We apply optimal transport-based global sensitivity measures to tackle the multivariate nature of the output and we rely on sensitivity measures that do not require independence between the model inputs for the univariate output case. On the modeling side, we apply multifidelity techniques that leverage low-fidelity models to speed up the calculations and make up for the limited amount of high-fidelity samples, while keeping the latter in the loop for accuracy guarantees. The sensitivity analysis reveals insights useful to understand the model's behavior and identify the factors to focus on during testing, in order to maximize the informational value extracted from these tests and ensure mission success even with limited resources.

Risk AnalysisVol. 45(8)
Goddard Space Flight Center (US), Jet Propulsion Laboratory (US), Institut Superieur de l'Aeronautique et de l'Espace (ISAE-SUPAERO) (FR), Helmholtz-Zentrum Dresden-Rossendorf (DE), Bocconi University (IT)
Jet Propulsion Laboratory, Goddard Space Flight Center
Openalex Percentile: Top 9%
Probabilistic and Robust Engineering Design
2.80
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.