Uncertainty quantification using conformal prediction for mesh-based simulations

Machine learning surrogates for computational fluid dynamics (CFD) achieve substantial speedups but lack uncertainty quantification (UQ). We develop a post hoc conformal prediction (CP) framework that wraps any trained graph neural network (GNN) surrogate to produce prediction sets with coverage near-nominal levels. Using MeshGraphNet on two benchmark datasets-CylinderFlow (2D velocity) and Flag (3D position), we compare five prediction-set geometries. Our componentwise adaptive (CW-Adaptive) method emerges as the robust universal choice, achieving 28%-55% smaller prediction sets versus ℓ2 balls across both datasets at 95% confidence while maintaining near-nominal coverage. By learning per-component scales from domain-aware features, CW-Adaptive captures both spatial heterogeneity and anisotropic error structure-outperforming Mahalanobis ellipsoids that provide only modest gains (approx. 14%) when residuals are anisotropic and inflate sets otherwise. All methods achieve coverage within 2%-3% of nominal despite distribution drift in mesh-based simulations that violates exchangeability assumption. This article is part of the theme issue 'Advancing uncertainty quantification in AI systems'.

Authors

Institutions

Publication Details

Journal
Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences
Published
2026-08-27
DOI
https://doi.org/10.1098/rsta.2025.0076
Citations
1
Primary Topic
Model Reduction and Neural Networks
Type
article
Field-Weighted Citation Impact
5.29

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Uncertainty quantification using conformal prediction for mesh-based simulations

Samira Mabtoul, Izhar Ali, Shen-Shyang Ho
1 citations
Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences
Model Reduction and Neural Networks
5.29
article

Uncertainty quantification using conformal prediction for mesh-based simulations

Samira Mabtoul, Izhar Ali, Shen-Shyang Ho
article en
1 citations

Abstract

Machine learning surrogates for computational fluid dynamics (CFD) achieve substantial speedups but lack uncertainty quantification (UQ). We develop a post hoc conformal prediction (CP) framework that wraps any trained graph neural network (GNN) surrogate to produce prediction sets with coverage near-nominal levels. Using MeshGraphNet on two benchmark datasets-CylinderFlow (2D velocity) and Flag (3D position), we compare five prediction-set geometries. Our componentwise adaptive (CW-Adaptive) method emerges as the robust universal choice, achieving 28%-55% smaller prediction sets versus ℓ2 balls across both datasets at 95% confidence while maintaining near-nominal coverage. By learning per-component scales from domain-aware features, CW-Adaptive captures both spatial heterogeneity and anisotropic error structure-outperforming Mahalanobis ellipsoids that provide only modest gains (approx. 14%) when residuals are anisotropic and inflate sets otherwise. All methods achieve coverage within 2%-3% of nominal despite distribution drift in mesh-based simulations that violates exchangeability assumption. This article is part of the theme issue 'Advancing uncertainty quantification in AI systems'.

Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering SciencesVol. 384(2327)
Rowan University (US)
National Science Foundation
Openalex Percentile: Top 4%
Model Reduction and Neural Networks
5.29
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.