Uncertainty quantification using conformal prediction for mesh-based simulations
Machine learning surrogates for computational fluid dynamics (CFD) achieve substantial speedups but lack uncertainty quantification (UQ). We develop a post hoc conformal prediction (CP) framework that wraps any trained graph neural network (GNN) surrogate to produce prediction sets with coverage near-nominal levels. Using MeshGraphNet on two benchmark datasets-CylinderFlow (2D velocity) and Flag (3D position), we compare five prediction-set geometries. Our componentwise adaptive (CW-Adaptive) method emerges as the robust universal choice, achieving 28%-55% smaller prediction sets versus ℓ2 balls across both datasets at 95% confidence while maintaining near-nominal coverage. By learning per-component scales from domain-aware features, CW-Adaptive captures both spatial heterogeneity and anisotropic error structure-outperforming Mahalanobis ellipsoids that provide only modest gains (approx. 14%) when residuals are anisotropic and inflate sets otherwise. All methods achieve coverage within 2%-3% of nominal despite distribution drift in mesh-based simulations that violates exchangeability assumption. This article is part of the theme issue 'Advancing uncertainty quantification in AI systems'.
Authors
- Samira Mabtoul
- Izhar Ali
- Shen-Shyang Ho (ORCID: https://orcid.org/0000-0002-0353-7159)
Institutions
- Rowan University (US)
Publication Details
- Journal
- Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences
- Published
- 2026-08-27
- DOI
- https://doi.org/10.1098/rsta.2025.0076
- Citations
- 1
- Primary Topic
- Model Reduction and Neural Networks
- Type
- article
- Field-Weighted Citation Impact
- 5.29
Funders
- National Science Foundation