Trustworthy Uncertainty Quantification Via Distributionally-Robust Dual Adaptive Conformal Prediction

Abstract Uncertainty quantification (UQ) plays a vital role in ensuring reliable and consistent decision-making, especially in emerging domains, such as interactive, data-driven modeling, and simulation for digital twins, where challenges, such as distribution shifts, dynamic adjustments, and deep uncertainty limit the effectiveness of traditional Bayesian methods that rely on prior distribution assumptions. Conformal prediction (CP) offers a distribution-free framework for UQ with guaranteed marginal coverage. While basic methods like split CP and adaptive CP address some practical concerns, they often suffer from unstable prediction intervals and degraded coverage under distribution shift or dependence among samples. To overcome these limitations, we propose a dual adaptive conformal prediction method that introduces a dynamic data partitioning mechanism to adaptively adjust conformity scores and interval widths based on observed data characteristics and optimize information allocation for improved predictive uncertainty estimation. This dual adaptation improves the adaptability of uncertainty estimation models, increasing their sensitivity to data variations, and improving the stability of prediction results. To evaluate the effectiveness of the proposed method, experiments are conducted on both exchangeable and non-exchangeable datasets across low- and high-dimensional settings. Experimental results demonstrate superior expected coverage and greater stability in prediction intervals compared to traditional CP and Bayesian methods, especially in enhancing the flexibility of CP methods for non-exchangeable data. The proposed approach significantly strengthens conformal prediction’s applicability to real-world, non-ideal conditions—offering a promising direction for future UQ research.

Authors

Institutions

Publication Details

Journal
Journal of Mechanical Design
Published
2025-09-04
DOI
https://doi.org/10.1115/1.4069683
Citations
1
Primary Topic
Fault Detection and Control Systems
Type
article
Field-Weighted Citation Impact
1.21
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Trustworthy Uncertainty Quantification Via Distributionally-Robust Dual Adaptive Conformal Prediction

Sobhan Badakhshan, Jie Zhang, Hongwei Xu, Yuwei Zong
1 citations
Journal of Mechanical Design
Fault Detection and Control Systems
1.21
article

Trustworthy Uncertainty Quantification Via Distributionally-Robust Dual Adaptive Conformal Prediction

Sobhan Badakhshan, Jie Zhang, Hongwei Xu, Yuwei Zong
article en
1 citations

Abstract

Abstract Uncertainty quantification (UQ) plays a vital role in ensuring reliable and consistent decision-making, especially in emerging domains, such as interactive, data-driven modeling, and simulation for digital twins, where challenges, such as distribution shifts, dynamic adjustments, and deep uncertainty limit the effectiveness of traditional Bayesian methods that rely on prior distribution assumptions. Conformal prediction (CP) offers a distribution-free framework for UQ with guaranteed marginal coverage. While basic methods like split CP and adaptive CP address some practical concerns, they often suffer from unstable prediction intervals and degraded coverage under distribution shift or dependence among samples. To overcome these limitations, we propose a dual adaptive conformal prediction method that introduces a dynamic data partitioning mechanism to adaptively adjust conformity scores and interval widths based on observed data characteristics and optimize information allocation for improved predictive uncertainty estimation. This dual adaptation improves the adaptability of uncertainty estimation models, increasing their sensitivity to data variations, and improving the stability of prediction results. To evaluate the effectiveness of the proposed method, experiments are conducted on both exchangeable and non-exchangeable datasets across low- and high-dimensional settings. Experimental results demonstrate superior expected coverage and greater stability in prediction intervals compared to traditional CP and Bayesian methods, especially in enhancing the flexibility of CP methods for non-exchangeable data. The proposed approach significantly strengthens conformal prediction’s applicability to real-world, non-ideal conditions—offering a promising direction for future UQ research.

Journal of Mechanical DesignVol. 148(2)
The University of Texas at Dallas (US), University of North Texas at Dallas (US)
Openalex Percentile: Top 17%
Fault Detection and Control Systems
1.21
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.