Class-adaptive oracle-free metamorphic test case prioritization framework for vision-based deep neural networks

Metamorphic testing (MT) provides an effective oracle-free strategy for evaluating deep neural networks under semantics-preserving perturbations. However, existing MT prioritization methods typically rely on static global heuristics and do not adequately capture class-dependent variation in model behavior or the complementary roles of predictive uncertainty and interpretability drift. This limitation is especially important in safety-critical vision applications. We propose a class-adaptive uncertainty-interpretability metamorphic test case prioritization framework (CUI-MTP) for vision-based deep learning systems. Rather than ranking individual samples, the framework prioritizes executable metamorphic test cases and formulates prioritization as a class-conditioned optimization problem that jointly models probabilistic instability and saliency-level behavioral change. Predictive uncertainty and interpretability drift are integrated through multi-objective Bayesian optimization with expected hypervolume improvement. Experiments on CIFAR-10, Fashion-MNIST, and ISIC2019 with ResNet-18, ResNet-50, and ConvNeXt-Base show that the proposed method consistently outperforms representative oracle-free baselines across datasets, architectures, and Top-N budgets, with statistically significant improvements ([Formula: see text]). Qualitative Grad-CAM case studies further show that the framework captures not only obvious prediction failures but also high-risk cases with substantial saliency drift. Overall, the results demonstrate a practical and scalable strategy for robust, safety-aware validation of vision-based deep learning systems.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-04-16
DOI
https://doi.org/10.1038/s41598-026-49010-3
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Class-adaptive oracle-free metamorphic test case prioritization framework for vision-based deep neural networks

Radziah Mohamad, Junhan Li, Johanna Ahmad
Scientific Reports
Adversarial Robustness in Machine Learning
article

Class-adaptive oracle-free metamorphic test case prioritization framework for vision-based deep neural networks

Radziah Mohamad, Junhan Li, Johanna Ahmad
article en

Abstract

Metamorphic testing (MT) provides an effective oracle-free strategy for evaluating deep neural networks under semantics-preserving perturbations. However, existing MT prioritization methods typically rely on static global heuristics and do not adequately capture class-dependent variation in model behavior or the complementary roles of predictive uncertainty and interpretability drift. This limitation is especially important in safety-critical vision applications. We propose a class-adaptive uncertainty-interpretability metamorphic test case prioritization framework (CUI-MTP) for vision-based deep learning systems. Rather than ranking individual samples, the framework prioritizes executable metamorphic test cases and formulates prioritization as a class-conditioned optimization problem that jointly models probabilistic instability and saliency-level behavioral change. Predictive uncertainty and interpretability drift are integrated through multi-objective Bayesian optimization with expected hypervolume improvement. Experiments on CIFAR-10, Fashion-MNIST, and ISIC2019 with ResNet-18, ResNet-50, and ConvNeXt-Base show that the proposed method consistently outperforms representative oracle-free baselines across datasets, architectures, and Top-N budgets, with statistically significant improvements ([Formula: see text]). Qualitative Grad-CAM case studies further show that the framework captures not only obvious prediction failures but also high-risk cases with substantial saliency drift. Overall, the results demonstrate a practical and scalable strategy for robust, safety-aware validation of vision-based deep learning systems.

Scientific Reports
University of Technology Malaysia (MY), Chongqing University of Technology (CN)
Openalex Percentile: Top 5%
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.