LeF‐MTP: Prioritizing GNN Test Cases by Fusing Model Uncertainty and Feature‐Space Confusability

ABSTRACT Graph Neural Networks (GNNs) are widely applied in 3D computer vision tasks. However, validating their reliability is limited by the high cost of labeling large‐scale test data. Existing test case prioritization techniques for deep learning often rely on single‐dimensional heuristics or mutation‐based analysis (e.g., GraphPrior, PCPrior). However, these methods often limit fault diversity or incur prohibitive computational overhead. To address these issues, this paper proposes LeF‐MTP, a multi‐dimensional test prioritization framework. Unlike these state‐of‐the‐art methods that depend on computationally intensive external mutations, LeF‐MTP directly exploits the model's internal cognitive states. The method characterizes test cases through two dimensions: the predictive uncertainty and feature‐space confusability. These cognitive features are fused via a Random Forest classifier to predict failure probabilities. The resulting priority list is then optimized by a diversity‐aware re‐ranking process based on feature clustering. We evaluated the framework on four 3D point cloud datasets (including ScanObjectNN and S3DIS) across four GNN architectures. Experimental results demonstrate that LeF‐MTP achieves higher fault detection rates than heuristic and mutation‐based baselines, with Average Percentage of Fault Detection (APFD) improvements ranging from 8.79% to 74.69%. Moreover, an efficiency analysis demonstrates that the proposed approach reduces feature generation time compared to mutation‐based methods, validating its practicality for GNN testing.

Authors

Institutions

Publication Details

Journal
Computational Intelligence
Published
2026-02-01
DOI
https://doi.org/10.1111/coin.70199
Primary Topic
Advanced Graph Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LeF‐MTP: Prioritizing GNN Test Cases by Fusing Model Uncertainty and Feature‐Space Confusability

Qingran Su, Bing Fu, Yuming Ren, Yongfeng Yin et al.
Computational Intelligence
Advanced Graph Neural Networks
article

LeF‐MTP: Prioritizing GNN Test Cases by Fusing Model Uncertainty and Feature‐Space Confusability

Qingran Su, Bing Fu, Yuming Ren, Yongfeng Yin, Chunming Hu, Xingze Li
article en

Abstract

ABSTRACT Graph Neural Networks (GNNs) are widely applied in 3D computer vision tasks. However, validating their reliability is limited by the high cost of labeling large‐scale test data. Existing test case prioritization techniques for deep learning often rely on single‐dimensional heuristics or mutation‐based analysis (e.g., GraphPrior, PCPrior). However, these methods often limit fault diversity or incur prohibitive computational overhead. To address these issues, this paper proposes LeF‐MTP, a multi‐dimensional test prioritization framework. Unlike these state‐of‐the‐art methods that depend on computationally intensive external mutations, LeF‐MTP directly exploits the model's internal cognitive states. The method characterizes test cases through two dimensions: the predictive uncertainty and feature‐space confusability. These cognitive features are fused via a Random Forest classifier to predict failure probabilities. The resulting priority list is then optimized by a diversity‐aware re‐ranking process based on feature clustering. We evaluated the framework on four 3D point cloud datasets (including ScanObjectNN and S3DIS) across four GNN architectures. Experimental results demonstrate that LeF‐MTP achieves higher fault detection rates than heuristic and mutation‐based baselines, with Average Percentage of Fault Detection (APFD) improvements ranging from 8.79% to 74.69%. Moreover, an efficiency analysis demonstrates that the proposed approach reduces feature generation time compared to mutation‐based methods, validating its practicality for GNN testing.

Computational IntelligenceVol. 42(1)
Beihang University (CN)
Openalex Percentile: Top 55%
Advanced Graph Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.