Research on quantification of image classification uncertainty based on conformal prediction

Convolutional neural networks (CNNs) have demonstrated remarkable performance in image classification tasks. However, for real-world decision-making applications, it is crucial to develop reliable methods for quantifying the uncertainty associated with their predictions. This study evaluates two conformal prediction methods, Regularized Adaptive Prediction Sets (RAPS) and Adaptive Prediction Sets (APS), using a ResNet-152 classifier on ImageNet. The focus is on their performance under unperturbed conditions and perturbations such as noise, blur, and occlusion. Experiments analyze varying confidence thresholds and RAPS regularization adaptability. Results show that RAPS outperforms APS in most scenarios but faces challenges in prediction efficiency at high confidence levels. This research provides valuable references for practical applications of uncertainty quantification in image classification tasks, contributing to enhancing the reliability of CNN-based classification systems in complex environments.

Authors

Institutions

Publication Details

Journal
IET conference proceedings.
Published
2025-08-01
DOI
https://doi.org/10.1049/icp.2025.2043
Primary Topic
Advanced Measurement and Detection Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on quantification of image classification uncertainty based on conformal prediction

Weisong Liu, Jing Du, Zhuxuan Meng, Pengfei Sun
IET conference proceedings.
Advanced Measurement and Detection Methods
article

Research on quantification of image classification uncertainty based on conformal prediction

Weisong Liu, Jing Du, Zhuxuan Meng, Pengfei Sun
article en

Abstract

Convolutional neural networks (CNNs) have demonstrated remarkable performance in image classification tasks. However, for real-world decision-making applications, it is crucial to develop reliable methods for quantifying the uncertainty associated with their predictions. This study evaluates two conformal prediction methods, Regularized Adaptive Prediction Sets (RAPS) and Adaptive Prediction Sets (APS), using a ResNet-152 classifier on ImageNet. The focus is on their performance under unperturbed conditions and perturbations such as noise, blur, and occlusion. Experiments analyze varying confidence thresholds and RAPS regularization adaptability. Results show that RAPS outperforms APS in most scenarios but faces challenges in prediction efficiency at high confidence levels. This research provides valuable references for practical applications of uncertainty quantification in image classification tasks, contributing to enhancing the reliability of CNN-based classification systems in complex environments.

IET conference proceedings.Vol. 2025(8)
Academy of Military Medical Sciences (CN), PLA Academy of Military Science (CN)
Climate action
Openalex Percentile: Top 81%
Advanced Measurement and Detection Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.