Abnormal Discrepancy-Guided Knowledge Distillation for Image Anomaly Detection

Knowledge distillation is a cornerstone of image anomaly detection for amplifying subtle defects via teacher–student discrepancy, yet existing methods rely on feature alignment loss that causes reconstruction error confusion and degrades accuracy. To address this critical limitation, this study proposes an abnormal discrepancy-guided knowledge distillation method (DiffKD) that differentially guides student feature reconstruction through channel-level discrepancy masks, leveraging normal features as supervisory signals and abnormal discrepancy features as constraints to enhance anomaly detection performance. The approach integrates a knowledge distillation network for feature reconstruction with a segmentation network for anomaly localization, while utilizing prior anomaly samples and synthetic anomaly samples to provide real-time training data of anomalous samples. Extensive evaluations on the SUT-Crack and MVTec AD benchmarks validate the effectiveness and generalizability of our approach. On MVTec AD, it achieves 80.7% average precision (AP) and 81.9% instance-level average precision (IAP), showing competitive performance against the representative methods evaluated under the same protocol. These results not only demonstrate significant improvements in IAD accuracy but also highlight its promise for enabling real-time, automated anomaly detection in practical applications.

Authors

Institutions

Publication Details

Journal
Journal of Imaging
Published
2026-06-30
DOI
https://doi.org/10.3390/jimaging12070291
Primary Topic
Anomaly Detection Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Abnormal Discrepancy-Guided Knowledge Distillation for Image Anomaly Detection

Kai Wang, Fengxiang Jin, Zhenjun Yu, Lin Sun
Journal of Imaging
Anomaly Detection Techniques and Applications
article

Abnormal Discrepancy-Guided Knowledge Distillation for Image Anomaly Detection

Kai Wang, Fengxiang Jin, Zhenjun Yu, Lin Sun
article en

Abstract

Knowledge distillation is a cornerstone of image anomaly detection for amplifying subtle defects via teacher–student discrepancy, yet existing methods rely on feature alignment loss that causes reconstruction error confusion and degrades accuracy. To address this critical limitation, this study proposes an abnormal discrepancy-guided knowledge distillation method (DiffKD) that differentially guides student feature reconstruction through channel-level discrepancy masks, leveraging normal features as supervisory signals and abnormal discrepancy features as constraints to enhance anomaly detection performance. The approach integrates a knowledge distillation network for feature reconstruction with a segmentation network for anomaly localization, while utilizing prior anomaly samples and synthetic anomaly samples to provide real-time training data of anomalous samples. Extensive evaluations on the SUT-Crack and MVTec AD benchmarks validate the effectiveness and generalizability of our approach. On MVTec AD, it achieves 80.7% average precision (AP) and 81.9% instance-level average precision (IAP), showing competitive performance against the representative methods evaluated under the same protocol. These results not only demonstrate significant improvements in IAD accuracy but also highlight its promise for enabling real-time, automated anomaly detection in practical applications.

Journal of ImagingVol. 12(7)
Qingdao Center of Resource Chemistry and New Materials (CN), Shandong University of Science and Technology (CN)
Quality Education
Openalex Percentile: Top 8%
Anomaly Detection Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.