Robustness and Reproducibility of Hard Augmentation and Prediction Consistency for Industrial Surface-Defect Classification: A Repeated-Split, Multi-Seed, Multi-Dataset Study

We evaluated whether adding prediction consistency (PC) to hard augmentation yields repeatable robustness benefits in industrial surface-defect classification. Five training strategies were compared using ResNet18 on NEU-CLS, Magnetic Tile, and X-SDD across five repeated stratified splits and three seeds (225 runs). PC changed mean corrupted-image Macro-F1 by −0.0026, +0.0168, and +0.0051, respectively. All corrected dataset-level intervals included zero, and no condition-level effect survived Holm correction. Component ablations and a further 30-run NEU control with training-only coefficient calibration did not establish a PC gain or selection–PC interaction. Archived development-set endpoint diagnostics characterized prediction agreement and gradient magnitude but did not establish a causal mechanism. On a sealed 270-image NEU set, 75 frozen models reproduced the broad method-by-condition pattern (r = 0.9983), while small PC effects were inconsistent. Additional comparators placed IPMix highest in mean performance under the original evaluator, while evaluator controls changed the speckle margin between HardAug + PC and AugMix. Between-split variance remained imprecisely estimated. These findings distinguish repeatability of small incremental effects from broad performance agreement and demonstrate sensitivity to evaluation choices. Conclusions concern the tested complete training strategies under one backbone, three public datasets, and synthetic corruptions.

Authors

Institutions

Publication Details

Journal
Technologies
Published
2026-11-18
DOI
https://doi.org/10.3390/technologies14110767
Primary Topic
Industrial Vision Systems and Defect Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Robustness and Reproducibility of Hard Augmentation and Prediction Consistency for Industrial Surface-Defect Classification: A Repeated-Split, Multi-Seed, Multi-Dataset Study

Min-Po Jung, 焦总政, Shuaikang Yang
1 links
Technologies
Industrial Vision Systems and Defect Detection
article

Robustness and Reproducibility of Hard Augmentation and Prediction Consistency for Industrial Surface-Defect Classification: A Repeated-Split, Multi-Seed, Multi-Dataset Study

Min-Po Jung, 焦总政, Shuaikang Yang
article en

Abstract

We evaluated whether adding prediction consistency (PC) to hard augmentation yields repeatable robustness benefits in industrial surface-defect classification. Five training strategies were compared using ResNet18 on NEU-CLS, Magnetic Tile, and X-SDD across five repeated stratified splits and three seeds (225 runs). PC changed mean corrupted-image Macro-F1 by −0.0026, +0.0168, and +0.0051, respectively. All corrected dataset-level intervals included zero, and no condition-level effect survived Holm correction. Component ablations and a further 30-run NEU control with training-only coefficient calibration did not establish a PC gain or selection–PC interaction. Archived development-set endpoint diagnostics characterized prediction agreement and gradient magnitude but did not establish a causal mechanism. On a sealed 270-image NEU set, 75 frozen models reproduced the broad method-by-condition pattern (r = 0.9983), while small PC effects were inconsistent. Additional comparators placed IPMix highest in mean performance under the original evaluator, while evaluator controls changed the speckle margin between HardAug + PC and AugMix. Between-split variance remained imprecisely estimated. These findings distinguish repeatability of small incremental effects from broad performance agreement and demonstrate sensitivity to evaluation choices. Conclusions concern the tested complete training strategies under one backbone, three public datasets, and synthetic corruptions.

TechnologiesVol. 14(11)
Youngsan University (KR)
Industrial Vision Systems and Defect Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon