Real-Time Multimodal Defect Detection and MES Feedback on Edge Devices via Bayesian Fusion and Causal Adaptation

Conventional single-modality or loosely coupled inspection systems often degrade under partial occlusion, transient sensor dropout, or illumination drift, and their feedback to Manufacturing Execution Systems (MES) can be delayed or non-deterministic.We present <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">D3Lite-MES</i>, a real-time multimodal defect detection framework that (i) aligns heterogeneous sensors at both hardware and software levels, (ii) fuses them via a Bayesian–Causal Weighted Fusion (BCWF) module, and (iii) adapts model parameters on edge devices through a lightweight causal adaptation routine. Deployed on commodity edge hardware, the system sustains line-takt operation and writes verified defect events back to MES with bounded latency. On three production lines covering <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">[product families anonymized]</i>, D3Lite-MES attains a mean F1 of 98.2% and [email protected] of 97.6%, reducing false alarms by 98.2% compared with lightweight baselines, at an end-to-end latency of 34 ms and average power of 8.9W. Ablations show that BCWF contributes +1.7% F1 under partial observations, while causal adaptation yields +1.7% under illumination drift. The MES feedback loop decreases manual triage time by 34% and shortens recovery from minor stops by 34%.

Authors

Institutions

Publication Details

Journal
IEEE Access
Published
2025-01-01
DOI
https://doi.org/10.1109/access.2025.3610341
Primary Topic
Industrial Vision Systems and Defect Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Real-Time Multimodal Defect Detection and MES Feedback on Edge Devices via Bayesian Fusion and Causal Adaptation

W.-C. Lin, Yong Lin, Yi-Chu Lin
IEEE Access
Industrial Vision Systems and Defect Detection
article

Real-Time Multimodal Defect Detection and MES Feedback on Edge Devices via Bayesian Fusion and Causal Adaptation

W.-C. Lin, Yong Lin, Yi-Chu Lin
article en

Abstract

Conventional single-modality or loosely coupled inspection systems often degrade under partial occlusion, transient sensor dropout, or illumination drift, and their feedback to Manufacturing Execution Systems (MES) can be delayed or non-deterministic.We present <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">D3Lite-MES</i>, a real-time multimodal defect detection framework that (i) aligns heterogeneous sensors at both hardware and software levels, (ii) fuses them via a Bayesian–Causal Weighted Fusion (BCWF) module, and (iii) adapts model parameters on edge devices through a lightweight causal adaptation routine. Deployed on commodity edge hardware, the system sustains line-takt operation and writes verified defect events back to MES with bounded latency. On three production lines covering <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">[product families anonymized]</i>, D3Lite-MES attains a mean F1 of 98.2% and [email protected] of 97.6%, reducing false alarms by 98.2% compared with lightweight baselines, at an end-to-end latency of 34 ms and average power of 8.9W. Ablations show that BCWF contributes +1.7% F1 under partial observations, while causal adaptation yields +1.7% under illumination drift. The MES feedback loop decreases manual triage time by 34% and shortens recovery from minor stops by 34%.

IEEE AccessVol. 13
Rutgers, The State University of New Jersey (US), Key Laboratory of Guangdong Province (CN), James Cook University Singapore (SG), Guangdong Peizheng College
Openalex Percentile: Top 65%
Industrial Vision Systems and Defect Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Real-Time Multimodal Defect Detection and MES Feedback on Edge Devices via Bayesian Fusion and Causal Adaptation — W.-C. Lin, Yong Lin, et al. · IEEE Access (2025) | TGRS Research Map | TGRS