Deep learning model for automated visual inspection of electronic boards

Abstract This paper presents the development of a deep learning model specifically designed for error detection in the assembly of electronic components on a printed circuit board. The proposed Convolutional Deep Learning Model (CDLM) consists of three stages: segmentation, feature extraction and classification. The segmentation is based on the model for detecting objects in images: Mask r-cnn. The feature extraction stage utilizes Convolutional Neural Networks and follows an approach inspired by human vision—detecting first coarse structures, then medium details, and finally fine details. The classification stage is performed using Fully Connected (FC) neural networks. For training and evaluation, a proprietary dataset was created, consisting of 2376 images representing five types of defects on the boards, plus the corrected one; all boards type are equally represented. Finally, the model was implemented on a computer that processes digital images of the boards to provide real-time inspection. The proposal is able to determine whether or not a board has one of the five proposed defects. The results show a zero error and 100% accuracy in classifying the boards.