A Text Detection Method Based on Multiscale Selective Fusion Feature Pyramid and Multisemantic Spatial Network for Visual IoT

With the rapid development of Visual Internet of Things (VIoT) and text detection technology, they have been widely combined and applied to many industrial production sites, such as label text detection, achieving impressive results. However, there are still many shortcomings in the text detection technology: 1) the existing VIoT system has very limited detection precision for text with large scale changes, especially for some small-scale text detection; 2) the existing text detection algorithms cannot meet the actual situation, as the labels often contain handwritten texts, and the text to be detected is arbitrary shape; and 3) in the actual detection, there are many creases or defects on the text label. To solve the above problems, this article designs a text detection method based on a multiscale selection fusion feature pyramid and multisemantic spatial network (MSNet) to assist the VIoT system in detecting label text. First, a multiscale selective fusion feature pyramid is designed, which not only uses the texture extraction module to effectively improve the text texture feature and multiscale feature extraction ability, but also uses the cross-scale selective fusion block to selectively fuse the features of different stages to reduce the influence of pollution on detection. In addition, a MSNet is designed to capture the multisemantic spatial information of each feature channel by using the multiscale deep shared 1-D convolution, which effectively integrates global context dependence and multisemantic spatial prior. Experimental results show that the comprehensive index F-measure on the public datasets ICDAR2015, total-text, and CTW1500 is increased by 5.7%, 3.3%, and 3.8%, respectively. Furthermore, the precision, recall, and F-measure on the dataset label-text are 94.6%, 90.7%, and 92.6%, respectively. The label text detection VIoT system we designed has been deployed in the field and achieved excellent performance. The code of our proposed method can be found in: <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/rebornone1/MSNet</uri>