Persian/Arabic Scene Text Recognition With Convolutional Recurrent Neural Network

ABSTRACT With advancements in technology, natural scene text recognition (STR) has become a critical yet challenging field due to variations in fonts, colours, textures, illumination, and complex backgrounds. This research study focuses on optical character recognition (OCR) with a case study on Iranian signposts, traffic signs, and licence plates to convert text from images into editable formats. The proposed method combines a preprocessing stage, leveraging resizing, noise reduction, adaptive thresholding, and colour inversion, which significantly enhances image quality and facilitates accurate text recognition, with a deep‐learning pipeline. The process begins with the CRAFT model for text detection, addressing limitations in Persian/Arabic alphabet representation in datasets, followed by CRNN for text recognition. These preprocessing techniques and the CRAFT component result in notable performance improvements, achieving 98.6% accuracy with training error rates reduced from 13.90% to 1.40% after 20 epochs. Additionally, the system's effectiveness is validated through Persian/Arabic‐specific OCR criteria at both the character and word levels. Results indicate that preprocessing and deep learning integration improve reliability, paving the way for future applications in intelligent transportation systems and other domains requiring robust STR solutions. This study demonstrates the potential for further enhancements in OCR systems, particularly for complex, script‐based languages.