Text Image Super-Resolution for Improved OCR in Real-Life Scenarios using Swin Transformers
Text recognition in real-life images poses a challenging task due to blur, distortion, and low resolution. This work presents an innovative method integrating image super-resolution, image restoration, and optical character recognition techniques to enhance text recognition in real-life photographs. We specifically reviewed the processing of the TextZoom dataset and utilized transfer learning on an improved version of the image super-resolution model, SwinIR. The findings of our experiment show that our text recognition scores are better than the current best scores, and there is a significant rise in the peak signal-to-noise ratio while dealing with deformed low-resolution images from the TextZoom dataset. This approach outperforms earlier research in the domain of scene text image super-resolution and offers a promising resolution for text recognition in real-life images. The code can be accessed at this location: https://github.com/Phimanu/TextSR
Authors
- Raid Saabni
- Mareike Schulze (ORCID: https://orcid.org/0000-0002-4691-1219)
- Sarel Cohen (ORCID: https://orcid.org/0000-0003-4578-1245)
- Vanja Doskoč (ORCID: https://orcid.org/0000-0003-0190-7512)
- Tobias Friedrich (ORCID: https://orcid.org/0000-0003-0076-6308)
- Philipp Hildebrandt (ORCID: https://orcid.org/0000-0002-0965-513X)
Institutions
- Hasso Plattner Institute (DE)
- University of Potsdam (DE)
- Academic College of Tel Aviv-Yafo (IL)
Publication Details
- Published
- 2025-08-27
- DOI
- https://doi.org/10.1145/3704268.3742690
- Primary Topic
- Image Processing Techniques and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00