A Hybrid Template-Guided Deep Learning Framework for OCR-Oriented Restoration of Degraded Tax Documents
Degraded tax forms and other legal-administrative documents require restoration methods that impose strict constraints on content fidelity. This paper presents a structure-aware restoration framework for degraded tax documents that combines geometric normalization, canonical template guidance, and supervised image restoration within a common alignment space. Documents are first mapped to a canonical layout through homography estimation based on Scale-Invariant Feature Transform (SIFT) and Random Sample Consensus (RANSAC), using a master template as a reference. Restoration is then performed using template priors and masked constraints designed to preserve the fixed document structure while recovering variable content. Under a fixed-budget comparative protocol, U-Net with template priors achieved the highest visual and structural quality, whereas the proposed hybrid model obtained the best functional OCR performance on synthetic data, reaching a Character Error Rate (CER) of 0.1091 and a Word Error Rate (WER) of 0.3495. As a complementary evaluation on 37 real-world documents with human-generated textual ground truth, restoration increased full-page word coverage across all three OCR engines evaluated, yielding absolute improvements ranging from 4.15 to 18.05 percentage points.
Authors
- John W. Branch-Bedoya
- German Sanchez-Torres
- Oswaldo A. Peña Rojas
Publication Details
- Journal
- Computers
- Published
- 2026-08-24
- DOI
- https://doi.org/10.3390/computers15090553
- Primary Topic
- Handwritten Text Recognition Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00