A Hybrid Template-Guided Deep Learning Framework for OCR-Oriented Restoration of Degraded Tax Documents

Degraded tax forms and other legal-administrative documents require restoration methods that impose strict constraints on content fidelity. This paper presents a structure-aware restoration framework for degraded tax documents that combines geometric normalization, canonical template guidance, and supervised image restoration within a common alignment space. Documents are first mapped to a canonical layout through homography estimation based on Scale-Invariant Feature Transform (SIFT) and Random Sample Consensus (RANSAC), using a master template as a reference. Restoration is then performed using template priors and masked constraints designed to preserve the fixed document structure while recovering variable content. Under a fixed-budget comparative protocol, U-Net with template priors achieved the highest visual and structural quality, whereas the proposed hybrid model obtained the best functional OCR performance on synthetic data, reaching a Character Error Rate (CER) of 0.1091 and a Word Error Rate (WER) of 0.3495. As a complementary evaluation on 37 real-world documents with human-generated textual ground truth, restoration increased full-page word coverage across all three OCR engines evaluated, yielding absolute improvements ranging from 4.15 to 18.05 percentage points.

Authors

Publication Details

Journal
Computers
Published
2026-08-24
DOI
https://doi.org/10.3390/computers15090553
Primary Topic
Handwritten Text Recognition Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Hybrid Template-Guided Deep Learning Framework for OCR-Oriented Restoration of Degraded Tax Documents

John W. Branch-Bedoya, German Sanchez-Torres, Oswaldo A. Peña Rojas
Computers
Handwritten Text Recognition Techniques
article

A Hybrid Template-Guided Deep Learning Framework for OCR-Oriented Restoration of Degraded Tax Documents

John W. Branch-Bedoya, German Sanchez-Torres, Oswaldo A. Peña Rojas
article en

Abstract

Degraded tax forms and other legal-administrative documents require restoration methods that impose strict constraints on content fidelity. This paper presents a structure-aware restoration framework for degraded tax documents that combines geometric normalization, canonical template guidance, and supervised image restoration within a common alignment space. Documents are first mapped to a canonical layout through homography estimation based on Scale-Invariant Feature Transform (SIFT) and Random Sample Consensus (RANSAC), using a master template as a reference. Restoration is then performed using template priors and masked constraints designed to preserve the fixed document structure while recovering variable content. Under a fixed-budget comparative protocol, U-Net with template priors achieved the highest visual and structural quality, whereas the proposed hybrid model obtained the best functional OCR performance on synthetic data, reaching a Character Error Rate (CER) of 0.1091 and a Word Error Rate (WER) of 0.3495. As a complementary evaluation on 37 real-world documents with human-generated textual ground truth, restoration increased full-page word coverage across all three OCR engines evaluated, yielding absolute improvements ranging from 4.15 to 18.05 percentage points.

ComputersVol. 15(9)
Sustainable cities and communities
Openalex Percentile: Top 25%
Handwritten Text Recognition Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.