StyleScript: A Structured Data Augmentation Framework for Transformer-Based OCR in Engineering Documents

Engineering documents often contain a combination of printed and handwritten text, intricate layouts, and visual degradation, posing significant challenges to Optical Character Recognition (OCR) systems. Transformer-based models like TrOCR provide strong baseline performance but require domain-specific data augmentation to generalize effectively. This paper introduces StyleScript, a structured data augmentation framework that generates realistic synthetic word images by extracting stroke-based style features such as slant angle and thickness. We fine-tune both TrOCR (small) and TrOCR (large) models using real and StyleScript-augmented data derived from a Military Sealift Command (MSC) dataset. Additionally, we develop a systematic OCR pipeline combining preprocessing, CRAFT-based text detection, and fine-tuned TrOCR recognition to digitize full-page engineering documents with spatial fidelity. Experimental results show that StyleScript-enhanced training improves OCR performance across diverse document conditions, making it a practical solution for engineering and other technical domains with limited annotated data.

Authors

Publication Details

Journal
ODU Digital Commons (Old Dominion University)
Published
2025-12-23
Primary Topic
Handwritten Text Recognition Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

StyleScript: A Structured Data Augmentation Framework for Transformer-Based OCR in Engineering Documents

Wael Khallouli, Farshid Javadnejad, Samual Kovacic, Andres Avelino Sousa-Poza et al.
ODU Digital Commons (Old Dominion University)
Handwritten Text Recognition Techniques
article

StyleScript: A Structured Data Augmentation Framework for Transformer-Based OCR in Engineering Documents

Wael Khallouli, Farshid Javadnejad, Samual Kovacic, Andres Avelino Sousa-Poza, Jiang Li
article en

Abstract

Engineering documents often contain a combination of printed and handwritten text, intricate layouts, and visual degradation, posing significant challenges to Optical Character Recognition (OCR) systems. Transformer-based models like TrOCR provide strong baseline performance but require domain-specific data augmentation to generalize effectively. This paper introduces StyleScript, a structured data augmentation framework that generates realistic synthetic word images by extracting stroke-based style features such as slant angle and thickness. We fine-tune both TrOCR (small) and TrOCR (large) models using real and StyleScript-augmented data derived from a Military Sealift Command (MSC) dataset. Additionally, we develop a systematic OCR pipeline combining preprocessing, CRAFT-based text detection, and fine-tuned TrOCR recognition to digitize full-page engineering documents with spatial fidelity. Experimental results show that StyleScript-enhanced training improves OCR performance across diverse document conditions, making it a practical solution for engineering and other technical domains with limited annotated data.

ODU Digital Commons (Old Dominion University)
Openalex Percentile: Top 35%
Handwritten Text Recognition Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.