Improving automatic text recognition through atmospheric turbulence

Image quality degradation caused by atmospheric turbulence reduces the performance of automated tasks such as optical character recognition. This issue is addressed by fine-tuning text recognition models using turbulencedegraded images. As obtaining a realistic training dataset of turbulence-degraded recordings is challenging, two synthetic datasets were created: one using a physics-inspired deep learning turbulence simulator and one using a heat chamber. The fine-tuned text recognition model leads to improved performance on a validation dataset of turbulence-distorted recordings. A number of architectural modifications to the text recognition model are proposed that allow for using a sequence of frames instead of just a single frame, while still using the pre-trained weights. These modifications are shown to lead to a further performance improvement.

Authors

Institutions

Publication Details

Published
2024-11-13
DOI
https://doi.org/10.1117/12.3031801
Primary Topic
Advanced Text Analysis Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improving automatic text recognition through atmospheric turbulence

Michel van Lier, Nicolas Boehrer, Lotte Nijskens, Judith Dijk et al.
Advanced Text Analysis Techniques
article

Improving automatic text recognition through atmospheric turbulence

Michel van Lier, Nicolas Boehrer, Lotte Nijskens, Judith Dijk, Lukas Knobel, Pieter Piscaer
article en

Abstract

Image quality degradation caused by atmospheric turbulence reduces the performance of automated tasks such as optical character recognition. This issue is addressed by fine-tuning text recognition models using turbulencedegraded images. As obtaining a realistic training dataset of turbulence-degraded recordings is challenging, two synthetic datasets were created: one using a physics-inspired deep learning turbulence simulator and one using a heat chamber. The fine-tuned text recognition model leads to improved performance on a validation dataset of turbulence-distorted recordings. A number of architectural modifications to the text recognition model are proposed that allow for using a sequence of frames instead of just a single frame, while still using the pre-trained weights. These modifications are shown to lead to a further performance improvement.

Netherlands Organisation for Applied Scientific Research (NL)
Climate action
Openalex Percentile: Top 82%
Advanced Text Analysis Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.