Improved Natural Language Processing-Based Optical Character Recognition Model for Image-to-LaTeX Conversion

Recognition of symbols in mathematical expressions and systematic analysis involving the recognition of basic mathematical expressions (BME) from images are difficult tasks. Many researchers have used optical character recognition (OCR) to support such recognition. However, recognizing such unique mathematical symbols and figuring out where they belong in the formula is still challenging due to the limitations of the existing encoder-decoder architecture that fails to capture the precise position of such symbols and a poor data set. In order to address such a challenge, this study proposes a natural language processing (NLP)-based optical character recognition (OCR) model that converts images of BME to LaTeX markup by using an encoder based on a convolutional neural network (CNN) and a decoder based on a recurrent neural network (RNN). The proposed approach includes an attention mechanism and a novel dataset that enable the encoder-decoder architecture to find the position of the math symbol correctly. The proposed NLP-based OCR model was evaluated using the BLEU score, edit distance, and exact match metrics by compiling the predicted LaTeX markup to produce new math formulas and contrasting them against the ground truth. The NLP-based OCR model achieved a good performance, having achieved 93.22% on the BLEU score, 93.49% on the edit dis-tance, and 78.21 on the exact match.

Authors

Institutions

Publication Details

Journal
International Journal of Latest Technology in Engineering Management & Applied Science
Published
2026-11-19
DOI
https://doi.org/10.51583/ijltemas.2026.151000126
Primary Topic
Handwritten Text Recognition Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Improved Natural Language Processing-Based Optical Character Recognition Model for Image-to-LaTeX Conversion

Francis Amaechi Okoye, Everistus Zeluwa Orji, Ozor Godwin Odozo
International Journal of Latest Technology in Engineering Management & Applied Science
Handwritten Text Recognition Techniques
article

Improved Natural Language Processing-Based Optical Character Recognition Model for Image-to-LaTeX Conversion

Francis Amaechi Okoye, Everistus Zeluwa Orji, Ozor Godwin Odozo
article en

Abstract

Recognition of symbols in mathematical expressions and systematic analysis involving the recognition of basic mathematical expressions (BME) from images are difficult tasks. Many researchers have used optical character recognition (OCR) to support such recognition. However, recognizing such unique mathematical symbols and figuring out where they belong in the formula is still challenging due to the limitations of the existing encoder-decoder architecture that fails to capture the precise position of such symbols and a poor data set. In order to address such a challenge, this study proposes a natural language processing (NLP)-based optical character recognition (OCR) model that converts images of BME to LaTeX markup by using an encoder based on a convolutional neural network (CNN) and a decoder based on a recurrent neural network (RNN). The proposed approach includes an attention mechanism and a novel dataset that enable the encoder-decoder architecture to find the position of the math symbol correctly. The proposed NLP-based OCR model was evaluated using the BLEU score, edit distance, and exact match metrics by compiling the predicted LaTeX markup to produce new math formulas and contrasting them against the ground truth. The NLP-based OCR model achieved a good performance, having achieved 93.22% on the BLEU score, 93.49% on the edit dis-tance, and 78.21 on the exact match.

International Journal of Latest Technology in Engineering Management & Applied ScienceVol. 15(10)
Enugu State University of Science and Technology (NG), Kıbrıs İlim Üniversitesi (CY)
Handwritten Text Recognition Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon