CNN-LSTM-Based Bilingual Receipt Information Extraction Using Template-Based Data Generation

This paper discusses the development of a bilingual receipt information extraction system using a CNN-LSTM model with data augmentation techniques. The system targets the extraction of essential information such as company names, dates, and total amounts from receipts containing both Thai and English text. To address the limited availability of annotated data, synthetic receipt samples were generated from initial templates, creating a diverse training dataset. The model’s performance was evaluated on both the generated dataset and the SROIE 2019 dataset, achieving high accuracy across all tested information classes. While the CNN effectively extracts features, the LSTM processes these features for accurate information extraction. Future work aims to incorporate transformer-based models to enhance the system’s contextual understanding and generalization capabilities. This research highlights the effectiveness of combining CNNs and LSTMs in handling complex, multilingual datasets for practical applications in information extraction.

Authors

Institutions

Publication Details

Published
2024-11-06
DOI
https://doi.org/10.1109/icsec62781.2024.10770740
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CNN-LSTM-Based Bilingual Receipt Information Extraction Using Template-Based Data Generation

Santitham Prom–on, Jaturon Harnsomburana, Phoramint Chotwarutkit, Poonyawee Wongwisetsuk
Neural Networks and Applications
article

CNN-LSTM-Based Bilingual Receipt Information Extraction Using Template-Based Data Generation

Santitham Prom–on, Jaturon Harnsomburana, Phoramint Chotwarutkit, Poonyawee Wongwisetsuk
article en

Abstract

This paper discusses the development of a bilingual receipt information extraction system using a CNN-LSTM model with data augmentation techniques. The system targets the extraction of essential information such as company names, dates, and total amounts from receipts containing both Thai and English text. To address the limited availability of annotated data, synthetic receipt samples were generated from initial templates, creating a diverse training dataset. The model’s performance was evaluated on both the generated dataset and the SROIE 2019 dataset, achieving high accuracy across all tested information classes. While the CNN effectively extracts features, the LSTM processes these features for accurate information extraction. Future work aims to incorporate transformer-based models to enhance the system’s contextual understanding and generalization capabilities. This research highlights the effectiveness of combining CNNs and LSTMs in handling complex, multilingual datasets for practical applications in information extraction.

King Mongkut's University of Technology Thonburi (TH)
Quality Education
Openalex Percentile: Top 80%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.