Menu item extraction from Thai receipt images using deep learning and template-based information extraction

This paper proposes an algorithm to extract food and beverage information from Thai receipt images using deep learning model and the proposed template-based information extraction. This information includes item name, quantity, price, and other details which are the sub-total, VAT, non-VAT, service charge and discount. The proposed algorithm consists of four steps: preprocessing, menu item template detection, optical character recognition, and information extraction. The experimental results show that the proposed algorithm using YOLOv8 for menu item template detection achieved mAP of 0.835, whereas OCR and the proposed template-based information extraction achieved 87.37% accuracy on item price extraction and 70.45% accuracy on VAT and other payment details.