Tibetan Data Augmentation via GAN‐Based Handwritten Text Generation
ABSTRACT Increased awareness of Tibetan cultural preservation, along with technological advancements, has led to significant efforts in academic research on Tibetan. However, the structural complexity of the Tibetan language and limited labeled handwriting data impede advancements in Optical Character Recognition (OCR) and other applications. To address these challenges, this paper proposes an innovative Tibetan data augmentation technique, using Generative Adversarial Networks (GANs) to synthesise arbitrary handwriting images in variable calligraphic styles based on inputs. Moreover, our method leverages a Real‐Fake Cross Inputs Strategy during training to enhance generation diversity and improve model generalisability in generating handwritten text beyond the training set and pre‐defined corpus. The model was trained on three Tibetan handwriting datasets, including Umê style numerals, Uchen style consonants, and Khyug‐yig style words. Experimental results demonstrate that the model successfully generates realistic and recognisable Tibetan numeral and consonant handwriting, achieving Fréchet Inception Distance (FID) scores of 14.45 and 27.63, respectively. The proposed method's effectiveness in augmenting OCR models was validated as evidenced by a reduced OCR Word Error Rate (WER) on the augmented datasets.
Authors
- Nyima Tashi
- Thupten Tsering (ORCID: https://orcid.org/0000-0002-4613-5790)
- Rinchen Dongrub
- Jin Zhang (ORCID: https://orcid.org/0000-0001-7083-4455)
- Xiangxiang Wang (ORCID: https://orcid.org/0000-0002-7661-950X)
- Yongbin Yu (ORCID: https://orcid.org/0000-0001-6022-7504)
- Tianying Sheng
- Dorje Tashi
- Bingtian Chen (ORCID: https://orcid.org/0009-0009-1459-1888)
- Lobsang Yeshi
Institutions
- The University of Sydney (AU)
- Tibet University (CN)
- University of Electronic Science and Technology of China (CN)
- Qinghai Normal University (CN)
- UNSW Sydney (AU)
Publication Details
- Journal
- CAAI Transactions on Intelligence Technology
- Published
- 2025-11-29
- DOI
- https://doi.org/10.1049/cit2.70078
- Primary Topic
- Handwritten Text Recognition Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Science and Technology Major Project