Real-World Application of Machine Translation of Cantonese-to-Written-Chinese Translation

This paper explores integrating a Cantonese-to-Written-Chinese translation model into a real-world application. This translation model is selected amongst various pre-trained models after being trained with a large parallel corpus of Cantonese and written Chinese language pairs and a test set manually translated by the native translators to ensure evaluation reliability. We implemented the best-performing model into a subtitle-generating application with an unsaturated Cantonese market, generating subtitles in written Chinese with Cantonese audio by incorporating speech-to-text and the translation model. In the evaluation, the test set is split into high-similarity cases and low-similarity cases. The low similarity cases are considered more difficult translation tasks since the sequences have relatively more Cantonese proportions. Our model achieved similar performance with the Microsoft Azure system in high-similarity cases. At the same time, it achieved a 30.1 BLEU score and 22.6 CHRF++ score, which outperformed Microsoft Azure with a 28.5 BLEU score and 21.2 CHRF++ score in the low similarity cases. With the combination of Cantonese input from our application, using the model can also reduce processing time while being comparable with existing translation tools.

Authors

Publication Details

Published
2024-12-13
DOI
https://doi.org/10.1145/3711542.3711546
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Real-World Application of Machine Translation of Cantonese-to-Written-Chinese Translation

Siu-Kei Au Yeung, Raptor Yick-Kan Kwok, Marvin Ng, Thomas Tsang et al.
Natural Language Processing Techniques
article

Real-World Application of Machine Translation of Cantonese-to-Written-Chinese Translation

Siu-Kei Au Yeung, Raptor Yick-Kan Kwok, Marvin Ng, Thomas Tsang, L M Lau
article en

Abstract

This paper explores integrating a Cantonese-to-Written-Chinese translation model into a real-world application. This translation model is selected amongst various pre-trained models after being trained with a large parallel corpus of Cantonese and written Chinese language pairs and a test set manually translated by the native translators to ensure evaluation reliability. We implemented the best-performing model into a subtitle-generating application with an unsaturated Cantonese market, generating subtitles in written Chinese with Cantonese audio by incorporating speech-to-text and the translation model. In the evaluation, the test set is split into high-similarity cases and low-similarity cases. The low similarity cases are considered more difficult translation tasks since the sequences have relatively more Cantonese proportions. Our model achieved similar performance with the Microsoft Azure system in high-similarity cases. At the same time, it achieved a 30.1 BLEU score and 22.6 CHRF++ score, which outperformed Microsoft Azure with a 28.5 BLEU score and 21.2 CHRF++ score in the low similarity cases. With the combination of Cantonese input from our application, using the model can also reduce processing time while being comparable with existing translation tools.

Quality Education
Openalex Percentile: Top 73%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.