Quantitative Evaluation of Translation Quality and Computational Efficiency in Semantic vs. Phonetic Strategies for Chinese Scientific Terms

This study presents a quantitative evaluation of translation quality and computational efficiency between semantic and phonetic translation strategies for Chinese scientific terms, using Large Language Models (LLMs). Focusing on two representative domains—the Chinese periodic table and heterocyclic compound nomenclature—we propose a back-translation framework (LLM-BT) specifically designed for evaluating scientific terminology translation, conducting Chinese→ English→ Chinese cycles with Grok, DeepSeek, and GPT-4 models. BLEU scores are used to assess translation accuracy. Results show that semantic translation of element names achieves near-perfect performance (BLEU ≈1.00), leveraging the compositional properties of Chinese characters. In contrast, phonetic translation of heterocyclic compounds yields lower BLEU scores (0.55-0.65), reflecting the inherent challenges of transliteration. Multilingual comparisons using Google Translate (Chinese, Japanese, Korean, English) further validate the superiority of semantic translation strategies (BLEU 0.94-0.99) over phonetic approaches (0.16-0.36). Also, byte-level analysis reveals that Chinese semantic and pictophonetic names are more compact (3 bytes per element) compared to Japanese (13.73 bytes) and Korean (8.97 bytes) transliterations. These findings highlight the dual advantages of semantic translation for both accuracy and computational efficiency. We advocate prioritizing semantic strategies in scientific terminology standardization and cross-linguistic knowledge transfer.

Authors

Institutions

Publication Details

Published
2025-08-03
DOI
https://doi.org/10.1109/ialp68296.2024.11156243
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Quantitative Evaluation of Translation Quality and Computational Efficiency in Semantic vs. Phonetic Strategies for Chinese Scientific Terms

Pedro Carvalho Brom, Li Weigang, Rafael Marconi Ramos
Natural Language Processing Techniques
article

Quantitative Evaluation of Translation Quality and Computational Efficiency in Semantic vs. Phonetic Strategies for Chinese Scientific Terms

Pedro Carvalho Brom, Li Weigang, Rafael Marconi Ramos
article en

Abstract

This study presents a quantitative evaluation of translation quality and computational efficiency between semantic and phonetic translation strategies for Chinese scientific terms, using Large Language Models (LLMs). Focusing on two representative domains—the Chinese periodic table and heterocyclic compound nomenclature—we propose a back-translation framework (LLM-BT) specifically designed for evaluating scientific terminology translation, conducting Chinese→ English→ Chinese cycles with Grok, DeepSeek, and GPT-4 models. BLEU scores are used to assess translation accuracy. Results show that semantic translation of element names achieves near-perfect performance (BLEU ≈1.00), leveraging the compositional properties of Chinese characters. In contrast, phonetic translation of heterocyclic compounds yields lower BLEU scores (0.55-0.65), reflecting the inherent challenges of transliteration. Multilingual comparisons using Google Translate (Chinese, Japanese, Korean, English) further validate the superiority of semantic translation strategies (BLEU 0.94-0.99) over phonetic approaches (0.16-0.36). Also, byte-level analysis reveals that Chinese semantic and pictophonetic names are more compact (3 bytes per element) compared to Japanese (13.73 bytes) and Korean (8.97 bytes) transliterations. These findings highlight the dual advantages of semantic translation for both accuracy and computational efficiency. We advocate prioritizing semantic strategies in scientific terminology standardization and cross-linguistic knowledge transfer.

Universidade de Brasília (BR), Instituto Federal de Educação, Ciência e Tecnologia de Brasília (BR)
Openalex Percentile: Top 87%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.