Unsupervised Acquisition of Machine Translation Corpus Combining LSTM-BiRNN Classifiers

The field of machine translation has advanced significantly due to artificial intelligence technology. To further enhance the quality of the parallel corpus, the study first achieved bilingual semantic acquisition, created parallel sentence pairs, and built a classifier for extracting parallel sentences using recurrent neural networks. The experimental results show that compared wit h the existing state-of-the-art models, the parallel corpus mining method designed by the study has the best performance in terms of accuracy and F1 value, achieving an accuracy of 0.981 and an F1 value of 0.928. Mining different bilingual corpora all obtained high Jaccard similarity, and mining 10,000 pairs of utterances only took 41.64 s. The machine translation system achieved the best translation quality on the parallel corpus mined by the research-designed method, with bilingual substitution measure of 47.46, character F1 score of 76.06, and translation editing rate of 65.14. The design of the study can further improve the quality of parallel corpus and promote the development of machine translation technology.

Authors

Institutions

Publication Details

Journal
IET conference proceedings.
Published
2025-01-09
DOI
https://doi.org/10.1049/icp.2024.4188
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Unsupervised Acquisition of Machine Translation Corpus Combining LSTM-BiRNN Classifiers

Yidan Piao
IET conference proceedings.
Natural Language Processing Techniques
article

Unsupervised Acquisition of Machine Translation Corpus Combining LSTM-BiRNN Classifiers

Yidan Piao
article en

Abstract

The field of machine translation has advanced significantly due to artificial intelligence technology. To further enhance the quality of the parallel corpus, the study first achieved bilingual semantic acquisition, created parallel sentence pairs, and built a classifier for extracting parallel sentences using recurrent neural networks. The experimental results show that compared wit h the existing state-of-the-art models, the parallel corpus mining method designed by the study has the best performance in terms of accuracy and F1 value, achieving an accuracy of 0.981 and an F1 value of 0.928. Mining different bilingual corpora all obtained high Jaccard similarity, and mining 10,000 pairs of utterances only took 41.64 s. The machine translation system achieved the best translation quality on the parallel corpus mined by the research-designed method, with bilingual substitution measure of 47.46, character F1 score of 76.06, and translation editing rate of 65.14. The design of the study can further improve the quality of parallel corpus and promote the development of machine translation technology.

IET conference proceedings.Vol. 2024(21)
Eastern Liaoning University (CN)
Openalex Percentile: Top 100%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Unsupervised Acquisition of Machine Translation Corpus Combining LSTM-BiRNN Classifiers — Yidan Piao · IET conference proceedings. (2025) | TGRS Research Map | TGRS