Co-Evolution of Multilingual Word Vectors and Language Models

Multilingual word vector technology has experienced an evolution from word alignment to unsupervised alignment to multilingual aligned word vectors; and language modelling has evolved from monolingual models to multilingual models based on the Transformer architecture. Both of them are synergistically applied to improve cross-language generalization capability and low-resource language modelling, showing significant advantages. The synergistic evolution of multilingual word vectors and language models promotes the development of cross-language intelligent systems, which will further enhance the machine's ability to understand and generate multilingual scenarios in the future.