Unsupervised cross-lingual part-of-speech tagging with monolingual corpora only

Due to the scarcity of part-of-speech (POS) annotated data for low-resource languages, existing studies have predominantly relied on unsupervised methods. Among these methods, annotation projection transfers POS tags from a high-resource source language to a low-resource target language through word alignments derived from parallel corpora, making it particularly suitable for low-resource scenarios. However, its effectiveness depends heavily on the availability of parallel corpora, which remain scarce or entirely unavailable for many low-resource languages. To address this limitation, we propose a fully unsupervised cross-lingual POS tagging framework that relies solely on monolingual corpora and leverages an unsupervised neural machine translation (UNMT) system. Specifically, the UNMT system translates sentences from a high-resource language into a low-resource language to construct pseudo-parallel sentence pairs. A target language POS tagger is then trained based on the standard annotation projection procedure. Moreover, we introduce a multi-source projection technique to calibrate the POS tags projected on the target side, thereby improving the quality of the annotations used to train the target language POS tagger. We evaluate the proposed framework on 28 language pairs, covering four source languages (English, German, Spanish and French) and seven target languages (Afrikaans, Basque, Finnish, Indonesian, Lithuanian, Portuguese and Turkish). Experimental results show that our method achieves performance comparable to that of a baseline cross-lingual POS tagger trained on genuine parallel sentence pairs and even outperforms it for several target languages. Furthermore, the proposed multi-source projection technique further improves tagging performance, yielding an average gain of 1.3% over previous methods.

Authors

Institutions

Publication Details

Journal
Complex & Intelligent Systems
Published
2026-09-09
DOI
https://doi.org/10.1007/s40747-026-02498-8
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Unsupervised cross-lingual part-of-speech tagging with monolingual corpora only

Jianyu Zheng
Complex & Intelligent Systems
Natural Language Processing Techniques
article

Unsupervised cross-lingual part-of-speech tagging with monolingual corpora only

Jianyu Zheng
article en

Abstract

Due to the scarcity of part-of-speech (POS) annotated data for low-resource languages, existing studies have predominantly relied on unsupervised methods. Among these methods, annotation projection transfers POS tags from a high-resource source language to a low-resource target language through word alignments derived from parallel corpora, making it particularly suitable for low-resource scenarios. However, its effectiveness depends heavily on the availability of parallel corpora, which remain scarce or entirely unavailable for many low-resource languages. To address this limitation, we propose a fully unsupervised cross-lingual POS tagging framework that relies solely on monolingual corpora and leverages an unsupervised neural machine translation (UNMT) system. Specifically, the UNMT system translates sentences from a high-resource language into a low-resource language to construct pseudo-parallel sentence pairs. A target language POS tagger is then trained based on the standard annotation projection procedure. Moreover, we introduce a multi-source projection technique to calibrate the POS tags projected on the target side, thereby improving the quality of the annotations used to train the target language POS tagger. We evaluate the proposed framework on 28 language pairs, covering four source languages (English, German, Spanish and French) and seven target languages (Afrikaans, Basque, Finnish, Indonesian, Lithuanian, Portuguese and Turkish). Experimental results show that our method achieves performance comparable to that of a baseline cross-lingual POS tagger trained on genuine parallel sentence pairs and even outperforms it for several target languages. Furthermore, the proposed multi-source projection technique further improves tagging performance, yielding an average gain of 1.3% over previous methods.

Complex & Intelligent Systems
University of Electronic Science and Technology of China (CN)
Quality Education
Openalex Percentile: Top 88%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.