A Multitask XLM-R-Based Hybrid Approach for Named Entity Recognition, Coreference Resolution, and Genealogical Relation Extraction from Uzbek Historical Documents

Automatically extracting genealogical information from historical documents in the Uzbek language requires identifying personal names, linking various expressions referring to the same individual, and determining kinship relations between persons. However, this process is complicated by factors such as variations in the spelling of personal names, the presence of archaic vocabulary, and the distribution of information regarding a single individual across different parts of the text. This study proposes a multi-task hybrid approach based on the XLM-RoBERTa-large model to solve these problems. In the proposed system, named entities are identified using BiLSTM–CRF, expressions referring to the same individual are linked via a coreference model, and genealogical relations are determined using a combination of a neural model and mechanisms based on kinship rules. The approach was evaluated on the ArchiveGene-Real dataset of 171 authentic Uzbek historical documents; every configuration was retrained with five random seeds, and differences were tested with a paired document-level bootstrap and Holm correction. The full system reached F1 = 0.624 ± 0.021 for named entity recognition, CoNLL F1 = 0.570 ± 0.010 for coreference, and F1 = 0.441 ± 0.026 for genealogical relation extraction. With gold person mentions, coreference rose to 0.802 ± 0.009 and relation F1 to 0.509 ± 0.029; with gold mentions and gold coreference, the kinship grammar reached 0.627, which shows that most of the remaining error arises upstream of the relation stage. Neither the neural relation head (0.242) nor lexical rules alone (0.150) came close to the full system, and disabling coreference, entity refinement or cluster splitting lowered relation F1 significantly. All retrained components (domain adaptation, BiLSTM, CRF, cluster attention, and the auxiliary mention and relation losses) improved NER significantly. A single-task NER model scored higher than the multi-task model (0.669 vs. 0.624; p = 0.125), but replacing the NER stage with the strongest standalone encoder left relation F1 unchanged (0.440). On 13 external documents, NER and coreference transferred well, whereas relation F1 fell to 0.186; this gap was traced to the coverage of the kinship grammar rather than to the neural components. The results show that combining neural document-level modelling with explicit kinship knowledge is an effective and transparent way to extract genealogical information from historical documents. The main limitations are the small size of the corpus and of the external set, the use of manually corrected transcriptions (the OCR error rate was not measured), and the restriction of mentions to named references.

Authors

Institutions

Publication Details

Journal
Machine Learning and Knowledge Extraction
Published
2026-11-12
DOI
https://doi.org/10.3390/make8110378
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A Multitask XLM-R-Based Hybrid Approach for Named Entity Recognition, Coreference Resolution, and Genealogical Relation Extraction from Uzbek Historical Documents

Mukaddas Abduraxmanova, Samandarov Batirbek Satimovich, Dauletov Adilbek Yusupbayevich, Noila Matyakubova et al.
Machine Learning and Knowledge Extraction
Topic Modeling
article

A Multitask XLM-R-Based Hybrid Approach for Named Entity Recognition, Coreference Resolution, and Genealogical Relation Extraction from Uzbek Historical Documents

Mukaddas Abduraxmanova, Samandarov Batirbek Satimovich, Dauletov Adilbek Yusupbayevich, Noila Matyakubova, Gulnozakhon Oripova, Shahlo Khamroeva, Gulchexra Cho‘lliyeva
article en

Abstract

Automatically extracting genealogical information from historical documents in the Uzbek language requires identifying personal names, linking various expressions referring to the same individual, and determining kinship relations between persons. However, this process is complicated by factors such as variations in the spelling of personal names, the presence of archaic vocabulary, and the distribution of information regarding a single individual across different parts of the text. This study proposes a multi-task hybrid approach based on the XLM-RoBERTa-large model to solve these problems. In the proposed system, named entities are identified using BiLSTM–CRF, expressions referring to the same individual are linked via a coreference model, and genealogical relations are determined using a combination of a neural model and mechanisms based on kinship rules. The approach was evaluated on the ArchiveGene-Real dataset of 171 authentic Uzbek historical documents; every configuration was retrained with five random seeds, and differences were tested with a paired document-level bootstrap and Holm correction. The full system reached F1 = 0.624 ± 0.021 for named entity recognition, CoNLL F1 = 0.570 ± 0.010 for coreference, and F1 = 0.441 ± 0.026 for genealogical relation extraction. With gold person mentions, coreference rose to 0.802 ± 0.009 and relation F1 to 0.509 ± 0.029; with gold mentions and gold coreference, the kinship grammar reached 0.627, which shows that most of the remaining error arises upstream of the relation stage. Neither the neural relation head (0.242) nor lexical rules alone (0.150) came close to the full system, and disabling coreference, entity refinement or cluster splitting lowered relation F1 significantly. All retrained components (domain adaptation, BiLSTM, CRF, cluster attention, and the auxiliary mention and relation losses) improved NER significantly. A single-task NER model scored higher than the multi-task model (0.669 vs. 0.624; p = 0.125), but replacing the NER stage with the strongest standalone encoder left relation F1 unchanged (0.440). On 13 external documents, NER and coreference transferred well, whereas relation F1 fell to 0.186; this gap was traced to the coverage of the kinship grammar rather than to the neural components. The results show that combining neural document-level modelling with explicit kinship knowledge is an effective and transparent way to extract genealogical information from historical documents. The main limitations are the small size of the corpus and of the external set, the use of manually corrected transcriptions (the OCR error rate was not measured), and the restriction of mentions to named references.

Machine Learning and Knowledge ExtractionVol. 8(11)
Bukhara State University (UZ), Ferghana State University (UZ), Kimyo International University in Tashkent (UZ), Alfraganus University (UZ), Alisher Navo'i Tashkent State University of Uzbek Language and Literature (UZ), National University of Uzbekistan (UZ)
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon