A DeepSeek-R1 fine-tuning approach for missing character inference in Dunhuang ancient Tibetan texts

Tibetan ancient books contain rich historical, philosophical, and medical knowledge, but many manuscripts are fragmented and illegible due to poor preservation. Traditional manual repair relies on expert judgment, which is inefficient and subjectively biased. This article proposes a method for inferring missing characters in Dunhuang ancient Tibetan texts by fine-tuning the DeepSeek-R1 large-scale language model. By integrating large modern Tibetan and ancient Tibetan texts from Dunhuang, a reasoning model, DeepSeek-R1-Tibet, suitable for the semantic context of ancient Tibetan, was constructed. The experimental results demonstrate that fine-tuned DeepSeek-R1-Tibet achieves the largest performance gains across all conditions, outperforming CINO, mBERT, and TisBERT on the Hits@3 metric in the three-syllable condition (0.667 vs. 0.456 for mBERT), where generative reasoning over broader context proves increasingly advantageous. This work has opened up new avenues for the digital preservation and intelligent organization of Tibetan ancient books.

Authors

Publication Details

Journal
npj Heritage Science
Published
2026-10-15
DOI
https://doi.org/10.1038/s40494-026-03045-x
Primary Topic
Handwritten Text Recognition Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A DeepSeek-R1 fine-tuning approach for missing character inference in Dunhuang ancient Tibetan texts

Liyuan Zhou, Dingguo Gao, Jingyi Li, Hongmei Gao
npj Heritage Science
Handwritten Text Recognition Techniques
article

A DeepSeek-R1 fine-tuning approach for missing character inference in Dunhuang ancient Tibetan texts

Liyuan Zhou, Dingguo Gao, Jingyi Li, Hongmei Gao
article en

Abstract

Tibetan ancient books contain rich historical, philosophical, and medical knowledge, but many manuscripts are fragmented and illegible due to poor preservation. Traditional manual repair relies on expert judgment, which is inefficient and subjectively biased. This article proposes a method for inferring missing characters in Dunhuang ancient Tibetan texts by fine-tuning the DeepSeek-R1 large-scale language model. By integrating large modern Tibetan and ancient Tibetan texts from Dunhuang, a reasoning model, DeepSeek-R1-Tibet, suitable for the semantic context of ancient Tibetan, was constructed. The experimental results demonstrate that fine-tuned DeepSeek-R1-Tibet achieves the largest performance gains across all conditions, outperforming CINO, mBERT, and TisBERT on the Hits@3 metric in the three-syllable condition (0.667 vs. 0.456 for mBERT), where generative reasoning over broader context proves increasingly advantageous. This work has opened up new avenues for the digital preservation and intelligent organization of Tibetan ancient books.

npj Heritage Science
National Natural Science Foundation of China
Openalex Percentile: Top 16%
Handwritten Text Recognition Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.