Large language models learning to write rhyming Tang poetry A Xunzi Yayun R1 case study
This study explores using a GRPO (Generative Ranking Policy Optimization) reward mechanism combined with RAG (Retrieval Augmented Generation) to train a large language model for creating Tang poetry. The goal was to generate poems that adhere to traditional rules of tone, rhyme, parallelism, and word count while maintaining high artistic quality.The methodology involved building a specialized corpus, using DeepSeek-R1-671B for data distillation, and applying GRPO-based reinforcement learning. Integrating RAG technology further enhanced generation quality.Results showed that the resulting model, Xunzi-Yayun-R1, significantly surpassed the baseline in accurately following poetic rules. This research successfully fuses traditional literary norms with modern generative techniques, providing a viable path for generating other classical texts.
Authors
- Liu Liu (ORCID: https://orcid.org/0000-0002-3894-7844)
- Wenhua Zhao (ORCID: https://orcid.org/0000-0002-8061-2001)
- Xiyu Wang (ORCID: https://orcid.org/0009-0009-2347-2098)
- Jiacheng He (ORCID: https://orcid.org/0000-0002-1940-4262)
- Chang Liu (ORCID: https://orcid.org/0009-0008-4222-3209)
- Zhixiao Zhao (ORCID: https://orcid.org/0009-0007-1992-4296)
Institutions
- Nanjing Agricultural University (CN)
Publication Details
- Journal
- npj Heritage Science
- Published
- 2025-10-14
- DOI
- https://doi.org/10.1038/s40494-025-02087-x
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Social Science Foundation of Jiangsu Province