Chinese Story Generation Based on Style Control of Transformer Model and Content Evaluation Method

Natural language processing (NLP) has numerous applications and has been extensively developed in deep learning. In recent years, language models such as Transformer, BERT, and GPT have frequently been the foundation for related research. However, relatively few studies have focused on evaluating the quality of generated sentences. While traditional evaluation methods like BLEU can be applied, the challenge is that there is no ground truth reference for generated sentences, making it difficult to establish a reliable evaluation criterion. Therefore, this study examines the content generated by Bidirectional Encoder Representations and related recurrent methods based on the Transformer model. Specifically, we focus on analyzing sentence fluency by assessing the degree of part-of-speech (PoS) matching and the coherence of PoS context ordering. Determining whether the generated sentences align with the expected PoS structure of the model is crucial, as it significantly impacts the readability of the generated text.