Optimized Story Generation using DeepSeek LLM with Supervised Fine-Tuning

Automated story generation using Large Language Models (LLMs) has gained significant attention due to its applications in creative writing, education, and interactive systems. Despite advancements, existing LLMs often generate narratives that lack coherence, contextual alignment, and semantic accuracy, limiting their effectiveness in real-world applications. Addressing these challenges requires systematic model adaptation and optimization. This study focuses on enhancing the story generation capabilities of the DeepSeek-7B model through Supervised Fine-Tuning (SFT) and content moderation. The objective is to improve lexical overlap, contextual relevance, and narrative fluency by training the model on a curated dataset of structured narratives. The proposed methodology involves fine-tuning DeepSeek-7B using high-quality training data, optimizing for linguistic coherence and semantic alignment followed by content filtering. The model's performance is evaluated using ROUGE-1, ROUGE-2, ROUGE-L, METEOR, and BERT Score to quantify improvements over zero-shot generation. Experimental results demonstrate a 15% improvement in ROUGE-1, a 31% increase in ROUGE-2, and notable gains in METEOR and BERT scores, indicating superior content generation capabilities. These enhancements validate the effectiveness of SFT in refining narrative consistency and linguistic diversity. The findings contribute to advancing AI-driven storytelling by improving the structural and semantic integrity of generated content. This research underscores the potential of supervised adaptation in enhancing LLM performance for real-world generative applications.

Authors

Institutions

Publication Details

Published
2025-05-07
DOI
https://doi.org/10.1109/rmkmate64874.2025.11042725
Citations
3
Primary Topic
Computational and Text Analysis Methods
Type
article
Field-Weighted Citation Impact
16.03
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Optimized Story Generation using DeepSeek LLM with Supervised Fine-Tuning

P Velvizhy, P. Steffy Sherly, P Matan
3 citations
Computational and Text Analysis Methods
16.03
article

Optimized Story Generation using DeepSeek LLM with Supervised Fine-Tuning

P Velvizhy, P. Steffy Sherly, P Matan
article en
3 citations

Abstract

Automated story generation using Large Language Models (LLMs) has gained significant attention due to its applications in creative writing, education, and interactive systems. Despite advancements, existing LLMs often generate narratives that lack coherence, contextual alignment, and semantic accuracy, limiting their effectiveness in real-world applications. Addressing these challenges requires systematic model adaptation and optimization. This study focuses on enhancing the story generation capabilities of the DeepSeek-7B model through Supervised Fine-Tuning (SFT) and content moderation. The objective is to improve lexical overlap, contextual relevance, and narrative fluency by training the model on a curated dataset of structured narratives. The proposed methodology involves fine-tuning DeepSeek-7B using high-quality training data, optimizing for linguistic coherence and semantic alignment followed by content filtering. The model's performance is evaluated using ROUGE-1, ROUGE-2, ROUGE-L, METEOR, and BERT Score to quantify improvements over zero-shot generation. Experimental results demonstrate a 15% improvement in ROUGE-1, a 31% increase in ROUGE-2, and notable gains in METEOR and BERT scores, indicating superior content generation capabilities. These enhancements validate the effectiveness of SFT in refining narrative consistency and linguistic diversity. The findings contribute to advancing AI-driven storytelling by improving the structural and semantic integrity of generated content. This research underscores the potential of supervised adaptation in enhancing LLM performance for real-world generative applications.

Anna University, Chennai (IN)
Climate action
Openalex Percentile: Top 1%
Computational and Text Analysis Methods
16.03
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.