Script generation from synthetic stories using lightweight LLM and emotion-aware TTS pipelines

This study presents a complete end-to-end pipeline for generating emotionally annotated dialogues in the format Speaker (Emotion): Dialogue, conditioned on a given set of keywords. The system begins with a Hugging Face short story dataset used to build the training corpus. To accurately identify speakers and gender, FastCoref was applied with dialogue masking, followed by BookNLP for improved entity and gender resolution. Emotional context was assigned to each dialogue using a Bi-GRU–based emotion classification model, while representative keywords were extracted using Mistral-7B through few-shot prompt engineering. The resulting dataset of keyword–story pairs was then used to fine-tune three lightweight generative models: TinyLlama, Phi-1.5, and GPTNeo for conditional story generation. Model outputs were evaluated through both automated and human-centered assessments. Automated metrics such as perplexity and Distinct-1/Distinct-2 measured fluency and lexical diversity, while an LLM-based reviewer (DeepSeek-chat-v3-0324) rated coherence, creativity, and linguistic quality. In parallel, a human evaluation was conducted using Google Forms, where five participants rated 20 generated stories on coherence, emotional engagement, and overall quality. The averaged human ratings were compared with LLM-based scores to validate consistency in subjective and model-based evaluation. Overall, GPTNeo achieved the highest combined performance, with superior lexical diversity and an average rating of 4.0/5, followed by Phi-1.5 (3.6) and TinyLlama (2.8).

Authors

Institutions

Publication Details

Journal
Social Network Analysis and Mining
Published
2025-12-05
DOI
https://doi.org/10.1007/s13278-025-01558-0
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Script generation from synthetic stories using lightweight LLM and emotion-aware TTS pipelines

Ujwala Patil, Aniket Kailas Shahade
Social Network Analysis and Mining
Sentiment Analysis and Opinion Mining
article

Script generation from synthetic stories using lightweight LLM and emotion-aware TTS pipelines

Ujwala Patil, Aniket Kailas Shahade
article en

Abstract

This study presents a complete end-to-end pipeline for generating emotionally annotated dialogues in the format Speaker (Emotion): Dialogue, conditioned on a given set of keywords. The system begins with a Hugging Face short story dataset used to build the training corpus. To accurately identify speakers and gender, FastCoref was applied with dialogue masking, followed by BookNLP for improved entity and gender resolution. Emotional context was assigned to each dialogue using a Bi-GRU–based emotion classification model, while representative keywords were extracted using Mistral-7B through few-shot prompt engineering. The resulting dataset of keyword–story pairs was then used to fine-tune three lightweight generative models: TinyLlama, Phi-1.5, and GPTNeo for conditional story generation. Model outputs were evaluated through both automated and human-centered assessments. Automated metrics such as perplexity and Distinct-1/Distinct-2 measured fluency and lexical diversity, while an LLM-based reviewer (DeepSeek-chat-v3-0324) rated coherence, creativity, and linguistic quality. In parallel, a human evaluation was conducted using Google Forms, where five participants rated 20 generated stories on coherence, emotional engagement, and overall quality. The averaged human ratings were compared with LLM-based scores to validate consistency in subjective and model-based evaluation. Overall, GPTNeo achieved the highest combined performance, with superior lexical diversity and an average rating of 4.0/5, followed by Phi-1.5 (3.6) and TinyLlama (2.8).

Social Network Analysis and MiningVol. 16(1)
Symbiosis International University (IN)
Openalex Percentile: Top 79%
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.