AI-Driven Contextual Story Creation with Integrated Text and Visual Generation

This study proposes an AI-driven framework for generating coherent narratives and corresponding visuals tailored for children's stories. We produce textual material by using Long Short-Term Memory (LSTM) models, and visually appealing images by using Generative Adversarial Networks (GANs) and fine-tuned Stable Diffusion Models. Furthermore, we investigate various prefix-based story starting points to increase the variety and interest of the story. Our method includes a significant innovation: the Stable Diffusion model is fine-tuned for image generation, enabling the production of high-quality, contextually relevant images from particular story segments. We show by experiments that the Stable Diffusion model can be fine-tuned to greatly improve the quality and relevance of the produced images, and that the layered LSTM model with extended training produces the best text generation performance. Using these advanced models together improved the storytelling experience by fusing imaginative AI with rich, narrative-driven imagery.

Authors

Publication Details

Published
2024-10-16
DOI
https://doi.org/10.1109/asyu62119.2024.10757014
Citations
2
Primary Topic
Artificial Intelligence in Games
Type
article
Field-Weighted Citation Impact
0.69
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI-Driven Contextual Story Creation with Integrated Text and Visual Generation

Fatma Patlar Akbulut, Büşra Kocaçınar, Vael Kokach, Muhammed Gülsoy
2 citations
Artificial Intelligence in Games
0.69
article

AI-Driven Contextual Story Creation with Integrated Text and Visual Generation

Fatma Patlar Akbulut, Büşra Kocaçınar, Vael Kokach, Muhammed Gülsoy
article en
2 citations

Abstract

This study proposes an AI-driven framework for generating coherent narratives and corresponding visuals tailored for children's stories. We produce textual material by using Long Short-Term Memory (LSTM) models, and visually appealing images by using Generative Adversarial Networks (GANs) and fine-tuned Stable Diffusion Models. Furthermore, we investigate various prefix-based story starting points to increase the variety and interest of the story. Our method includes a significant innovation: the Stable Diffusion model is fine-tuned for image generation, enabling the production of high-quality, contextually relevant images from particular story segments. We show by experiments that the Stable Diffusion model can be fine-tuned to greatly improve the quality and relevance of the produced images, and that the layered LSTM model with extended training produces the best text generation performance. Using these advanced models together improved the storytelling experience by fusing imaginative AI with rich, narrative-driven imagery.

Openalex Percentile: Top 22%
Artificial Intelligence in Games
0.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.