Artistic Fusion: AI Powered Artistry for Story Boarding

Storyboarding is a crucial pre-production step in filmmaking, facilitating the visualization and planning of scenes. However, traditional methods have obstacles such as manual labour, artistic skill requirements, and limitations in dynamic scene representation. This paper presents an innovative AI-powered storyboard generator leveraging Stable Diffusion, implemented in PyTorch. The research addresses obstacles in traditional methods by automating the storyboard creation process, enhancing visual realism, and promoting collaborative filmmaking workflows. The AI-powered system integrates advanced generative techniques to simulate complex visual scenarios, from lighting variations to dynamic camera movements, ensuring a more accurate preview of the final cinematic experience. By utilizing text prompts, the model interprets narrative elements and mood, aligning generated visuals with creative intent. The integration of Stable Diffusion model allows for controlled noise introduction, enhancing realism and immersion in storyboarded scenes. Further, an average improved accuracy of 82% is witnessed when compared to existing methodologies like Dreambooth and LoRA. Key features include a user-friendly interface for intuitive operation, compatibility with diverse media types, and iterative refinement capabilities to fine-tune storyboard quality. Evaluation metrics such as Structural Similarity Index Measure (SSIM) and Peak Signal-to-Noise Ratio (PSNR) demonstrate the system's efficacy in producing high-quality visuals that meet filmmakers' expectations.

Authors

Institutions

Publication Details

Published
2024-10-15
DOI
https://doi.org/10.1109/icses63445.2024.10763187
Primary Topic
Artistic and Creative Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Artistic Fusion: AI Powered Artistry for Story Boarding

D. Amuthaguka, A Bhuvaneshwaran, P Kavya, N. Dhaksana et al.
Artistic and Creative Research
article

Artistic Fusion: AI Powered Artistry for Story Boarding

D. Amuthaguka, A Bhuvaneshwaran, P Kavya, N. Dhaksana, R Eraianbu, S Agilan
article en

Abstract

Storyboarding is a crucial pre-production step in filmmaking, facilitating the visualization and planning of scenes. However, traditional methods have obstacles such as manual labour, artistic skill requirements, and limitations in dynamic scene representation. This paper presents an innovative AI-powered storyboard generator leveraging Stable Diffusion, implemented in PyTorch. The research addresses obstacles in traditional methods by automating the storyboard creation process, enhancing visual realism, and promoting collaborative filmmaking workflows. The AI-powered system integrates advanced generative techniques to simulate complex visual scenarios, from lighting variations to dynamic camera movements, ensuring a more accurate preview of the final cinematic experience. By utilizing text prompts, the model interprets narrative elements and mood, aligning generated visuals with creative intent. The integration of Stable Diffusion model allows for controlled noise introduction, enhancing realism and immersion in storyboarded scenes. Further, an average improved accuracy of 82% is witnessed when compared to existing methodologies like Dreambooth and LoRA. Key features include a user-friendly interface for intuitive operation, compatibility with diverse media types, and iterative refinement capabilities to fine-tune storyboard quality. Evaluation metrics such as Structural Similarity Index Measure (SSIM) and Peak Signal-to-Noise Ratio (PSNR) demonstrate the system's efficacy in producing high-quality visuals that meet filmmakers' expectations.

Kalasalingam Academy of Research and Education (IN)
Openalex Percentile: Top 67%
Artistic and Creative Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.