Demo: StoryFrames: A Context-Aware Comic Generation System Based on Mobile Cloud Computing

This paper designs and implements a deep learning based context-aware comic generation system, called StoryFrames, to automatically generate the comic strips with dialogues based on mobile cloud computing. The input text from a user to generate comic strips is analyzed to extract key contextual words for achieving artistic style consistency, which is a challenge faced by existing generative models. Through in-depth analysis of the input text, StoryFrames extracts visually and narratively rich scenes and ranks them based on their importance for arranging these scenes in the comic strips. In addition, deep sentiment analysis is explored to precisely reveal emotional fluctuations in the dialogues and select dialogue box styles that match the emotional states of the characters. To the best of our knowledge, this is the first system that explores deep learning, large language models, and mobile cloud computing to ensure coherence among elements within the comic strips and consistency in the overall story's logic, emotion, style, and contextual descriptions. In particular, an Android-based prototype is implemented to verify the feasibility and performance of StoryFrames.