AI-Enhanced Storytelling: Integrating Visual, Textual, and Auditory Elements Through Multimodality

This study explores the integration of Artificial Intelligence (AI) in experience design, focusing on its role in creating a multi-sensory experience that bridges visual, textual, and auditory elements. The research centers on the album "Sky of Summer Nights,” where music generated by Suno AI complements illustrations and lyrics created by the author, Evan Raditya Pratomo. The project features three original illustrations, each corresponding to a song: "The Fairy Tale of Pink Summer,” "A Hug for Pink Moon,” and "Freed His Heart.” This research demonstrates how creative expression can be enhanced through multimodal principles, highlighting the challenges of effectively conveying messages through a combination of mediums. The findings affirm that the integration of AI can preserve the integrity of traditional design practices while offering new possibilities for innovation. By applying multimodal design theory, the study illustrates how AI is not only a tool but a catalyst for new emotional and creative experiences across disciplines. This research emphasizes the collaboration between human creativity and Suno AI, driving forward innovation in the fields of visual communication and experience design. Keywords: sky of summer nights; multi-sensory; multimodal; creative expression; suno AI

Authors

Institutions

Publication Details

Journal
ULTIMART Jurnal Komunikasi Visual
Published
2024-12-29
DOI
https://doi.org/10.31937/ultimart.v17i2.3817
Primary Topic
Digital Storytelling and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI-Enhanced Storytelling: Integrating Visual, Textual, and Auditory Elements Through Multimodality

Evan Raditya Pratomo
ULTIMART Jurnal Komunikasi Visual
Digital Storytelling and Education
article

AI-Enhanced Storytelling: Integrating Visual, Textual, and Auditory Elements Through Multimodality

Evan Raditya Pratomo
article en

Abstract

This study explores the integration of Artificial Intelligence (AI) in experience design, focusing on its role in creating a multi-sensory experience that bridges visual, textual, and auditory elements. The research centers on the album "Sky of Summer Nights,” where music generated by Suno AI complements illustrations and lyrics created by the author, Evan Raditya Pratomo. The project features three original illustrations, each corresponding to a song: "The Fairy Tale of Pink Summer,” "A Hug for Pink Moon,” and "Freed His Heart.” This research demonstrates how creative expression can be enhanced through multimodal principles, highlighting the challenges of effectively conveying messages through a combination of mediums. The findings affirm that the integration of AI can preserve the integrity of traditional design practices while offering new possibilities for innovation. By applying multimodal design theory, the study illustrates how AI is not only a tool but a catalyst for new emotional and creative experiences across disciplines. This research emphasizes the collaboration between human creativity and Suno AI, driving forward innovation in the fields of visual communication and experience design. Keywords: sky of summer nights; multi-sensory; multimodal; creative expression; suno AI

ULTIMART Jurnal Komunikasi VisualVol. 17(2)
Universitas Ciputra (ID)
Industry, innovation and infrastructure
Openalex Percentile: Top 61%
Digital Storytelling and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.