<i>Audible Garden</i> : Transcoding Literati Traditions in Landscape Representation Through a Multimodal Approach

Abstract This paper analyzes the integration of East Asian literati traditions with contemporary multimedia through two artworks. It proposes a multimodal transcoding framework converting video frames into multisensory outputs via data-driven visualization and sonification. Using a modified turntable, the system interprets an artificial marble disc, created from the artist’s daily creation, to depict mental space using sumi ink. This aligns with literati traditions of expressing inner worlds through landscape paintings as contemplative practice. The study explores how translating these embodied practices into multimodal manifestations offers new perspectives in new media art while broadening the representations of landscape in an intercultural context.