Immersive Synthetic Memories: Transforming AI-Generated 2D Memories into Virtual Environments

Abstract The DDS Synthetic Memories project has developed techniques using Gen-AI technologies to recreate past visual experiences that may have faded, changed, or been forgotten. The Immersive Synthetic Memories project extends these efforts to immerse subjects in virtual recreations of their memories. The installation invites participants into an intimate setting to recall memories instantly rendered with generative AI and spatialized for VR headsets. The project is a collaboration with Barcelona-based Domestic Data Streamers (DDS), the University of Southern California’s Mobile & Environmental Media Lab, and Scott Fisher’s course Spatial Imaging for XR. This paper explores the artistic and technical processes, the AI pipeline converting 2D visuals into 3D 180° immersive spaces, development challenges, and potential applications in mental health and memory studies.