Spatial Storybook: Language Model-driven Audiobook Spatialization

Figure 1: The Spatial Storybook system automatically converts a monaural audiobook into an immersive binaural presentation.It is comprised of an LLM prompted to reimagine a passage of text as a stage play, with stage positions associated with each spoken dialogue and room descriptions associated with each scene; this information ultimately conditions a real-time scene rendering engine.