Generative Live Commentaries Interacting with Geospatial Context for Promoting Local Festivals

With the advancement of robust network connections and the rise of live streaming platforms, it has become possible to experience local events and walking tours remotely in real-time. This study introduces a city-wide audio augmented reality system designed to enhance engagement at local festivals by combining livestreamed video with character-driven commentaries on local history and event details. To ensure continuous storytelling, even in areas with few points of interest, this study proposes a novel geofencing architecture that considers multilayered city features, enabling seamless audio guide experiences. Additionally, this paper introduces prompt engineering for generating entertaining and listener-friendly guide scripts, tailored for large language models, named the geofence-to-conversation technique. A preliminary study of our prototype system, deployed at an actual local festival, demonstrates its effectiveness and potential for enhancing regional promotion.