Enhancing Tourist Experiences with AI: The Integration of LLMs and Audio Augmented Reality

In this article, the Insight Explorer system, which utilizes artificial intelligence (AI) and audio augmented reality (AR), is introduced as a tool designed to transform tourist experiences through immersive audio narratives delivered via AR Smart Glasses. This innovative system employs the GPT-4-Vision API for accurate landmark identification, maintaining high performance even under complex environmental conditions. Our comprehensive evaluation and detailed case studies demonstrate the system's effectiveness and versatility, particularly in enhancing user immersion through advanced spatial audio processing techniques. While the system achieves significant milestones, it also presents challenges in computational demands. Future work will concentrate on optimizing and expanding the system to further enhance its capabilities. Overall, the integration of AI and audio AR by the Insight Explorer marks a substantial progress in the development of intelligent, immersive tourism solutions.