Integrating computer vision and AI for interactive augmented reality experiences in new media

Abstract. Augmented reality (AR) is a groundbreaking technology that fully immerse the user in a mixed 'reality' where the real and virtual coexist in a unique manner. Integrating more artificial intelligence (AI) and computer vision into AR devices can greatly improve user input and provide a whole novel interface. Through AI technology, such as gesture recognition, object tracking, and face recognition, AR systems can offer more intuitive and engaging interactions. An AR system featuring such improved AI technologies can process real-time data while having the contextual awareness to respond to users' input and the surrounding environment on the fly. It can also provide narrative integration, character development, and dynamic environments to users, thereby enabling them to have a more personalised and meaningful experience. This paper examines the evolution of new media by discussing the possibilities of using AI and computer vision in AR devices to create personalised experiences, all the while critically looking at technical challenges and the opportunities they present to the field of future research and development. It also looks at case studies across different sectors, such as education, training, tourism, gaming, retail, and aviation to justify the potential of future development of AI-enhanced AR.