Application of Digital Interactive Experience System for Cultural and Tourism based on Augmented Reality with YOLOv3

Now a day’s tourism industry in Asia is more than ever being modernized by innovative technologies, an undisputable reality that was converting the sector in different ways. To create a memorable experience there were no embracing innovations and feedback mechanism are there for better engagement. In this paper, the proposed Augmented Realities with You Only Look Once (AR-YOLOv3) detects any cultural and tourism objects with marker less AR through an interactive application. Initially, the user and admin login to the web-based system and the details are saved to database for further accessibility. The scale invariant feature transform method is used to extract Scale Invariant Feature Transform (SIFT) features from the image. To achieve better performance the SIFT features are divided into threads by using multithreaded approach. These thread frames are given as input to YOLOv3 algorithm for a real-time object detection. The simulation setup for proposed AR-YOLOv3 achieved a better results including accuracy 85.83%, precision 87.29% and recall 88.49%.