ENHANCE OBJECT TRACKING ON AUGMENTED REALITY USING HYBRID CONVOLUTIONAL NEURAL NETWORK AND FAST CORNER DETECTION

Markerless augmented reality (AR) is utilized in applications that do not require anchoring to the real world and do not require the use of physical markers (fiducial markers). Augmented object displays not only float but also allow for the automatic placement of 3D augmented reality objects on flat surfaces to enhance realism in real time. There are two challenges that need to be addressed in Markerless AR systems: object tracking and registration, as well as the influence of light intensity. Therefore, the objective of this research is to propose the use of Convolutional Neural Networks (CNN) and Features from Accelerated Segment Test (FAST) corner detection for tracking or detecting objects in markerless augmented reality systems. Testing was conducted using three epoch schemes: 10, 50, and 100. The test results were measured using several parameters, including the execution time, testing loss, and testing accuracy. The test results indicated an improvement in the performance of the tested object detection. The accuracy testing results of using the CNN and FAST corner detection methods were superior to those of the CNN-only method and FAST corner detection alone, reaching 98%. However, this method increases the processing time for object detection. Thus, the processing time of the CNN without FAST corner detection was faster.