Building Footprint Extraction from Fixed-Wing UAV Imagery using Mask R-CNN and Object-based Image Analysis Methods (Case Study: Banturejo Village, Malang Regency)

Abstract As a developing area in Malang Regency, Banturejo Village has many potencies since its location near the tourism area of Selorejo Dam. To maximally the harness of potencies while maintaining efficient land use in Banturejo village, mapping the built area in large scale should be carried out. The photogrammetric techniques using fixed-wing UAV could be a good alternative for large-scale mapping in this village area because of its capability to quickly acquire high resolution image with highly customizable mission specifications. But the problem arises in interpreting these imagery into meaningful cartographic representation which often requires cautious manual digitization in much slower rate that its acquisition. In this research the automatic image analysis method for building footprint extraction using Mask R-CNN algorithm and Object-Based Image Analysis was performed. The fixed wing UAV imagery was captured in 2023 and the structure from motion algorithm was employed for photogrammetric processing which produced 10-cm resolution orthophoto. Manually digitized building polygons from the same imagery serve as the gold standard for accuracy analysis, and small proportion of the data was used as training samples for the algorithm. The results shows that 1447 buildings with total area of 180,595 m 2 was generated with Mask R-CNN algorithm, while OBIA-Mask R-CNN produced 572 buildings and total area of 201,932 m 2 . The confusion matrices reveal precision value of 77.94%, recall 51.54%, F1 Score 62.02% by Mask R-CNN method, and precision value of 35.95%, recall 9.21%, F1 Score 14.66% by OBIA-Mask RCNN method. Mask R-CNN method generated slightly lower accuracy of total building area, but in terms of precision the OBIA-Mask RCNN method produces lower number of building polygons.