Global-scale explainable AI assessment for OBIA-based classification using Deep Learning and Machine Learning methods

Over the past decade, object-based image analysis (OBIA) has gained prominence as a widely adopted method for generating land use/land cover (LULC) maps. This study aims to evaluate the performance of various classification algorithms within the OBIA framework using SPOT-6 satellite imagery. The research methodology involved segmenting the images with the multi-resolution segmentation (MRS) algorithm, followed by the application of convolutional neural networks (CNN), random forest (RF), and support vector machine (SVM) algorithms for classification. The study was conducted in the Perpignan province, located in the Pyrénées-Orientales region of France. After the segmentation stage, CNN, RF, and SVM classifiers were employed to classify the image segments based on both spectral and spatial attributes. The accuracy of the resulting thematic maps was assessed using standard metrics, including overall accuracy (OA), the Kappa coefficient (KC), and the F��score (FS). Of the three classifiers, CNN achieved the highest overall accuracy at 91.28%, outperforming SVM, which attained an OA of 90.50%, and RF, which recorded an OA of 87.28%. Additionally, this study explored the integration of explainable artificial intelligence (AI) techniques, specifically the Shapley Additive Explanations (SHAP) algorithm, to enhance the interpretability of the machine learning models. This approach fosters greater trust, accountability, and acceptance in decision-making processes. By leveraging SHAP values, the study provides deeper insights into the decision-making processes of the CNN, SVM, and RF classifiers, ultimately enhancing the transparency and comprehensibility of these models.