Developing Interpretable Deep Learning Model for Subtropical Forest Type Classification Using Beijing-2, Sentinel-1, and Time-Series NDVI Data of Sentinel-2
Accurate forest type classification in subtropical regions is essential for ecological monitoring and sustainable management. Multimodal remote sensing data provide rich information support, yet the synergy between network architectures and fusion strategies in deep learning models remains insufficiently explored. This study established a multimodal deep learning framework with integrated interpretability analysis by combining high-resolution Beijing-2 RGB imagery, Sentinel-1 data, and time-series Sentinel-2 NDVI data. Two representative architectures (U-Net and Swin-UNet) were systematically combined with three fusion strategies, including feature concatenation (Concat), gated multimodal fusion (GMU), and Squeeze-and-Excitation (SE). To quantify feature contributions and decision patterns, three complementary interpretability methods were also employed: Shapley Additive Explanations (SHAP), Grad-CAM++, and occlusion sensitivity. Results show that Swin-UNet consistently outperformed U-Net. The SwinUNet-SE model achieved the highest overall accuracy (OA) of 82.76%, exceeding the best U-Net model by 3.34%, with the largest improvement of 5.8% for mixed forest classification. The effectiveness of fusion strategies depended strongly on architecture. In U-Net, SE and Concat improved OA by 0.91% and 0.23% compared with the RGB baseline, while GMU slightly declined. In Swin-UNet, all strategies achieved higher gains between 1.03% and 2.17%, and SE effectively reduced NDVI sensitivity. SHAP analysis showed that RGB features contributed most (values > 0.0015), NDVI features from winter and spring ranked among the top 50%, and Sentinel-1 features contributed less. These findings reveal how architecture and fusion design interact to enhance multimodal forest classification.
Authors
- Zhulin Chen (ORCID: https://orcid.org/0000-0001-7280-2916)
- Shijiao Qiao
- Guofeng Tao
- Shudan Chen
- Xuefeng Wang (ORCID: https://orcid.org/0000-0002-2703-9293)
- Mengmeng Shi (ORCID: https://orcid.org/0009-0007-3670-8413)
Institutions
- Beijing Normal University (CN)
- Institute of Forest Resource Information Techniques (CN)
- Chinese Academy of Forestry (CN)
- State Forestry and Grassland Administration (CN)
Publication Details
- Journal
- Forests
- Published
- 2025-11-10
- DOI
- https://doi.org/10.3390/f16111709
- Citations
- 1
- Primary Topic
- Remote Sensing in Agriculture
- Type
- article
- Field-Weighted Citation Impact
- 1.72