Improved leaf area index reconstruction in heavily cloudy areas: A novel deep learning approach for SAR-Optical fusion integrating spatiotemporal features
• A two-step deep learning approach for LAI reconstruction using spatiotemporal features. • The approach enables accuracy with an average R2 > 0.6 across millions of pixels. • 2D CNN-Transformer effectively bridges Sentinel-1 SAR and Sentinel-2 optical data. The Leaf Area Index (LAI) is an essential parameter for assessing vegetation growth. LAI derived from optical data can suffer from gaps caused by cloud cover. Synthetic Aperture Radar (SAR) presents a solution with its all-weather observation capability. To address these issues, this study proposes a new deep learning approach for reconstructing time series LAI using SAR and optical data in two steps. Firstly, the two-dimensional Convolutional Neural Network-Transformer (2D CNN-Transformer) is applied to bridge SAR and optical data. Secondly, the 2D CNN-Transformer predicted LAI and the Sentinel-2 LAI are input into the Enhanced Deep Convolutional Model for Spatiotemporal Image Fusion (EDCSTFN) model to further improve the accuracy. The novelty lies in a two-step framework combining a 2D CNN-Transformer for spatiotemporal feature extraction and a deep learning fusion algorithm refining accurate LAI reconstruction. Results showed that the 2D CNN-Transformer achieved a higher accuracy (R2 = 0.64, RMSE = 0.38 m 2 /m 2 ) in establishing a relationship between SAR and optical data, compared to 1D CNN, 2D CNN-LSTM, and 1D CNN-Transformer. In the second step, the EDCSTFN reconstructed LAI achieved the highest accuracy of an R 2 of 0.81 and an RMSE of 0.22 m 2 /m 2 , with an average R 2 of 0.61 and RMSE of 0.37 m 2 /m 2 across croplands and forests in millions of pixels, further improving the accuracy based on the first step. The approach effectively fills gaps in spatial details and achieves a more continuous spatial distribution. The proposed approach demonstrates good generalizability in millions of pixels under frequent cloud cover and complex surface conditions and provides a new strategy for the fusion of optical and SAR data.
Authors
- Kevin J. Tansey (ORCID: https://orcid.org/0000-0002-9116-8081)
- Ji Zhou (ORCID: https://orcid.org/0000-0001-9926-7693)
- Fengwei Guo (ORCID: https://orcid.org/0000-0002-8089-2015)
- Mingqi Li (ORCID: https://orcid.org/0000-0003-4188-7034)
- Pengxin Wang (ORCID: https://orcid.org/0000-0002-2655-6731)
Institutions
- University of Electronic Science and Technology of China (CN)
- University of Leicester (GB)
- Ministry of Agriculture and Rural Affairs (CN)
- China Agricultural University (CN)
Publication Details
- Journal
- International Journal of Applied Earth Observation and Geoinformation
- Published
- 2025-07-21
- DOI
- https://doi.org/10.1016/j.jag.2025.104745
- Primary Topic
- Remote Sensing in Agriculture
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Rothamsted Research
- UK Research and Innovation
- Royal Society
- National Natural Science Foundation of China
- Science and Technology Facilities Council