MSG: Robust Multimodal Remote Sensing Image Matching Using Side Window Gaussian Space

Robust and accurate image matching and registration are foundational tasks for numerous applications. However, current methods often fail when dealing with multimodal remote sensing images (MRSI) that exhibit significant spatial geometric differences (SGD) and nonlinear radiometric differences (NRD). To address these challenges, this paper proposes a novel MRSI matching method: matching using side window Gaussian space (MSG). MSG leverages an intuitive concept that human visual perception relies heavily on salient features at image edges for precise matching. Specifically, the proposed method: (1) constructs a multi-scale side window Gaussian filter scale space (MSGSS) that preserves edge information at different scales while blurring the image; (2) enhances the repeatability of keypoints by performing corner detection on edge maps; (3) increases descriptor robustness by using second-order gradients combined with steerable filtering; (4) further utilizes a two-stage matching strategy within a constrained search space and designs a new distance, making full use of densely distributed edge keypoints. Quantitative and qualitative experiments conducted on 5 datasets spanning 957 image pairs across 9 multimodal types demonstrate that MSG outperforms nine advanced algorithms (six feature-based methods: SIFT, OS-SIFT, RIFT, CoFSM, HOWP, POS-GIFT; and three deep learning-based methods: SuperPoint+SuperGlue, LoFTR, ReDFeat). The results indicate that MSG achieved a number of correct matches (NCM) much higher than the compared algorithms, with the highest success rate (SR), lowest RMSE and good time efficiency, while achieving both scale and rotation invariance. Codes are available at https://github.com/ZCYla/MSG.