CSIFT: A Structural Feature Encoding Framework for Cross-Modal Image Registration

Multimodal sensor collaborative detection serves as an indispensable complementary technology in Earth observation. However, significant cross-modal discrepancies in multi-modal images severely limit the operational efficiency and alignment accuracy of traditional registration methods. Feature-based multimodal image registration techniques struggle to maintain stable performance across different modalities due to inherent radiometric differences. To address this limitation, this paper proposes a cross-modal structural information feature transform (CSIFT) framework by optimizing intermediate modality construction. The method employs the oriented FAST and rotated BRIEF (ORB) detector to extract keypoints and construct circular Gaussian-weighted oriented gradient features (CGOGF) through a Gaussian-weighted directional gradient allocation mechanism applied to neighborhood information. The gradient magnitude distribution based on annular distance eliminates truncation effects caused by linear interpolation, while principal directionaligned blocks ensure rotational consistency. By transforming cross-modal registration into a homogeneous feature matching problem through structural feature encoding, experimental results demonstrate that CGOGF significantly enhances crossmodal performance while preserving information integrity compared to traditional methods. Extensive evaluations on two public datasets show that CSIFT achieves the highest success rates (97.58% and 97.19%) across various multi-modal datasets, outperforming multiple traditional registration approaches.

Authors

Institutions

Publication Details

Journal
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Published
2025-01-01
DOI
https://doi.org/10.1109/jstars.2025.3616220
Primary Topic
Advanced Image and Video Retrieval Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CSIFT: A Structural Feature Encoding Framework for Cross-Modal Image Registration

Leping Chen, Daoxiang An, Luya Lian
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Advanced Image and Video Retrieval Techniques
article

CSIFT: A Structural Feature Encoding Framework for Cross-Modal Image Registration

Leping Chen, Daoxiang An, Luya Lian
article en

Abstract

Multimodal sensor collaborative detection serves as an indispensable complementary technology in Earth observation. However, significant cross-modal discrepancies in multi-modal images severely limit the operational efficiency and alignment accuracy of traditional registration methods. Feature-based multimodal image registration techniques struggle to maintain stable performance across different modalities due to inherent radiometric differences. To address this limitation, this paper proposes a cross-modal structural information feature transform (CSIFT) framework by optimizing intermediate modality construction. The method employs the oriented FAST and rotated BRIEF (ORB) detector to extract keypoints and construct circular Gaussian-weighted oriented gradient features (CGOGF) through a Gaussian-weighted directional gradient allocation mechanism applied to neighborhood information. The gradient magnitude distribution based on annular distance eliminates truncation effects caused by linear interpolation, while principal directionaligned blocks ensure rotational consistency. By transforming cross-modal registration into a homogeneous feature matching problem through structural feature encoding, experimental results demonstrate that CGOGF significantly enhances crossmodal performance while preserving information integrity compared to traditional methods. Extensive evaluations on two public datasets show that CSIFT achieves the highest success rates (97.58% and 97.19%) across various multi-modal datasets, outperforming multiple traditional registration approaches.

IEEE Journal of Selected Topics in Applied Earth Observations and Remote SensingVol. 18
National University of Defense Technology (CN)
Openalex Percentile: Top 73%
Advanced Image and Video Retrieval Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

CSIFT: A Structural Feature Encoding Framework for Cross-Modal Image Registration — Leping Chen, Daoxiang An, et al. · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (2025) | TGRS Research Map | TGRS