MADReg: modality-aware deformation regularization for unsupervised infrared-visible image registration

Infrared-visible image registration establishes spatial correspondence for multisensor fusion and perception. In unsupervised deformation learning, differences in modality responses can be mistaken for geometric misalignment, causing erroneous displacement and distortion of scene geometry. Common deformation priors encourage spatial regularity, invertibility, or topology preservation, whereas determining whether a deformation is supported by the observed geometry requires additional guidance. We propose MADReg, a modality-aware deformation regularization framework that obtains complementary geometric references from reverse registration and translation-assisted registration. bidirectional deformation field consistency cross-utilizes the forward and backward fields and constrains the structural correspondence of the resulting warped images. Translation-driven deformation regularization estimates auxiliary fields from translated same-modality pairs and uses their spatial displacements and amplitude and phase spectra to guide the main field. Together, these reference processes relate the estimated deformation to shared scene structures and the overall deformation patterns of auxiliary mappings, helping suppress spatial changes induced by modality responses. Within-dataset and direct cross-dataset experiments on Visnir and RoadScene demonstrate improved correspondence accuracy relative to representative methods. Ablation studies and visualizations support the complementary value of the geometric references for preserving scene structure and controlling deformation irregularity.

Authors

Institutions

Publication Details

Journal
Measurement Science and Technology
Published
2026-11-18
DOI
https://doi.org/10.1088/1361-6501/aec039
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

MADReg: modality-aware deformation regularization for unsupervised infrared-visible image registration

Yi Yang, Xiaoru Pan, Di Miao, Jianpu Liu
3 links
Measurement Science and Technology
Advanced Image Fusion Techniques
article

MADReg: modality-aware deformation regularization for unsupervised infrared-visible image registration

Yi Yang, Xiaoru Pan, Di Miao, Jianpu Liu
article en

Abstract

Infrared-visible image registration establishes spatial correspondence for multisensor fusion and perception. In unsupervised deformation learning, differences in modality responses can be mistaken for geometric misalignment, causing erroneous displacement and distortion of scene geometry. Common deformation priors encourage spatial regularity, invertibility, or topology preservation, whereas determining whether a deformation is supported by the observed geometry requires additional guidance. We propose MADReg, a modality-aware deformation regularization framework that obtains complementary geometric references from reverse registration and translation-assisted registration. bidirectional deformation field consistency cross-utilizes the forward and backward fields and constrains the structural correspondence of the resulting warped images. Translation-driven deformation regularization estimates auxiliary fields from translated same-modality pairs and uses their spatial displacements and amplitude and phase spectra to guide the main field. Together, these reference processes relate the estimated deformation to shared scene structures and the overall deformation patterns of auxiliary mappings, helping suppress spatial changes induced by modality responses. Within-dataset and direct cross-dataset experiments on Visnir and RoadScene demonstrate improved correspondence accuracy relative to representative methods. Ablation studies and visualizations support the complementary value of the geometric references for preserving scene structure and controlling deformation irregularity.

Measurement Science and TechnologyVol. 37(46)
Tianjin University of Technology and Education (CN), Tianjin University (CN), Tianjin Foreign Studies University (CN), Florida International University Tianjin Center (CN)
National Natural Science Foundation of China
Advanced Image Fusion Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon