T-Net++: Effective Permutation-Equivariance Network for Two-View Correspondence Pruning
We propose a conceptually novel, flexible, and effective framework (named T-Net++) for the task of two-view correspondence pruning. T-Net++ comprises two unique structures: the "-'' structure and the "|'' structure. The "-'' structure utilizes an iterative learning strategy to process correspondences, while the "|'' structure integrates all feature information of the "-'' structure and produces inlier weights. Moreover, within the "|'' structure, we design a new Local-Global Attention Fusion module to fully exploit valuable information obtained from concatenating features through channel-wise and spatial-wise relationships. Furthermore, we develop a Channel-Spatial Squeeze-and-Excitation module, a modified network backbone that enhances the representation ability of important channels and correspondences through the squeeze-and-excitation operation. T-Net++ not only preserves the permutation-equivariance manner for correspondence pruning, but also gathers rich contextual information, thereby enhancing the effectiveness of the network. Experimental results demonstrate that T-Net++ outperforms other state-of-the-art correspondence pruning methods on various benchmarks and excels in two extended tasks.
Authors
- Jiayi Ma (ORCID: https://orcid.org/0000-0003-3264-3265)
- Guobao Xiao (ORCID: https://orcid.org/0000-0003-2928-8100)
- Haibin Ling (ORCID: https://orcid.org/0000-0003-4094-8413)
- Xiaoqin Zhang (ORCID: https://orcid.org/0000-0003-0958-7285)
- Zhen Zhong (ORCID: https://orcid.org/0000-0003-0855-406X)
- Xin Liu (ORCID: https://orcid.org/0000-0002-8407-9099)
Institutions
- Tongji University (CN)
- Wuhan University (CN)
- Zhejiang University of Technology (CN)
- Stony Brook University (US)
Publication Details
- Journal
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2024-08-16
- DOI
- https://doi.org/10.1109/tpami.2024.3444457
- Citations
- 9
- Primary Topic
- Advanced Image and Video Retrieval Techniques
- Type
- article
- Field-Weighted Citation Impact
- 2.24
Funders
- National Natural Science Foundation of China
- Natural Science Foundation of Zhejiang Province