Reference-Based Iterative Interaction With <i>P</i> <sup>2</sup>-Matching for Stereo Image Super-Resolution
Stereo Image Super-Resolution (SSR) holds great promise in improving the quality of stereo images by exploiting the complementary information between left and right views. Most SSR methods primarily focus on the inter-view correspondences in low-resolution (LR) space. The potential of referencing a high-quality SR image of one view benefits the SR for the other is often overlooked, while those with abundant textures contribute to accurate correspondences. Therefore, we propose Reference-based Iterative Interaction (RIISSR), which utilizes reference-based iterative pixel-wise and patch-wise matching, dubbed $P^{2}$ -Matching, to establish cross-view and cross-resolution correspondences for SSR. Specifically, we first design the information perception block (IPB) cascaded in parallel to extract hierarchical contextualized features for different views. Pixel-wise matching is embedded between two parallel IPBs to exploit cross-view interaction in LR space. Iterative patch-wise matching is then executed by utilizing the SR stereo pair as another mutual reference, capitalizing on the cross-scale patch recurrence property to learn high-resolution (HR) correspondences for SSR performance. Moreover, we introduce the supervised side-out modulator (SSOM) to re-weight local intra-view features and produce intermediate SR images, which seamlessly bridge two matching mechanisms. Experimental results demonstrate the superiority of RIISSR against existing state-of-the-art methods.
Authors
- Sam Kwong (ORCID: https://orcid.org/0000-0001-7484-7261)
- Huihui Bai (ORCID: https://orcid.org/0000-0002-3879-8957)
- Ronghui Sheng (ORCID: https://orcid.org/0009-0002-6713-8090)
- Rui Liao (ORCID: https://orcid.org/0000-0002-0057-2792)
- Renjie Wan (ORCID: https://orcid.org/0000-0002-0161-0367)
- Runmin Cong (ORCID: https://orcid.org/0000-0003-0972-4008)
- Feng Li (ORCID: https://orcid.org/0000-0001-9862-0432)
- Wei Zhang (ORCID: https://orcid.org/0000-0002-4960-3190)
Institutions
- Ministry of Education of the People's Republic of China (CN)
- Hong Kong Baptist University (HK)
- Shandong University (CN)
Publication Details
- Journal
- IEEE Transactions on Image Processing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tip.2025.3577538
- Citations
- 4
- Primary Topic
- Advanced Image Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 5.10
Funders
- National Natural Science Foundation of China
- Taishan Scholar Foundation of Shandong Province