HRC-Net: Learning Visual Hypothesis, Representative, and Collaboration for Multi-Domain Image Inpainting
Multi-domain image inpainting utilizes complementary contextual information from auxiliary domain images to restore corrupted regions. While existing methods reconstruct auxiliary images to provide additional guidance, they face fundamental limitations: recovered pixels with complex patterns often lack representative details, while oversimplified patterns offer insufficient contextual information. To address these challenges, we propose HRC-Net, a novel framework incorporating three generative sub-networks for the comprehensive image inpainting task. Our architecture consists of: (1) A Hypothesis Sub-network that enables robust samplings of pixel-wise hypotheses from multi-domain inputs; (2) A Representative Sub-network that learns to score hypothesis quality based on contextual relevance; and (3) a Collaboration Sub-network that optimizes adaptive fusion kernels to integrate the most pertinent details. Together, these components model the joint distribution of representative scores and convolutional kernels, fostering a precise interaction between auxiliary hypotheses and target image corruption to meticulously repair the target image. Extensive evaluations across multiple benchmark datasets demonstrate HRC-Net's superior performance, significantly outperforming state-of-the-art methods in both quantitative metrics and visual quality.
Authors
- Ke Xu (ORCID: https://orcid.org/0000-0001-5855-3810)
- Qing Guo (ORCID: https://orcid.org/0000-0003-0974-9299)
- Renjie Zhang (ORCID: https://orcid.org/0000-0002-2141-6297)
- Wanchao Su (ORCID: https://orcid.org/0000-0002-7498-3033)
- Ping Li (ORCID: https://orcid.org/0000-0002-1503-0240)
- Jie Zhang (ORCID: https://orcid.org/0000-0001-8219-5590)
- Di Lin (ORCID: https://orcid.org/0000-0002-9324-800X)
- Xin Wang (ORCID: https://orcid.org/0000-0002-7977-6586)
- Ji Du (ORCID: https://orcid.org/0009-0001-9388-8146)
- Huali Dong (ORCID: https://orcid.org/0009-0006-7137-6955)
Institutions
- Hong Kong Polytechnic University (HK)
- Tianjin University (CN)
- City University of Hong Kong (HK)
- Nankai University (CN)
- Macao Polytechnic University (MO)
- Monash University (AU)
Publication Details
- Journal
- ACM Transactions on Graphics
- Published
- 2025-12-01
- DOI
- https://doi.org/10.1145/3763337
- Primary Topic
- Generative Adversarial Networks and Image Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Hong Kong Polytechnic University
- Natural Science Foundation of Tianjin City