Portrait Shadow Removal via Self-Exemplar Illumination Equalization
We introduce the Self-Exemplar Illumination Equalization Network, designed specifically for effective portrait shadow removal. The core idea of our method is that partially shadowed portraits can find ideal exemplars within their non-shadowed facial regions. Rather than directly fusing two distinct classes of facial features, our approach utilizes non-shadowed regions as an illumination indicator to equalize the shadowed regions, generating deshadowed results without boundary-merging artifacts. Our network comprises cascaded Self-Exemplar Illumination Equalization Blocks (SExmBlock), each containing two modules: a self-exemplar feature matching module and a feature-level illumination rectification module. The former identifies and applies internal illumination exemplars to shadowed areas, producing illumination-corrected features, while the latter adjusts shadow illumination by reapplying the illumination factors from these features to the input face. Applying this series of SExmBlocks to shadowed portraits incrementally eliminates shadows and preserves clear, accurate facial details. The effectiveness of our method is demonstrated through evaluations on two public shadow portrait datasets, where it surpasses existing state-of-the-art methods in both qualitative and quantitative assessments.
Authors
- Ziheng Wu
- Shengfeng He (ORCID: https://orcid.org/0000-0002-3802-4644)
- Guiqing Li (ORCID: https://orcid.org/0000-0002-4598-1522)
- Cheng Xu (ORCID: https://orcid.org/0000-0002-4281-6214)
- Shengxin Liu (ORCID: https://orcid.org/0000-0001-5786-6938)
- Qian Huang (ORCID: https://orcid.org/0009-0001-4553-0051)
Institutions
- Shenzhen Institute of Information Technology (CN)
- Harbin Institute of Technology (CN)
- Alibaba Group (China) (CN)
- Singapore Management University (SG)
- South China University of Technology (CN)
Publication Details
- Published
- 2024-10-26
- DOI
- https://doi.org/10.1145/3664647.3681000
- Primary Topic
- Advanced Image and Video Retrieval Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00