Multi-Source Face Relighting: Pre-fusion and Post-fusion Approaches for Improved Lighting Consistency and Detail Preservation

Multi-source face relighting is a key challenge in computer vision due to its applications in virtual reality, face recognition, and image editing, yet existing methods struggle with lighting consistency, shadow modeling, and detail preservation under complex multi-light-source conditions. This paper introduces two approaches, pre-fusion and post-fusion, to address these challenges by extending single-light-source relighting methods to multi-source scenarios. The pre-fusion approach unifies multiple light source parameters before relighting, improving lighting consistency and shadow modeling, while the post-fusion approach fuses individual relit images at the pixel level, preserving fine details with flexible control. Evaluations on a custom dataset and the FFHQ dataset show that pre-fusion outperforms post-fusion in terms of MSE, PSNR, and DSSIM. Experimental results confirm that pre-fusion effectively enhances lighting consistency and preserves details, offering a practical solution for real-world multi-source face relighting.

Authors

Institutions

Publication Details

Published
2024-11-24
DOI
https://doi.org/10.1109/iccvit63928.2024.10872585
Citations
1
Primary Topic
Visual Attention and Saliency Detection
Type
article
Field-Weighted Citation Impact
0.25

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-Source Face Relighting: Pre-fusion and Post-fusion Approaches for Improved Lighting Consistency and Detail Preservation

Zhiyuan Zou, Jian S. Dai, Junlin Hu, Yuan Gao
1 citations
Visual Attention and Saliency Detection
0.25
article

Multi-Source Face Relighting: Pre-fusion and Post-fusion Approaches for Improved Lighting Consistency and Detail Preservation

Zhiyuan Zou, Jian S. Dai, Junlin Hu, Yuan Gao
article en
1 citations

Abstract

Multi-source face relighting is a key challenge in computer vision due to its applications in virtual reality, face recognition, and image editing, yet existing methods struggle with lighting consistency, shadow modeling, and detail preservation under complex multi-light-source conditions. This paper introduces two approaches, pre-fusion and post-fusion, to address these challenges by extending single-light-source relighting methods to multi-source scenarios. The pre-fusion approach unifies multiple light source parameters before relighting, improving lighting consistency and shadow modeling, while the post-fusion approach fuses individual relit images at the pixel level, preserving fine details with flexible control. Evaluations on a custom dataset and the FFHQ dataset show that pre-fusion outperforms post-fusion in terms of MSE, PSNR, and DSSIM. Experimental results confirm that pre-fusion effectively enhances lighting consistency and preserves details, offering a practical solution for real-world multi-source face relighting.

Beijing Information Science & Technology University (CN)
Beijing Municipal Education Commission, Technology Development
Openalex Percentile: Top 42%
Visual Attention and Saliency Detection
0.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Multi-Source Face Relighting: Pre-fusion and Post-fusion Approaches for Improved Lighting Consistency and Detail Preservation — Zhiyuan Zou, Jian S. Dai, et al. · (2024) | TGRS Research Map | TGRS