Detail-Preserving Diffusion Models for Low-Light Image Enhancement
Existing diffusion models for low-light image enhancement typically incrementally remove noise introduced during the forward diffusion process using a denoising loss, with the process being conditioned on input low-light images. While these models demonstrate remarkable abilities in generating realistic high-frequency details, they often struggle to restore fine details that are faithful to the input. To address this, we present a novel detail-preserving diffusion model for realistic and faithful low-light image enhancement. Our approach integrates a size-agnostic diffusion process with a reverse process reconstruction loss, significantly enhancing the fidelity of enhanced images to their low-light counterparts and enabling more accurate recovery of fine details. To ensure the preservation of region- and content-aware details, we employ an efficient noise estimation network with a simplified channel-spatial attention mechanism. Additionally, we propose a multiscale ensemble scheme to maintain detail fidelity across diverse illumination regions. Comprehensive experiments on eight benchmark datasets demonstrate that our method achieves state-of-the-art results compared to over twenty existing methods in terms of both perceptual quality (LPIPS) and distortion metrics (PSNR and SSIM). The code is available at: <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/CSYanH/DePDiff</uri>.
Authors
- Patrick Le Callet (ORCID: https://orcid.org/0000-0002-2143-7063)
- Yong Xu (ORCID: https://orcid.org/0000-0001-7183-3155)
- Boxin Shi (ORCID: https://orcid.org/0000-0001-6749-0364)
- Yan Huang (ORCID: https://orcid.org/0000-0001-9136-195X)
- Jinxiu Liang (ORCID: https://orcid.org/0000-0001-6302-0912)
- Xuefeng Liao (ORCID: https://orcid.org/0000-0001-7031-3924)
Institutions
- École Centrale de Nantes (FR)
- Centre National de la Recherche Scientifique (FR)
- Peking University (CN)
- Laboratoire des Sciences du Numérique de Nantes (FR)
- South China University of Technology (CN)
- Nantes Université (FR)
Publication Details
- Journal
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2024-11-20
- DOI
- https://doi.org/10.1109/tcsvt.2024.3502801
- Citations
- 5
- Primary Topic
- Image Enhancement Techniques
- Type
- article
- Field-Weighted Citation Impact
- 1.25
Funders
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Guangzhou Municipal Science and Technology Project