Seed Optimization With Frozen Generator for Superior Zero-Shot Low-Light Image Enhancement
In this work, we observe that the generators, which are pre-trained on massive natural images, inherently hold the promising potential for superior low-light image enhancement against varying scenarios. Specifically, for the low-light image enhancement process of a single image, we introduce the pre-trained generators to restore the details and colors degraded by low-light conditions, thereby improving the visual effect. Taking one step further, we introduce a novel optimization strategy, which backpropagates the gradients to the input seeds rather than the parameters of the low-light image enhancement model, thus intactly retaining the generative knowledge learned from natural images and achieving faster convergence speed. Benefiting from the pre-trained knowledge and seed-optimization strategy, the low-light image enhancement model can significantly regularize the visibility and fidelity of the enhanced result, thus rapidly generating high-quality images without training on any low-light dataset. Extensive experiments on various benchmarks demonstrate the effectiveness of the proposed method, showing its potential advantages over numerous state-of-the-art methods both qualitatively and quantitatively.
Authors
- Haoxuan Wang (ORCID: https://orcid.org/0000-0001-5106-7705)
- Huaian Chen (ORCID: https://orcid.org/0000-0003-3999-2206)
- Yi Jin (ORCID: https://orcid.org/0000-0001-8232-3863)
- Enhong Chen (ORCID: https://orcid.org/0000-0002-4835-4102)
- Yuxuan Gu (ORCID: https://orcid.org/0009-0004-7994-8589)
- Pengyang Ling
- Ben Wang (ORCID: https://orcid.org/0000-0002-0880-9264)
- Xiaoxiao Ma (ORCID: https://orcid.org/0000-0002-4791-8914)
- Zhixiang Wei (ORCID: https://orcid.org/0009-0009-5765-6565)
Institutions
- University of Science and Technology of China (CN)
Publication Details
- Journal
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2024-09-05
- DOI
- https://doi.org/10.1109/tcsvt.2024.3454763
- Citations
- 6
- Primary Topic
- Image Enhancement Techniques
- Type
- article
- Field-Weighted Citation Impact
- 1.50