Enhanced soft domain adaptation for object detection in the dark
Unlike foggy conditions, domain adaptation is rarely facilitated in dark detection tasks due to the lack of dark datasets. We generate target low-light images via swapping the ring-shaped frequency spectrum of Exdark with Cityscapes, and surprisingly find the promotion is less satisfactory. The root lies in non-transferable alignment that excessively highlights dark backgrounds. To tackle this issue, we propose an Enhanced Soft Domain Adaptation (ESDA) framework to focus on background misalignment. Specifically, Soft Domain Adaptation (SDA) compensates for over-alignment of backgrounds by providing different soft labels for foreground and background samples. The Highlight Foreground (HF), by introducing center sampling, increases the number of high-quality background samples for training. Suppress Background (SB) weakens non-transferable background alignment by replacing foreground scores with backgrounds. Experimental results show SDA combined with HF and SB is sufficiently strengthened and achieves state-of-the-art performance using multiple cross-domain benchmarks. Note that ESDA yields 11.8% relative improvement on the real-world ExDark dataset. • Based on the first comment of reviewer \#3, the real-time comparison experiment and its analysis are added in Section 4.1.5 (More Results and Analysis) to show that our proposed ESDA is appropriate for object detection. • Based on the second comment of reviewer\#3, we give a clear application of our method in Section 1 (Introduction). • Based on the third comment of reviewer\#3, we point our that our method’s two limitations and future work will focus on them in Section 5 (Conclusion).
Authors
- Xiaomao Li (ORCID: https://orcid.org/0000-0001-6374-1488)
- Yunfei Bai (ORCID: https://orcid.org/0000-0001-8084-6281)
- Chang Liu (ORCID: https://orcid.org/0000-0001-6755-4831)
- Rui Yang (ORCID: https://orcid.org/0000-0002-3704-2306)
Publication Details
- Journal
- Journal of Visual Communication and Image Representation
- Published
- 2024-11-20
- DOI
- https://doi.org/10.1016/j.jvcir.2024.104337
- Primary Topic
- Image Enhancement Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- China National Funds for Distinguished Young Scientists