Source-Free Object Detection With Detection Transformer
Source-Free Object Detection (SFOD) enables knowledge transfer from a source domain to an unsupervised target domain for object detection without access to source data. Most existing SFOD approaches are either confined to conventional object detection (OD) models like Faster R-CNN or designed as general solutions without tailored adaptations for novel OD architectures, especially Detection Transformer (DETR). In this paper, we introduce Feature Reweighting ANd Contrastive Learning NetworK (FRANCK), a novel SFOD framework specifically designed to perform query-centric feature enhancement for DETRs. FRANCK comprises four key components: 1) an Objectness Score-based Sample Reweighting (OSSR) module that computes attention-based objectness scores on multi-scale encoder feature maps, reweighting the detection loss to emphasize less-recognized regions; 2) a Contrastive Learning with Matching-based Memory Bank (CMMB) module that integrates multi-level features into memory banks, enhancing class-wise contrastive learning; 3) an Uncertainty-weighted Query-fused Feature Distillation (UQFD) module that improves feature distillation through prediction quality reweighting and query feature fusion; and 4) an improved self-training pipeline with a Dynamic Teacher Updating Interval (DTUI) that optimizes pseudo-label quality. By leveraging these components, FRANCK effectively adapts a source-pre-trained DETR model to a target domain with enhanced robustness and generalization. Extensive experiments on several widely used benchmarks demonstrate that our method achieves state-of-the-art performance, highlighting its effectiveness and compatibility with DETR-based SFOD models.
Authors
- Tengfei Xing
- Sicheng Zhao (ORCID: https://orcid.org/0000-0001-5843-6411)
- Chenggang Clarence Yan (ORCID: https://orcid.org/0000-0003-1204-0512)
- Guiguang Ding (ORCID: https://orcid.org/0000-0003-0137-9975)
- Guoping Liu (ORCID: https://orcid.org/0000-0002-1278-2885)
- Hui Chen (ORCID: https://orcid.org/0000-0003-4180-5801)
- Yangyang Li (ORCID: https://orcid.org/0009-0003-2578-856X)
- Huizai Yao
- Jianhua Tao (ORCID: https://orcid.org/0000-0002-9344-6428)
- S. Lu (ORCID: https://orcid.org/0000-0002-8814-1670)
Institutions
- Chinese Academy of Sciences (CN)
- Institute of Automation (CN)
- China Academy of Information and Communications Technology (CN)
- Didi Chuxing (China)
- Hangzhou Dianzi University (CN)
- Tsinghua University (CN)
Publication Details
- Journal
- IEEE Transactions on Image Processing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tip.2025.3607621
- Citations
- 3
- Primary Topic
- Advanced Image and Video Retrieval Techniques
- Type
- article
- Field-Weighted Citation Impact
- 3.83