Dual Causal-Aware Detection Transformer for Remote Sensing Images
Deep neural networks often inherit biases from training data, compromising generalization. In visual recognition, distinguishing foreground from background is insufficient, as models tend to rely on spurious correlations rather than learning essential causal patterns. To address this issue, this paper proposes a novel transformer architecture, termed dual causal-aware detection transformer (DCDT), specifically designed for object detection in optical remote sensing images from a causal perspective. Specifically, we begin by constructing a structural causal model to intuitively analyze the causal effects inherent in the overall visual patterns. Building on this foundation, DCDT introduces causal constraints at the attention level by embedding dynamic multi-scale causal prototypes into the attention mechanism. The derived causal priors are subsequently used to enhance features at the representation level, thereby enforcing feature-level causal modulation. This dual causal-aware strategy enables the precise extraction and reinforcement of causally relevant features, improving both robustness and discriminative capability in complex detection scenarios. In addition, a sparse kernel-region mask is incorporated to decouple local information from global representations, effectively strengthening the modeling of fine-grained structures. Extensive experiments conducted on two challenging public datasets, DIOR and HRRSD, demonstrate that DCDT consistently outperforms existing methods and baselines. These results validate the effectiveness of DCDT in capturing both global causal semantics and local fine-grained features, highlighting its practicality in complex remote sensing scenarios.
Authors
- Licheng Jiao (ORCID: https://orcid.org/0000-0003-3354-9617)
- Wenping Ma (ORCID: https://orcid.org/0000-0001-8872-2195)
- Zhongjian Huang (ORCID: https://orcid.org/0000-0003-2004-0619)
- Xu Liu (ORCID: https://orcid.org/0000-0002-8780-5455)
- Lingling Li (ORCID: https://orcid.org/0000-0002-6130-2518)
- Fang Liu (ORCID: https://orcid.org/0000-0002-5669-9354)
- Shuyuan Yang (ORCID: https://orcid.org/0000-0002-4796-5737)
- Yuhan Wang (ORCID: https://orcid.org/0000-0002-7243-9341)
Institutions
- Xidian University (CN)
Publication Details
- Journal
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tgrs.2025.3615182
- Primary Topic
- Remote-Sensing Image Classification
- Type
- article
- Field-Weighted Citation Impact
- 0.00