DHANet: Dual-Stream Hierarchical Interaction Networks for Multimodal Drone Object Detection

Drone-based remote sensing has become pivotal for high-resolution dynamic monitoring. However, the differences between day and night modes will trigger a mismatch in multi-scale object features under extreme lighting conditions. In this paper, we propose a dual-stream hierarchical interaction network for multimodal drone object detection, called DHANet, which enhances the distinguishability between multi-scale objects and background for each modality. Specifically, DHANet is designed with a Modality-Adaptive Asymmetric Attention Module (M-AAM) that enhances object-level semantic representations through global and local attention mechanisms. The M-AAM employs global context attention and local positional attention to replace conventional multi-scale context extraction, thereby effectively integrating spatial-channel information of objects. Furthermore, the network is equipped with a Multimodal Scale-Attentive Convolution (M-SC) module that dynamically generates modality-specific feature aggregation weights. This design enables global cross-modality information fusion while reducing computational complexity. Experimental results on two multimodal remote sensing benchmark datasets (DroneVehicle and VEDAI) and two natural datasets (LLVIP and FLIR) demonstrate the robustness and generalizability of DHANet. The codes will be openly and freely available at https://github.com/Victoria-xin1009/-IEEE TGRS DHANet for the sake of reproducibility.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Geoscience and Remote Sensing
Published
2025-01-01
DOI
https://doi.org/10.1109/tgrs.2025.3578675
Citations
2
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
2.55

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

DHANet: Dual-Stream Hierarchical Interaction Networks for Multimodal Drone Object Detection

Yingyan Hou, Lianming Xu, Jian Guan, Aiguo Fei et al.
2 citations
IEEE Transactions on Geoscience and Remote Sensing
Video Surveillance and Tracking Methods
2.55
article

DHANet: Dual-Stream Hierarchical Interaction Networks for Multimodal Drone Object Detection

Yingyan Hou, Lianming Xu, Jian Guan, Aiguo Fei, Li Wang, Xin Wu, H. Ji
article en
2 citations

Abstract

Drone-based remote sensing has become pivotal for high-resolution dynamic monitoring. However, the differences between day and night modes will trigger a mismatch in multi-scale object features under extreme lighting conditions. In this paper, we propose a dual-stream hierarchical interaction network for multimodal drone object detection, called DHANet, which enhances the distinguishability between multi-scale objects and background for each modality. Specifically, DHANet is designed with a Modality-Adaptive Asymmetric Attention Module (M-AAM) that enhances object-level semantic representations through global and local attention mechanisms. The M-AAM employs global context attention and local positional attention to replace conventional multi-scale context extraction, thereby effectively integrating spatial-channel information of objects. Furthermore, the network is equipped with a Multimodal Scale-Attentive Convolution (M-SC) module that dynamically generates modality-specific feature aggregation weights. This design enables global cross-modality information fusion while reducing computational complexity. Experimental results on two multimodal remote sensing benchmark datasets (DroneVehicle and VEDAI) and two natural datasets (LLVIP and FLIR) demonstrate the robustness and generalizability of DHANet. The codes will be openly and freely available at https://github.com/Victoria-xin1009/-IEEE TGRS DHANet for the sake of reproducibility.

IEEE Transactions on Geoscience and Remote SensingVol. 63
Beijing University of Posts and Telecommunications (CN), Chinese Academy of Sciences (CN), Aerospace Information Research Institute (CN)
National Natural Science Foundation of China, Beijing Municipal Natural Science Foundation
Openalex Percentile: Top 10%
Video Surveillance and Tracking Methods
2.55
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.