MDCFT-HSM: Modality-Shift-Aware RGB-T Small-Object Detection for Low-Altitude UAV Remote Sensing
Low-altitude UAV RGB-T small-object detection is challenged by unequal modality reliability and the progressive attenuation of small-object evidence. To address these issues, this paper proposes Modality-Dominant Controlled Fine-Tuning with Hierarchical Small-Object Modeling (MDCFT-HSM), an ordered feature-flow framework for RGB-T detection. Based on dataset-level single-modality performance, MDCFT selects an initial protected branch and introduces auxiliary-modality information through zero-initialized residual mappings at the stem, P3, P4, and P5 stages, thereby limiting interference from degraded auxiliary features. Within this controlled feature flow, the High–Low Frequency Detail Enhancement module (HLFDE) preserves shallow boundary, texture, and local thermal-response cues; the Selective Boundary-Guided Aggregation module (SBGA) strengthens cross-level detail propagation in the neck; and the Multi-scale Guided Feature Recalibration module (MGFR) recalibrates the P3, P4, and P5 features before the Detect head. On RGBTDronePerson, MDCFT-HSM achieves 49.53% [email protected] and 18.97% [email protected]:0.95 with 7.38 M parameters, 44.2 GFLOPs, and an inference speed of 60.0 FPS. On DroneVehicle, it achieves 83.60% [email protected] and 63.28% [email protected]:0.95. Controlled robustness tests show limited tolerance to auxiliary RGB absence and mild cross-modal spatial misalignment, whereas severe IR degradation, IR absence, and larger spatial offsets cause substantial performance loss. These results demonstrate a competitive accuracy–complexity trade-off under a fixed dataset-level protected-branch configuration. The method does not provide online sample-level reliability adaptation or geometric registration.
Authors
- Rijin Zhou
- Zhen Wang (ORCID: https://orcid.org/0000-0002-8182-2852)
- Yanwen Wang (ORCID: https://orcid.org/0000-0002-4863-2600)
- Qian Zhang (ORCID: https://orcid.org/0000-0001-5975-9781)
- Hongqing Ma
- Tianchen Long
- Hezhuo Yuan
- Feng Wang
Institutions
- Xijing University (CN)
Publication Details
- Journal
- Sensors
- Published
- 2026-08-14
- DOI
- https://doi.org/10.3390/s26165146
- Primary Topic
- Advanced Neural Network Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Key Research and Development Projects of Shaanxi Province