Rotated-Box Multi-Modal Vehicle Detection in Aerial Imagery: A Systematic Study with an Empirical Re-examination of Modality Misalignment

Abstract Vehicle detection in aerial imagery suers from small scales, arbitrary orientations, and limited single-modality information. Multi-modal RGBIR fusion is widely adopted, yet the eld rests on two tacit assumptions rarely veried: (1) paired RGB and IR images are spatially misaligned, making alignment the main obstacle to fusion; and (2) IR assists ne-grained class discrimination. Using a YOLOv8s-based rotated-box multi-modal detector , we reexamine both assumptions on VEDAI. Phase-correlation measurements show a median misalignment of only 0.078 pixels, indicating the dataset is well registered; permutation tests show IR adds no signicant discriminative power for the confusable carpickup pair (p = 0.81). Data proling instead reveals the true challenge: class confusion among extremely small objects (95.3% smaller than 32×32 pixels), primarily geometric. The framework nonetheless yields consistent gains: the rotated-box head improves mAP50-95 by 12.86 points and IR adds 5.79 points (paired t-test p < 0.0001 and p = 0.0026). An explicit alignment module (BMA) brings no signicant gain on these well-registered datasets (eight seeds; equivalence test and power analysis; mean +0.44 mAP50, p = 0.563). Reproducing this on DroneVehicle, alignment again yields no reliable gain (+0.21 mAP50-95), indicating the null holds across two independently registered datasets; the misaligned regime is tested only synthetically.

Authors

Institutions

Publication Details

Journal
Research Square
Published
2026-11-12
DOI
https://doi.org/10.21203/rs.3.rs-11372567/v1
Primary Topic
Advanced Neural Network Applications
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Rotated-Box Multi-Modal Vehicle Detection in Aerial Imagery: A Systematic Study with an Empirical Re-examination of Modality Misalignment

Yi Wu
Research Square
Advanced Neural Network Applications
preprint

Rotated-Box Multi-Modal Vehicle Detection in Aerial Imagery: A Systematic Study with an Empirical Re-examination of Modality Misalignment

Yi Wu
preprint en

Abstract

Abstract Vehicle detection in aerial imagery suers from small scales, arbitrary orientations, and limited single-modality information. Multi-modal RGBIR fusion is widely adopted, yet the eld rests on two tacit assumptions rarely veried: (1) paired RGB and IR images are spatially misaligned, making alignment the main obstacle to fusion; and (2) IR assists ne-grained class discrimination. Using a YOLOv8s-based rotated-box multi-modal detector , we reexamine both assumptions on VEDAI. Phase-correlation measurements show a median misalignment of only 0.078 pixels, indicating the dataset is well registered; permutation tests show IR adds no signicant discriminative power for the confusable carpickup pair (p = 0.81). Data proling instead reveals the true challenge: class confusion among extremely small objects (95.3% smaller than 32×32 pixels), primarily geometric. The framework nonetheless yields consistent gains: the rotated-box head improves mAP50-95 by 12.86 points and IR adds 5.79 points (paired t-test p < 0.0001 and p = 0.0026). An explicit alignment module (BMA) brings no signicant gain on these well-registered datasets (eight seeds; equivalence test and power analysis; mean +0.44 mAP50, p = 0.563). Reproducing this on DroneVehicle, alignment again yields no reliable gain (+0.21 mAP50-95), indicating the null holds across two independently registered datasets; the misaligned regime is tested only synthetically.

Research Square
Jiangxi Institute of Applied Science and Technology (CN)
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon