Lightweight multimodal fusion for UAV classification with explicit missing-modality modeling

Abstract Fine-grained unmanned aerial vehicle (UAV) type classification benefits from complementary sensors, yet real deployments face incomplete observations and heterogeneous stream reliability. We present a missing-aware fusion framework for RGB detections (YOLO11-S), Livox Avia LiDAR, 360° LiDAR, and radar-enhanced point clouds on MMAUD. Confidence–density scores are masked and renormalized so fusion weight is assigned only to observed streams (Eq. (2)); each absent stream still occupies a classifier slot via a learnable missing embedding that is not multiplied by the zero weight (Eq. (1)), keeping absence as a trainable signal rather than a numerical zero. On a time-stratified split, Tiny MLP (≈ 0.1 M fusion parameters) reaches 96.12% test accuracy in a representative seed-42 run. Over seeds 42–46, final test accuracy is 95.29 ± 0.60% without training-time modality dropout and 95.77 ± 0.90% with 30% training ModDrop (mean ± sample s.d.). Under matched 30% test missingness, accuracy remains 83.68% (seed 42). Protocol-aligned baselines and orthogonal ablations support the slot rule. Fusion-stage inference is about 2.1 ms per sample with pre-extracted features on an RTX 4090. Under our fixed split and frozen features—not as a challenge-leaderboard claim—compact missing-aware fusion is practical for heterogeneous UAV sensing under partial sensor availability.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-10-14
DOI
https://doi.org/10.1038/s41598-026-76332-z
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Lightweight multimodal fusion for UAV classification with explicit missing-modality modeling

Haiyang Bao, Ning Li, Di Wu, Ximing Ma et al.
Scientific Reports
Advanced Neural Network Applications
article

Lightweight multimodal fusion for UAV classification with explicit missing-modality modeling

Haiyang Bao, Ning Li, Di Wu, Ximing Ma, Xiangyue Yu, Yibo Feng
article en

Abstract

Abstract Fine-grained unmanned aerial vehicle (UAV) type classification benefits from complementary sensors, yet real deployments face incomplete observations and heterogeneous stream reliability. We present a missing-aware fusion framework for RGB detections (YOLO11-S), Livox Avia LiDAR, 360° LiDAR, and radar-enhanced point clouds on MMAUD. Confidence–density scores are masked and renormalized so fusion weight is assigned only to observed streams (Eq. (2)); each absent stream still occupies a classifier slot via a learnable missing embedding that is not multiplied by the zero weight (Eq. (1)), keeping absence as a trainable signal rather than a numerical zero. On a time-stratified split, Tiny MLP (≈ 0.1 M fusion parameters) reaches 96.12% test accuracy in a representative seed-42 run. Over seeds 42–46, final test accuracy is 95.29 ± 0.60% without training-time modality dropout and 95.77 ± 0.90% with 30% training ModDrop (mean ± sample s.d.). Under matched 30% test missingness, accuracy remains 83.68% (seed 42). Protocol-aligned baselines and orthogonal ablations support the slot rule. Fusion-stage inference is about 2.1 ms per sample with pre-extracted features on an RTX 4090. Under our fixed split and frozen features—not as a challenge-leaderboard claim—compact missing-aware fusion is practical for heterogeneous UAV sensing under partial sensor availability.

Scientific Reports
Chinese Academy of Sciences (CN), Changchun Institute of Optics, Fine Mechanics and Physics (CN), University of Chinese Academy of Sciences (CN)
Openalex Percentile: Top 16%
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.