MamWorld for open-world object detection with state space modeling and cross-modal fusion

Open-vocabulary detection (OVD) and open-world object detection (OWOD) are increasingly important for unmanned aerial vehicle (UAV) perception, where detectors must recognize known, unseen, long-tail, and unknown objects in complex aerial scenes. UAV-based detection is particularly challenging due to small targets, cluttered backgrounds, large viewpoint changes, and strict efficiency requirements for onboard deployment. Existing convolutional detectors capture local details efficiently but are limited in long-range dependency modeling, while Transformer-based methods provide stronger global reasoning at the cost of high computational complexity. In addition, many current OVD and OWOD methods rely on shallow cross-modal fusion, which weakens semantic consistency between aerial visual regions and textual category descriptions. To address these challenges, we propose MamWorld, a unified state-space-based detection framework for UAV-oriented open-category object detection. MamWorld introduces an ODMamba-based backbone with MassBlock to enhance cross-channel interaction, multi-scale spatial aggregation, and long-range dependency modeling for small and ambiguous aerial objects. It further employs TextMambaBlock and SGSS-TextMambaBlock to generate semantically selective textual representations, and MambaFusion-PAN to perform recursive bidirectional vision-language fusion across scales. This end-to-end design enables efficient alignment between UAV imagery and open-category semantics while supporting both OVD and OWOD. Experiments on LVIS, M-OWODB, and S-OWODB demonstrate that MamWorld achieves strong performance, especially for rare and unknown categories, while maintaining practical efficiency for UAV perception scenarios.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-05-11
DOI
https://doi.org/10.1038/s41598-026-52044-2
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MamWorld for open-world object detection with state space modeling and cross-modal fusion

Hongfei Zhao, Deng Zongqiang
Scientific Reports
Advanced Neural Network Applications
article

MamWorld for open-world object detection with state space modeling and cross-modal fusion

Hongfei Zhao, Deng Zongqiang
article en

Abstract

Open-vocabulary detection (OVD) and open-world object detection (OWOD) are increasingly important for unmanned aerial vehicle (UAV) perception, where detectors must recognize known, unseen, long-tail, and unknown objects in complex aerial scenes. UAV-based detection is particularly challenging due to small targets, cluttered backgrounds, large viewpoint changes, and strict efficiency requirements for onboard deployment. Existing convolutional detectors capture local details efficiently but are limited in long-range dependency modeling, while Transformer-based methods provide stronger global reasoning at the cost of high computational complexity. In addition, many current OVD and OWOD methods rely on shallow cross-modal fusion, which weakens semantic consistency between aerial visual regions and textual category descriptions. To address these challenges, we propose MamWorld, a unified state-space-based detection framework for UAV-oriented open-category object detection. MamWorld introduces an ODMamba-based backbone with MassBlock to enhance cross-channel interaction, multi-scale spatial aggregation, and long-range dependency modeling for small and ambiguous aerial objects. It further employs TextMambaBlock and SGSS-TextMambaBlock to generate semantically selective textual representations, and MambaFusion-PAN to perform recursive bidirectional vision-language fusion across scales. This end-to-end design enables efficient alignment between UAV imagery and open-category semantics while supporting both OVD and OWOD. Experiments on LVIS, M-OWODB, and S-OWODB demonstrate that MamWorld achieves strong performance, especially for rare and unknown categories, while maintaining practical efficiency for UAV perception scenarios.

Scientific Reports
Guangdong Police College (CN)
Quality Education
Openalex Percentile: Top 5%
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

MamWorld for open-world object detection with state space modeling and cross-modal fusion — Hongfei Zhao, Deng Zongqiang · Scientific Reports (2026) | TGRS Research Map | TGRS