AeroGuide: Grounded Vision-Language Navigation in Aerial Environments
Aerial vision-language navigation (VLN) requires a UAV to follow natural language instructions from visual observations. Aerial VLN is more challenging than ground-level VLN because UAV observations cover large outdoor areas, landmarks often occupy only a small part of the image, and navigation requires complex spatial reasoning. General-purpose vision-language models (VLMs) often struggle to identify instruction-relevant visual evidence from such dense aerial observations. We propose AeroGuide, a grounded aerial VLN framework built on Qwen3-VL. AeroGuide introduces Navigation-conditioned Visual Token Routing (NVTR), which selects instruction-relevant visual tokens conditioned on the current observation, UAV pose, and temporal landmark memory. AeroGuide maintains an egocentric temporal landmark memory that retains compact landmark evidence rather than full historical frames. The model is trained through multiple phases, including supervised learning, reasoning distillation, and simulator-based policy optimization, to improve grounded action prediction and closed-loop navigation. On the OpenFly benchmark, AeroGuide improves navigation success rate from 34.3% to 45.1%, a 31.5% relative improvement over the best-performing prior baseline. Ablation studies show that explicit visual grounding and compact temporal memory are key contributors to this improvement, demonstrating the effectiveness of grounded navigation for aerial VLN. Project page is available at https://aeroguide-frontend-iota.vercel.app/.
Authors
- Shashi Shekhar Jha (ORCID: https://orcid.org/0000-0002-1375-2266)
- Siddharth Singh (ORCID: https://orcid.org/0009-0007-3583-8603)
- Abhinav Upadhyay (ORCID: https://orcid.org/0000-0001-8201-5959)
- Satvik Srivastava (ORCID: https://orcid.org/0009-0002-0096-9068)
- Ashutosh Pandey (ORCID: https://orcid.org/0009-0001-1511-3126)
- Tanya Khanna (ORCID: https://orcid.org/0009-0009-0107-4160)
Institutions
- Indian Institute of Technology Ropar (IN)
- Harman (United Kingdom) (GB)
- Harman (Germany) (DE)
- Harman (United States) (US)
Publication Details
- Journal
- ACM Journal on Autonomous Transportation Systems
- Published
- 2026-11-06
- DOI
- https://doi.org/10.1145/3860544
- Primary Topic
- Multimodal Machine Learning Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00