AeroGuide: Grounded Vision-Language Navigation in Aerial Environments

Aerial vision-language navigation (VLN) requires a UAV to follow natural language instructions from visual observations. Aerial VLN is more challenging than ground-level VLN because UAV observations cover large outdoor areas, landmarks often occupy only a small part of the image, and navigation requires complex spatial reasoning. General-purpose vision-language models (VLMs) often struggle to identify instruction-relevant visual evidence from such dense aerial observations. We propose AeroGuide, a grounded aerial VLN framework built on Qwen3-VL. AeroGuide introduces Navigation-conditioned Visual Token Routing (NVTR), which selects instruction-relevant visual tokens conditioned on the current observation, UAV pose, and temporal landmark memory. AeroGuide maintains an egocentric temporal landmark memory that retains compact landmark evidence rather than full historical frames. The model is trained through multiple phases, including supervised learning, reasoning distillation, and simulator-based policy optimization, to improve grounded action prediction and closed-loop navigation. On the OpenFly benchmark, AeroGuide improves navigation success rate from 34.3% to 45.1%, a 31.5% relative improvement over the best-performing prior baseline. Ablation studies show that explicit visual grounding and compact temporal memory are key contributors to this improvement, demonstrating the effectiveness of grounded navigation for aerial VLN. Project page is available at https://aeroguide-frontend-iota.vercel.app/.

Authors

Institutions

Publication Details

Journal
ACM Journal on Autonomous Transportation Systems
Published
2026-11-06
DOI
https://doi.org/10.1145/3860544
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

AeroGuide: Grounded Vision-Language Navigation in Aerial Environments

Shashi Shekhar Jha, Siddharth Singh, Abhinav Upadhyay, Satvik Srivastava et al.
2 links
ACM Journal on Autonomous Transportation Systems
Multimodal Machine Learning Applications
article

AeroGuide: Grounded Vision-Language Navigation in Aerial Environments

Shashi Shekhar Jha, Siddharth Singh, Abhinav Upadhyay, Satvik Srivastava, Ashutosh Pandey, Tanya Khanna
article en

Abstract

Aerial vision-language navigation (VLN) requires a UAV to follow natural language instructions from visual observations. Aerial VLN is more challenging than ground-level VLN because UAV observations cover large outdoor areas, landmarks often occupy only a small part of the image, and navigation requires complex spatial reasoning. General-purpose vision-language models (VLMs) often struggle to identify instruction-relevant visual evidence from such dense aerial observations. We propose AeroGuide, a grounded aerial VLN framework built on Qwen3-VL. AeroGuide introduces Navigation-conditioned Visual Token Routing (NVTR), which selects instruction-relevant visual tokens conditioned on the current observation, UAV pose, and temporal landmark memory. AeroGuide maintains an egocentric temporal landmark memory that retains compact landmark evidence rather than full historical frames. The model is trained through multiple phases, including supervised learning, reasoning distillation, and simulator-based policy optimization, to improve grounded action prediction and closed-loop navigation. On the OpenFly benchmark, AeroGuide improves navigation success rate from 34.3% to 45.1%, a 31.5% relative improvement over the best-performing prior baseline. Ablation studies show that explicit visual grounding and compact temporal memory are key contributors to this improvement, demonstrating the effectiveness of grounded navigation for aerial VLN. Project page is available at https://aeroguide-frontend-iota.vercel.app/.

ACM Journal on Autonomous Transportation Systems
Indian Institute of Technology Ropar (IN), Harman (United Kingdom) (GB), Harman (Germany) (DE), Harman (United States) (US)
Openalex Percentile: Top 22%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon