Letting the Sensor Do the Geometry: Telemetry Metric Tokenization for Aerial Vision and Language Navigation

Vision and language navigation (VLN) for unmanned aerial vehicles (UAVs) requires an agent to follow natural language instructions while perceiving scenes whose appearance changes with flight altitude and heading. Existing methods treat these variations as nuisances to be learned, spending model capacity on scale and orientation invariance that the imaging geometry already determines. We propose SOAR, a telemetry-conditioned framework that uses onboard altitude, heading, and camera intrinsics to normalize the viewpoint at the input. A parameter free metric tokenizer rescales and rotates each frame so that every token covers a fixed ground footprint in a north-up frame. Under near-nadir, locally planar conditions, this reduces the perspective to bird’s-eye-view transformation to a reshape, a single convolution, and a tilt-correcting homography. Map registration then becomes pure translation, and language grounding and waypoint prediction operate directly in metric units. SOAR trains on a single 24 GB GPU. On the validation–unseen splits of AerialVLN-S and CityNav, SOAR reached success rates of 8.0% and 8.5%, with navigation errors of 120.0 m and 121.0 m, respectively. We report these results next to benchmark values from the literature as reference points for context. Because the experimental configurations differed, these comparisons do not support claims of controlled superiority over previously published methods.

Authors

Institutions

Publication Details

Journal
Sensors
Published
2026-11-17
DOI
https://doi.org/10.3390/s26227255
Primary Topic
Robotics and Sensor-Based Localization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Letting the Sensor Do the Geometry: Telemetry Metric Tokenization for Aerial Vision and Language Navigation

Heung Seok Jeon, Shakhnoza Muksimova, Doston Khasanov, Sarvarbek Sodikovich Yusupov et al.
2 links
Sensors
Robotics and Sensor-Based Localization
article

Letting the Sensor Do the Geometry: Telemetry Metric Tokenization for Aerial Vision and Language Navigation

Heung Seok Jeon, Shakhnoza Muksimova, Doston Khasanov, Sarvarbek Sodikovich Yusupov, Oybek Mallayev, Su-Mi Shin, Ergashevich Halimjon Khujamatov, Khujamatova Shakhlo
article en

Abstract

Vision and language navigation (VLN) for unmanned aerial vehicles (UAVs) requires an agent to follow natural language instructions while perceiving scenes whose appearance changes with flight altitude and heading. Existing methods treat these variations as nuisances to be learned, spending model capacity on scale and orientation invariance that the imaging geometry already determines. We propose SOAR, a telemetry-conditioned framework that uses onboard altitude, heading, and camera intrinsics to normalize the viewpoint at the input. A parameter free metric tokenizer rescales and rotates each frame so that every token covers a fixed ground footprint in a north-up frame. Under near-nadir, locally planar conditions, this reduces the perspective to bird’s-eye-view transformation to a reshape, a single convolution, and a tilt-correcting homography. Map registration then becomes pure translation, and language grounding and waypoint prediction operate directly in metric units. SOAR trains on a single 24 GB GPU. On the validation–unseen splits of AerialVLN-S and CityNav, SOAR reached success rates of 8.0% and 8.5%, with navigation errors of 120.0 m and 121.0 m, respectively. We report these results next to benchmark values from the literature as reference points for context. Because the experimental configurations differed, these comparisons do not support claims of controlled superiority over previously published methods.

SensorsVol. 26(22)
Gachon University (KR), Tashkent University of Information Technology (UZ), Konkuk University (KR), Kimyo International University in Tashkent (UZ), Alfraganus University (UZ), Korea Institute of Science & Technology Information (KR)
Robotics and Sensor-Based Localization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon