Uncertainty-Guided Belief World Models for Long-Horizon UAV Navigation under Partial Observability and Visual Degradation

Abstract Long-horizon UAV navigation under partial observability and visual degradation requires reliable decisions from uncertain current beliefs and increasingly uncertain imagined futures. We propose the Uncertainty-Guided Belief World Model (UG-BWM), which exposes posterior covariance to the actor and critic, propagates ensemble-based predictive uncertainty through latent rollouts, penalizes uncertain and collision-prone imagined transitions, and triggers candidate-sequence replanning through a hysteretic uncertainty rule. We evaluate UG-BWM in Gazebo Harmonic with PX4 SITL across six locked-test conditions, three route lengths, four visual-degradation types, and unseen structural shifts. UG-BWM achieves a success rate of 0.63, a collision rate of 0.15, and an SPL of 0.62, compared with 0.54, 0.20, and 0.54 for DreamerV3-CU. Controlled tests show that posterior confidence, the combined predictive uncertainty score, and the state-dependent imagined objective each contribute to performance. Predictive uncertainty remains positively associated with rollout error beyond the training horizon. During deployment, uncertainty-triggered replanning matches always-plan performance while activating the planner on 18\% of control steps, reducing planner use by 82\%. The results support uncertainty-explicit belief modeling and selective planning for UAV navigation under degraded sensing.

Authors

Institutions

Publication Details

Journal
Research Square
Published
2026-11-05
DOI
https://doi.org/10.21203/rs.3.rs-10749144/v1
Primary Topic
Reinforcement Learning in Robotics
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Uncertainty-Guided Belief World Models for Long-Horizon UAV Navigation under Partial Observability and Visual Degradation

Dhayaa Khudher
Research Square
Reinforcement Learning in Robotics
preprint

Uncertainty-Guided Belief World Models for Long-Horizon UAV Navigation under Partial Observability and Visual Degradation

Dhayaa Khudher
preprint en

Abstract

Abstract Long-horizon UAV navigation under partial observability and visual degradation requires reliable decisions from uncertain current beliefs and increasingly uncertain imagined futures. We propose the Uncertainty-Guided Belief World Model (UG-BWM), which exposes posterior covariance to the actor and critic, propagates ensemble-based predictive uncertainty through latent rollouts, penalizes uncertain and collision-prone imagined transitions, and triggers candidate-sequence replanning through a hysteretic uncertainty rule. We evaluate UG-BWM in Gazebo Harmonic with PX4 SITL across six locked-test conditions, three route lengths, four visual-degradation types, and unseen structural shifts. UG-BWM achieves a success rate of 0.63, a collision rate of 0.15, and an SPL of 0.62, compared with 0.54, 0.20, and 0.54 for DreamerV3-CU. Controlled tests show that posterior confidence, the combined predictive uncertainty score, and the state-dependent imagined objective each contribute to performance. Predictive uncertainty remains positively associated with rollout error beyond the training horizon. During deployment, uncertainty-triggered replanning matches always-plan performance while activating the planner on 18\% of control steps, reducing planner use by 82\%. The results support uncertainty-explicit belief modeling and selective planning for UAV navigation under degraded sensing.

Research Square
University of Basrah (IQ)
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon