Markov Decision Process-based Real-time Navigation for Autonomous Aerial Vehicles Using Video

Abstract Autonomous aerial vehicle navigation is critical for applications ranging from search and rescue operations to warehouse automation, requiring real-time decision-making under severe computational and power constraints. While traditional geometric approaches using 3D point clouds provide accurate navigation, they impose prohibitive computational overhead for resource-constrained drones, and existing computer vision algorithms for semantic navigation create a fundamental performance bottleneck where static parameter configurations fail to adapt to varying environmental conditions. This paper addresses this gap through a novel Markov Decision Process (MDP) framework that dynamically optimizes object detection parameters based on input characteristics, intelligently selecting algorithm configurations from both feature-based (HoG/Edgeboxes with SVMs) and neural network (CNN) detection pipelines while utilizing classifier confidence scores as quality indicators. Comprehensive evaluation across KUL traffic sign datasets, custom BU-RU drone-collected footage, and hardware-in-the-loop AirSim simulations demonstrates significant performance improvements: 20-70% execution time reduction while maintaining 98-100% detection accuracy compared to static approaches, real-time 30fps processing at 480 $$\times $$ × 270 resolution, and up to 18 $$\times $$ × improvement in frame processing rates during closed-loop navigation tasks. These computational efficiency gains translate to substantial energy savings, achieving 6.9W power reduction on NVIDIA Jetson TX2 hardware through proportional decreases in processing time and computational load.

Authors

Institutions

Publication Details

Journal
Journal of Intelligent & Robotic Systems
Published
2026-11-17
DOI
https://doi.org/10.1007/s10846-026-02388-8
Citations
1
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
1.14

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Markov Decision Process-based Real-time Navigation for Autonomous Aerial Vehicles Using Video

Dario Pompili, Vidyasagar Sadhu, Roberto Tron, Parul Pandey et al.
1 citations
Journal of Intelligent & Robotic Systems
Advanced Neural Network Applications
1.14
article

Markov Decision Process-based Real-time Navigation for Autonomous Aerial Vehicles Using Video

Dario Pompili, Vidyasagar Sadhu, Roberto Tron, Parul Pandey, Khizar Anjum
article en
1 citations

Abstract

Abstract Autonomous aerial vehicle navigation is critical for applications ranging from search and rescue operations to warehouse automation, requiring real-time decision-making under severe computational and power constraints. While traditional geometric approaches using 3D point clouds provide accurate navigation, they impose prohibitive computational overhead for resource-constrained drones, and existing computer vision algorithms for semantic navigation create a fundamental performance bottleneck where static parameter configurations fail to adapt to varying environmental conditions. This paper addresses this gap through a novel Markov Decision Process (MDP) framework that dynamically optimizes object detection parameters based on input characteristics, intelligently selecting algorithm configurations from both feature-based (HoG/Edgeboxes with SVMs) and neural network (CNN) detection pipelines while utilizing classifier confidence scores as quality indicators. Comprehensive evaluation across KUL traffic sign datasets, custom BU-RU drone-collected footage, and hardware-in-the-loop AirSim simulations demonstrates significant performance improvements: 20-70% execution time reduction while maintaining 98-100% detection accuracy compared to static approaches, real-time 30fps processing at 480 $$\times $$ × 270 resolution, and up to 18 $$\times $$ × improvement in frame processing rates during closed-loop navigation tasks. These computational efficiency gains translate to substantial energy savings, achieving 6.9W power reduction on NVIDIA Jetson TX2 hardware through proportional decreases in processing time and computational load.

Journal of Intelligent & Robotic Systems
Rutgers, The State University of New Jersey (US), Boston University (US), University of Massachusetts Boston (US)
National Science Foundation, Division of Computing and Communication Foundations
Openalex Percentile: Top 26%
Advanced Neural Network Applications
1.14
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon