A Bio-Inspired Geomagnetic Navigation Method Based on Hybrid Reinforcement Learning and Greedy Descent

Geomagnetic navigation offers geospatial positioning in GNSS-denied environments, using the global geomagnetic reference field as a continuously available reference. Traditional map-free bio-inspired navigation, however, relies on random search, which limits experience accumulation and search efficiency. To overcome this, this paper proposes a hybrid reinforcement learning and greedy descent (RL-GD) method. A state–action value table (Q-table) is trained offline in a simulation environment with randomly sampled start and target points using the 14th generation International Geomagnetic Reference Field (IGRF-14) model. In the online navigation stage, Q-table-based heading suggestions are fused with local trial candidates to form hybrid decisions that minimize normalized geomagnetic costs, while pure greedy descent is automatically activated for untrained states. In 50 paired Monte Carlo trials, RL-GD reduces the mean number of iterations from 3572 (EAS) to 1949 (a 45.4% reduction), lowers the path ratio from 2.15 to 1.16, and decreases the terminal positioning error from 0.078% to 0.037% of the straight-line distance. Ablation tests showed that removing greedy descent reduced success from 100% to 0% across all 50 tasks, while the Q-table prior reduced iterations by 17.3%. Under measurement noise of 2.5–10 nT, RL-GD maintained a 100% success rate, whereas EAS decreased from 100% (≤5 nT) to 28% (10 nT).

Authors

Institutions

Publication Details

Journal
Geomatics
Published
2026-11-19
DOI
https://doi.org/10.3390/geomatics6060147
Primary Topic
Inertial Sensor and Navigation
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A Bio-Inspired Geomagnetic Navigation Method Based on Hybrid Reinforcement Learning and Greedy Descent

Hanbing Wang, Jiaojiao Guo, Jiazheng Liu, Yukun Li et al.
Geomatics
Inertial Sensor and Navigation
article

A Bio-Inspired Geomagnetic Navigation Method Based on Hybrid Reinforcement Learning and Greedy Descent

Hanbing Wang, Jiaojiao Guo, Jiazheng Liu, Yukun Li, Min Yang, Xiaolin Ji, Binfeng Yang
article en

Abstract

Geomagnetic navigation offers geospatial positioning in GNSS-denied environments, using the global geomagnetic reference field as a continuously available reference. Traditional map-free bio-inspired navigation, however, relies on random search, which limits experience accumulation and search efficiency. To overcome this, this paper proposes a hybrid reinforcement learning and greedy descent (RL-GD) method. A state–action value table (Q-table) is trained offline in a simulation environment with randomly sampled start and target points using the 14th generation International Geomagnetic Reference Field (IGRF-14) model. In the online navigation stage, Q-table-based heading suggestions are fused with local trial candidates to form hybrid decisions that minimize normalized geomagnetic costs, while pure greedy descent is automatically activated for untrained states. In 50 paired Monte Carlo trials, RL-GD reduces the mean number of iterations from 3572 (EAS) to 1949 (a 45.4% reduction), lowers the path ratio from 2.15 to 1.16, and decreases the terminal positioning error from 0.078% to 0.037% of the straight-line distance. Ablation tests showed that removing greedy descent reduced success from 100% to 0% across all 50 tasks, while the Q-table prior reduced iterations by 17.3%. Under measurement noise of 2.5–10 nT, RL-GD maintained a 100% success rate, whereas EAS decreased from 100% (≤5 nT) to 28% (10 nT).

GeomaticsVol. 6(6)
Air Force Engineering University (CN)
Inertial Sensor and Navigation
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon