A Bio-Inspired Geomagnetic Navigation Method Based on Hybrid Reinforcement Learning and Greedy Descent
Geomagnetic navigation offers geospatial positioning in GNSS-denied environments, using the global geomagnetic reference field as a continuously available reference. Traditional map-free bio-inspired navigation, however, relies on random search, which limits experience accumulation and search efficiency. To overcome this, this paper proposes a hybrid reinforcement learning and greedy descent (RL-GD) method. A state–action value table (Q-table) is trained offline in a simulation environment with randomly sampled start and target points using the 14th generation International Geomagnetic Reference Field (IGRF-14) model. In the online navigation stage, Q-table-based heading suggestions are fused with local trial candidates to form hybrid decisions that minimize normalized geomagnetic costs, while pure greedy descent is automatically activated for untrained states. In 50 paired Monte Carlo trials, RL-GD reduces the mean number of iterations from 3572 (EAS) to 1949 (a 45.4% reduction), lowers the path ratio from 2.15 to 1.16, and decreases the terminal positioning error from 0.078% to 0.037% of the straight-line distance. Ablation tests showed that removing greedy descent reduced success from 100% to 0% across all 50 tasks, while the Q-table prior reduced iterations by 17.3%. Under measurement noise of 2.5–10 nT, RL-GD maintained a 100% success rate, whereas EAS decreased from 100% (≤5 nT) to 28% (10 nT).
Authors
- Hanbing Wang (ORCID: https://orcid.org/0009-0006-0848-1867)
- Jiaojiao Guo (ORCID: https://orcid.org/0000-0001-5218-5201)
- Jiazheng Liu (ORCID: https://orcid.org/0000-0002-2001-1597)
- Yukun Li
- Min Yang (ORCID: https://orcid.org/0000-0002-2789-0926)
- Xiaolin Ji
- Binfeng Yang
Institutions
- Air Force Engineering University (CN)
Publication Details
- Journal
- Geomatics
- Published
- 2026-11-19
- DOI
- https://doi.org/10.3390/geomatics6060147
- Primary Topic
- Inertial Sensor and Navigation
- Type
- article
- Field-Weighted Citation Impact
- 0.00