Policy Gradient Strategies for Lunar Lander Navigation: A Deep Reinforcement Learning Approach (REINFORCE).

This research investigates Policy Gradient strategies, specifically the REINFORCE algorithm with various baseline improvements, for solving the Lunar Lander problem in OpenAI Gym.We demonstrate how REINFORCE directly optimizes policy parameters without maintaining Q-values, making it particularly suitable for continuous state spaces where traditional tabular methods fail.Our comparative analysis reveals that while basic REINFORCE achieves moderate success, incorporating adaptive baselines significantly reduces gradient variance and improves learning stability.The implementation achieves optimal landing performance by balancing exploration and exploitation through Monte-Carlo methods, with visual confirmation of successful landings between designated flags.

Authors

Institutions

Publication Details

Published
2025-04-21
DOI
https://doi.org/10.54985/peeref.2504p1094338
Primary Topic
Spacecraft Dynamics and Control
Type
article
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Policy Gradient Strategies for Lunar Lander Navigation: A Deep Reinforcement Learning Approach (REINFORCE).

Thirumalai Murugan R
Spacecraft Dynamics and Control
article

Policy Gradient Strategies for Lunar Lander Navigation: A Deep Reinforcement Learning Approach (REINFORCE).

Thirumalai Murugan R
article en

Abstract

This research investigates Policy Gradient strategies, specifically the REINFORCE algorithm with various baseline improvements, for solving the Lunar Lander problem in OpenAI Gym.We demonstrate how REINFORCE directly optimizes policy parameters without maintaining Q-values, making it particularly suitable for continuous state spaces where traditional tabular methods fail.Our comparative analysis reveals that while basic REINFORCE achieves moderate success, incorporating adaptive baselines significantly reduces gradient variance and improves learning stability.The implementation achieves optimal landing performance by balancing exploration and exploitation through Monte-Carlo methods, with visual confirmation of successful landings between designated flags.

VIT-AP University
Spacecraft Dynamics and Control
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.