Intelligent Quadruped Robot Locomotion using PPO Agent

This paper presents the application of the Proximal Policy Optimization (PPO) algorithm in Reinforcement Learning (RL) for autonomous locomotion in quadruped robots. These robots are increasingly used as transformative tools in industrial applications, such as transporting goods and conducting surveillance, especially in challenging or remote environments. The PPO agent interacts with the quadruped environment to learn an optimal control policy that enables the robot to navigate complex and varied terrains with stability and reliability. The agent takes states (observations) as inputs and outputs actions for which a delayed reward is received. The PPO algorithm optimizes policy updates within safe bounds, balancing exploration and exploitation to enhance adaptability and minimize instability in control tasks. This approach helped a four-legged robot walk steadily and efficiently in a simulated environment using a PPO algorithm, showing strong stability and smooth walking.

Authors

Institutions

Publication Details

Published
2025-05-23
DOI
https://doi.org/10.1109/incet64471.2025.11140434
Primary Topic
Robotic Locomotion and Control
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Intelligent Quadruped Robot Locomotion using PPO Agent

Vijaya Lakshmi Korupu, Appa Rao Korukonda, Priyanka Banka, Chaitanya Varma Pakalapati et al.
Robotic Locomotion and Control
article

Intelligent Quadruped Robot Locomotion using PPO Agent

Vijaya Lakshmi Korupu, Appa Rao Korukonda, Priyanka Banka, Chaitanya Varma Pakalapati, Bindu Nalluri
article en

Abstract

This paper presents the application of the Proximal Policy Optimization (PPO) algorithm in Reinforcement Learning (RL) for autonomous locomotion in quadruped robots. These robots are increasingly used as transformative tools in industrial applications, such as transporting goods and conducting surveillance, especially in challenging or remote environments. The PPO agent interacts with the quadruped environment to learn an optimal control policy that enables the robot to navigate complex and varied terrains with stability and reliability. The agent takes states (observations) as inputs and outputs actions for which a delayed reward is received. The PPO algorithm optimizes policy updates within safe bounds, balancing exploration and exploitation to enhance adaptability and minimize instability in control tasks. This approach helped a four-legged robot walk steadily and efficiently in a simulated environment using a PPO algorithm, showing strong stability and smooth walking.

Siddhartha Medical College (IN)
Openalex Percentile: Top 78%
Robotic Locomotion and Control
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Intelligent Quadruped Robot Locomotion using PPO Agent — Vijaya Lakshmi Korupu, Appa Rao Korukonda, et al. · (2025) | TGRS Research Map | TGRS