Obstacle avoidance parking based on improved deep reinforcement learning SAC algorithm

Recent research uses neural-network-based approaches to generate time-optimized parking trajectories in linear time. However, the generalization of these neural networks in different parking lot scenarios is not fully considered and relies on high-quality data. To address these issues, this paper proposes an improved soft actor critic (SA C)-based parking trajectory planning method to achieve fast convergence and high success rate. A trajectory data-based reward function and an experience replay sampling strategy are designed simultaneously improve the learning efficiency. Meanwhile, the Flatten-T Swish Plus (FTSPlus) activation function is firstly introduced into the SAC's neural network structure to enhance the convergence capabilities. The simulation results show that compared with traditional SAC methods, the success rate has been greatly improved and convergence rate has also been improved by more than 60%. Furthermore, it has the good model generalization ability while maintaining collision-free traj ectories.

Authors

Institutions

Publication Details

Published
2024-11-01
DOI
https://doi.org/10.1109/cac63892.2024.10864486
Primary Topic
Smart Parking Systems Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Obstacle avoidance parking based on improved deep reinforcement learning SAC algorithm

KyungHi Chang, Ting Liu, Ping Liu, Mingjie Liu et al.
Smart Parking Systems Research
article

Obstacle avoidance parking based on improved deep reinforcement learning SAC algorithm

KyungHi Chang, Ting Liu, Ping Liu, Mingjie Liu, Changhao Piao
article en

Abstract

Recent research uses neural-network-based approaches to generate time-optimized parking trajectories in linear time. However, the generalization of these neural networks in different parking lot scenarios is not fully considered and relies on high-quality data. To address these issues, this paper proposes an improved soft actor critic (SA C)-based parking trajectory planning method to achieve fast convergence and high success rate. A trajectory data-based reward function and an experience replay sampling strategy are designed simultaneously improve the learning efficiency. Meanwhile, the Flatten-T Swish Plus (FTSPlus) activation function is firstly introduced into the SAC's neural network structure to enhance the convergence capabilities. The simulation results show that compared with traditional SAC methods, the success rate has been greatly improved and convergence rate has also been improved by more than 60%. Furthermore, it has the good model generalization ability while maintaining collision-free traj ectories.

Chongqing University of Posts and Telecommunications (CN), Inha University (KR)
Openalex Percentile: Top 71%
Smart Parking Systems Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.