Obstacle avoidance parking based on improved deep reinforcement learning SAC algorithm
Recent research uses neural-network-based approaches to generate time-optimized parking trajectories in linear time. However, the generalization of these neural networks in different parking lot scenarios is not fully considered and relies on high-quality data. To address these issues, this paper proposes an improved soft actor critic (SA C)-based parking trajectory planning method to achieve fast convergence and high success rate. A trajectory data-based reward function and an experience replay sampling strategy are designed simultaneously improve the learning efficiency. Meanwhile, the Flatten-T Swish Plus (FTSPlus) activation function is firstly introduced into the SAC's neural network structure to enhance the convergence capabilities. The simulation results show that compared with traditional SAC methods, the success rate has been greatly improved and convergence rate has also been improved by more than 60%. Furthermore, it has the good model generalization ability while maintaining collision-free traj ectories.
Authors
- KyungHi Chang (ORCID: https://orcid.org/0000-0002-2565-5391)
- Ting Liu (ORCID: https://orcid.org/0000-0003-0749-064X)
- Ping Liu (ORCID: https://orcid.org/0000-0002-2026-122X)
- Mingjie Liu
- Changhao Piao
Institutions
- Chongqing University of Posts and Telecommunications (CN)
- Inha University (KR)
Publication Details
- Published
- 2024-11-01
- DOI
- https://doi.org/10.1109/cac63892.2024.10864486
- Primary Topic
- Smart Parking Systems Research
- Type
- article
- Field-Weighted Citation Impact
- 0.00