A METHOD FOR TRAINING AN INTELLIGENT AGENT USING DOUBLE DQN NETWORKS, WAYPOINTS AND REWARD FUNCTION

The problems of increasing the control efficiency of autonomous vehicles are considered. The problem of reducing the required computational resources for the intelligent vehicle control module is highlighted. A neural network training algorithm for Double DQN architecture with modified reward functions is proposed. The basis of the proposed solution is the use of lane segmentation, reward function and the use of additional waypoints in training. A software model has been developed and simulation of the learning process has been performed. The results obtained from a comparative analysis with known solutions show a stable increase in episode duration, and effective training in a realistic urban simulation. The study points to the possibility of reducing the need for high computing power, which will enable the use of central processing units (CPUs) for basic functions of unmanned vehicles instead of graphics processing units (GPUs).

Authors

Publication Details

Journal
Research Result Information Technologies
Published
2024-09-30
DOI
https://doi.org/10.18413/2518-1092-2024-9-3-0-7
Primary Topic
Industrial Technology and Control Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A METHOD FOR TRAINING AN INTELLIGENT AGENT USING DOUBLE DQN NETWORKS, WAYPOINTS AND REWARD FUNCTION

Dmitry Olegovich Nepomnyashchiy, V.N. Khaidukova, Maksim Konstantinovich Tikhonov
Research Result Information Technologies
Industrial Technology and Control Systems
article

A METHOD FOR TRAINING AN INTELLIGENT AGENT USING DOUBLE DQN NETWORKS, WAYPOINTS AND REWARD FUNCTION

Dmitry Olegovich Nepomnyashchiy, V.N. Khaidukova, Maksim Konstantinovich Tikhonov
article en

Abstract

The problems of increasing the control efficiency of autonomous vehicles are considered. The problem of reducing the required computational resources for the intelligent vehicle control module is highlighted. A neural network training algorithm for Double DQN architecture with modified reward functions is proposed. The basis of the proposed solution is the use of lane segmentation, reward function and the use of additional waypoints in training. A software model has been developed and simulation of the learning process has been performed. The results obtained from a comparative analysis with known solutions show a stable increase in episode duration, and effective training in a realistic urban simulation. The study points to the possibility of reducing the need for high computing power, which will enable the use of central processing units (CPUs) for basic functions of unmanned vehicles instead of graphics processing units (GPUs).

Research Result Information TechnologiesVol. 9(3)
Sustainable cities and communities
Openalex Percentile: Top 80%
Industrial Technology and Control Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A METHOD FOR TRAINING AN INTELLIGENT AGENT USING DOUBLE DQN NETWORKS, WAYPOINTS AND REWARD FUNCTION — Dmitry Olegovich Nepomnyashchiy, V.N. Khaidukova, et al. · Research Result Information Technologies (2024) | TGRS Research Map | TGRS