Demonstration-Augmented Deep Reinforcement Learning for Robotic Task Optimization: A Framework for Enhanced Learning Efficiency and Precision

Deep Reinforcement Learning (DRL) enables robots to learn complex tasks autonomously. However, its reliance on random exploration and sparse reward signals often leads to inefficient learning and suboptimal performance. This paper presents a framework that integrates expert-generated data into the model-free DRL training process to improve learning efficiency and task precision. The proposed method introduces expert demonstrations into the replay buffer during training and dynamically adjusts their sampling to facilitate a smooth transition from expert-guided learning to autonomous policy optimization. Unlike approaches that rely on pre-collected expert datasets, this framework provides expert data online during training, which allows adaptive guidance based on task requirements. The approach is evaluated in robotic tasks involving sequential decision-making and object interaction. The results demonstrate that integrating expert data enhances learning efficiency and makes it an effective strategy for training DRL agents in structured environments.

Authors

Institutions

Publication Details

Published
2025-08-17
DOI
https://doi.org/10.1109/case58245.2025.11163888
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Demonstration-Augmented Deep Reinforcement Learning for Robotic Task Optimization: A Framework for Enhanced Learning Efficiency and Precision

Alexander Winkler, Mohammad-Ehsan Matour
Reinforcement Learning in Robotics
article

Demonstration-Augmented Deep Reinforcement Learning for Robotic Task Optimization: A Framework for Enhanced Learning Efficiency and Precision

Alexander Winkler, Mohammad-Ehsan Matour
article en

Abstract

Deep Reinforcement Learning (DRL) enables robots to learn complex tasks autonomously. However, its reliance on random exploration and sparse reward signals often leads to inefficient learning and suboptimal performance. This paper presents a framework that integrates expert-generated data into the model-free DRL training process to improve learning efficiency and task precision. The proposed method introduces expert demonstrations into the replay buffer during training and dynamically adjusts their sampling to facilitate a smooth transition from expert-guided learning to autonomous policy optimization. Unlike approaches that rely on pre-collected expert datasets, this framework provides expert data online during training, which allows adaptive guidance based on task requirements. The approach is evaluated in robotic tasks involving sequential decision-making and object interaction. The results demonstrate that integrating expert data enhances learning efficiency and makes it an effective strategy for training DRL agents in structured environments.

Hochschule Mittweida (DE)
Openalex Percentile: Top 86%
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Demonstration-Augmented Deep Reinforcement Learning for Robotic Task Optimization: A Framework for Enhanced Learning Efficiency and Precision — Alexander Winkler, Mohammad-Ehsan Matour · (2025) | TGRS Research Map | TGRS