Double Entropy Reinforcement Learning: Achieving Optimal Outcomes Despite Imperfect Teacher Guidance

Reinforcement learning (RL) has become a key method for decision-making in autonomous vehicles, particularly in tasks like path planning and obstacle avoidance. However, RL often struggles with sparse or delayed reward signals, which can hinder learning. A promising solution is incorporating a teacher-student framework, where the agent learns from a teacher. While these methods can accelerate learning, they risk sub-optimal outcomes if the teacher's guidance is flawed. This paper introduces Double Entropy Reinforcement Learning (DERL), which enables the student to initially rely on the teacher and gradually shift towards independent exploration as it surpasses the teacher's performance. Experiments show that DERL outperforms existing teacher-student algorithms in learning efficiency and effectiveness, reducing reliance on imperfect guidance.

Authors

Institutions

Publication Details

Published
2025-06-22
DOI
https://doi.org/10.1109/iv64158.2025.11097813
Primary Topic
Evolutionary Algorithms and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Double Entropy Reinforcement Learning: Achieving Optimal Outcomes Despite Imperfect Teacher Guidance

Aoyong Li, Hongqing Chu, Heng Wang, Yifan Cheng et al.
Evolutionary Algorithms and Applications
article

Double Entropy Reinforcement Learning: Achieving Optimal Outcomes Despite Imperfect Teacher Guidance

Aoyong Li, Hongqing Chu, Heng Wang, Yifan Cheng, Bingzhao Gaol
article en

Abstract

Reinforcement learning (RL) has become a key method for decision-making in autonomous vehicles, particularly in tasks like path planning and obstacle avoidance. However, RL often struggles with sparse or delayed reward signals, which can hinder learning. A promising solution is incorporating a teacher-student framework, where the agent learns from a teacher. While these methods can accelerate learning, they risk sub-optimal outcomes if the teacher's guidance is flawed. This paper introduces Double Entropy Reinforcement Learning (DERL), which enables the student to initially rely on the teacher and gradually shift towards independent exploration as it surpasses the teacher's performance. Experiments show that DERL outperforms existing teacher-student algorithms in learning efficiency and effectiveness, reducing reliance on imperfect guidance.

Tongji University (CN), Beijing Transportation Research Center (CN), Beihang University (CN)
Openalex Percentile: Top 90%
Evolutionary Algorithms and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Double Entropy Reinforcement Learning: Achieving Optimal Outcomes Despite Imperfect Teacher Guidance — Aoyong Li, Hongqing Chu, et al. · (2025) | TGRS Research Map | TGRS