LEAD: Learning-Enhanced Adaptive Decision-Making for Autonomous Driving in Dynamic Environments

This paper proposes a Learning-Enhanced Adaptive Decision-Making (LEAD) framework for autonomous vehicles (AVs) focusing on dynamic merging scenarios. To capture the competitive and strategic nature of vehicle interactions, we develop an interaction behavior model based on non-cooperative game theory. The behavior is modeled as a dynamic game, where each vehicle optimizes its actions using a multifactorial reward function. To optimize the behavior model parameters, maximum entropy inverse reinforcement learning (IRL) is employed to acquire optimal matching parameters. Additionally, a behavioral decision-making framework LEAD adapted to dynamic environments is proposed. By establishing a mapping between environmental variables and behavior model parameters, it enables parameters online learning and recognition, and achieves interactive behavior probabilities of AVs. Quantitative analysis employing naturalistic driving datasets (highD and exiD) and real-vehicle test data validates LEAD’s high consistency with human decision-making. In 188 tested interaction scenarios, the average human-like similarity rate is 81.73%, with a notable 83.12% in the highD dataset. Furthermore, in 145 dynamic interactions, LEAD matches human decisions at 77.12%, with 6913 consistence instances. Moreover, in real-vehicle tests, a 72.73% similarity with 0% safety violations is obtained. Results demonstrate the effectiveness of our LEAD framework in enabling AVs to make informed, adaptive behavior decisions in interactive environments.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Intelligent Transportation Systems
Published
2025-03-18
DOI
https://doi.org/10.1109/tits.2025.3531293
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LEAD: Learning-Enhanced Adaptive Decision-Making for Autonomous Driving in Dynamic Environments

Boqi Li, Heye Huang, Shiyue Zhao, Bo Zhang et al.
IEEE Transactions on Intelligent Transportation Systems
Reinforcement Learning in Robotics
article

LEAD: Learning-Enhanced Adaptive Decision-Making for Autonomous Driving in Dynamic Environments

Boqi Li, Heye Huang, Shiyue Zhao, Bo Zhang, Jianqiang Wang, Jinxin Liu
article en

Abstract

This paper proposes a Learning-Enhanced Adaptive Decision-Making (LEAD) framework for autonomous vehicles (AVs) focusing on dynamic merging scenarios. To capture the competitive and strategic nature of vehicle interactions, we develop an interaction behavior model based on non-cooperative game theory. The behavior is modeled as a dynamic game, where each vehicle optimizes its actions using a multifactorial reward function. To optimize the behavior model parameters, maximum entropy inverse reinforcement learning (IRL) is employed to acquire optimal matching parameters. Additionally, a behavioral decision-making framework LEAD adapted to dynamic environments is proposed. By establishing a mapping between environmental variables and behavior model parameters, it enables parameters online learning and recognition, and achieves interactive behavior probabilities of AVs. Quantitative analysis employing naturalistic driving datasets (highD and exiD) and real-vehicle test data validates LEAD’s high consistency with human decision-making. In 188 tested interaction scenarios, the average human-like similarity rate is 81.73%, with a notable 83.12% in the highD dataset. Furthermore, in 145 dynamic interactions, LEAD matches human decisions at 77.12%, with 6913 consistence instances. Moreover, in real-vehicle tests, a 72.73% similarity with 0% safety violations is obtained. Results demonstrate the effectiveness of our LEAD framework in enabling AVs to make informed, adaptive behavior decisions in interactive environments.

IEEE Transactions on Intelligent Transportation SystemsVol. 26(5)
University of Michigan (US), Tsinghua University (CN)
Peace, Justice and strong institutions
Openalex Percentile: Top 98%
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.