Driver Behavior Modeling with Subjective Risk‐Driven Inverse Reinforcement Learning

This paper proposes a subjective risk‐driven driver behavior modeling approach that incorporates drivers’ risk perception into decision‐making. Inspired by cognitive science, the proposed framework decomposes drivers’ internal evaluation into preference, reward, and subjective risk constraint. The subjective risk is defined as the coupling between drivers’ perceived uncertainty and environmental cost. To obtain a differentiable representation of the subjective risk, we adopt a unified Gaussian potential field formulation that couples the drivers’ cognitive risk fields and environmental cost risk fields through a Gaussian overlap integral. Building upon this, a risk‐threshold Maximum Entropy Inverse Reinforcement Learning paradigm is developed to learn drivers’ internal preference reward and risk perception from demonstrations. Experimental results on large‐scale naturalistic driving data demonstrate that, compared with baseline methods, the proposed approach can stably learn policies that are more consistent with real human driving decision distributions, while maintaining strong performance in high‐risk scenarios. Further human‐in‐the‐loop experiments confirm its effectiveness in personalized modeling, achieving consistency with individual driving behavior across kinematic characteristics, decision‐making patterns, and subjective risk perception. In addition, qualitative analyses show that the learned subjective risk field provides an interpretable representation of drivers’ risk perception, revealing how perceived risk influences driving decision‐making processes.

Authors

Institutions

Publication Details

Journal
Advanced Intelligent Systems
Published
2026-04-30
DOI
https://doi.org/10.1002/aisy.70412
Primary Topic
Autonomous Vehicle Technology and Safety
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Driver Behavior Modeling with Subjective Risk‐Driven Inverse Reinforcement Learning

Zichao Wang, Zhishuai Yin, Yang Liang, Zhiwei He et al.
Advanced Intelligent Systems
Autonomous Vehicle Technology and Safety
article

Driver Behavior Modeling with Subjective Risk‐Driven Inverse Reinforcement Learning

Zichao Wang, Zhishuai Yin, Yang Liang, Zhiwei He, Yong Zuo, Linzhen Nie, Qingquan Wei
article en

Abstract

This paper proposes a subjective risk‐driven driver behavior modeling approach that incorporates drivers’ risk perception into decision‐making. Inspired by cognitive science, the proposed framework decomposes drivers’ internal evaluation into preference, reward, and subjective risk constraint. The subjective risk is defined as the coupling between drivers’ perceived uncertainty and environmental cost. To obtain a differentiable representation of the subjective risk, we adopt a unified Gaussian potential field formulation that couples the drivers’ cognitive risk fields and environmental cost risk fields through a Gaussian overlap integral. Building upon this, a risk‐threshold Maximum Entropy Inverse Reinforcement Learning paradigm is developed to learn drivers’ internal preference reward and risk perception from demonstrations. Experimental results on large‐scale naturalistic driving data demonstrate that, compared with baseline methods, the proposed approach can stably learn policies that are more consistent with real human driving decision distributions, while maintaining strong performance in high‐risk scenarios. Further human‐in‐the‐loop experiments confirm its effectiveness in personalized modeling, achieving consistency with individual driving behavior across kinematic characteristics, decision‐making patterns, and subjective risk perception. In addition, qualitative analyses show that the learned subjective risk field provides an interpretable representation of drivers’ risk perception, revealing how perceived risk influences driving decision‐making processes.

Advanced Intelligent Systems
Wuhan University of Technology (CN), Ji Hua Laboratory (CN), Hubei University of Automotive Technology (CN), Wuhan University of Science and Technology (CN), Hubei University of Technology (CN)
National Natural Science Foundation of China
Peace, Justice and strong institutions
Openalex Percentile: Top 9%
Autonomous Vehicle Technology and Safety
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.