Model-Based Deep Reinforcement Learning for Energy Efficient Routing of a Connected and Automated Vehicle

The emergence of connected and automated vehicles (CAVs) offers promising opportunities to enhance traffic control and improve overall transportation system performance. However, the complexity and dynamic nature of modern traffic networks pose significant challenges for traditional routing methods. To achieve optimal vehicle routing and support sustainable mobility, more adaptive and intelligent strategies are needed. Among recent advancements, model-based deep reinforcement learning has shown exceptional potential in solving complex decision-making problems across various domains. Leveraging this capability, the present study applies a model-based deep reinforcement learning approach to address the energy-efficient routing problem in a simulated CAV environment. The routes recommended by the algorithm are compared to the shortest route calculated by traffic simulation software. The simulation results show a significant improvement in energy efficiency when the vehicle follows the routes suggested by the learning algorithm, even when the vehicle is subjected to new traffic scenarios. In addition, a comparison of the model-based agent with a conventional model-free reinforcement learning agent across varied traffic conditions demonstrates the robustness of the model-based algorithm. This work represents the first application of a model-based deep reinforcement learning algorithm to the energy-efficient routing problem for CAVs. This work also showcases a novel application of the foundational algorithm AlphaGo Zero.