A Multi-Objective Reinforcement Learning Based Energy Management Strategy for Electric Vehicles With Battery and Supercapacitor Integration

This paper proposes a Soft Actor-Critic (SAC)-based Energy Management Strategy (EMS) for All Electric Vehicles (AEVs) equipped with a Hybrid Energy Storage System (HESS). A custom-designed reward function is formulated to explicitly drive the SAC agent toward achieving three key objectives: extending battery lifetime, increasing vehicle mileage, and enhancing energy efficiency. The SAC agent, developed in Python, communicates with a Simulink-modeled environment over TCP/IP using the Simulink_gym wrapper. Simulation results demonstrate that the SAC-based EMS outperforms a conventional rule-based strategy in terms of State of Charge (SoC) preservation, power smoothing, and loss reduction. Future work includes real-time validation through Hardware-in-the-Loop (HIL) testing.

Authors

Institutions

Publication Details

Published
2025-06-20
DOI
https://doi.org/10.1109/isie62713.2025.11124663
Citations
1
Primary Topic
Electric and Hybrid Vehicle Technologies
Type
article
Field-Weighted Citation Impact
0.68
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Multi-Objective Reinforcement Learning Based Energy Management Strategy for Electric Vehicles With Battery and Supercapacitor Integration

Parisa Ranjbaran, Alireza Bakhshai, Javad Ebrahimi, Praveen Jain
1 citations
Electric and Hybrid Vehicle Technologies
0.68
article

A Multi-Objective Reinforcement Learning Based Energy Management Strategy for Electric Vehicles With Battery and Supercapacitor Integration

Parisa Ranjbaran, Alireza Bakhshai, Javad Ebrahimi, Praveen Jain
article en
1 citations

Abstract

This paper proposes a Soft Actor-Critic (SAC)-based Energy Management Strategy (EMS) for All Electric Vehicles (AEVs) equipped with a Hybrid Energy Storage System (HESS). A custom-designed reward function is formulated to explicitly drive the SAC agent toward achieving three key objectives: extending battery lifetime, increasing vehicle mileage, and enhancing energy efficiency. The SAC agent, developed in Python, communicates with a Simulink-modeled environment over TCP/IP using the Simulink_gym wrapper. Simulation results demonstrate that the SAC-based EMS outperforms a conventional rule-based strategy in terms of State of Charge (SoC) preservation, power smoothing, and loss reduction. Future work includes real-time validation through Hardware-in-the-Loop (HIL) testing.

Queen's University (CA)
Affordable and clean energy
Openalex Percentile: Top 26%
Electric and Hybrid Vehicle Technologies
0.68
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Multi-Objective Reinforcement Learning Based Energy Management Strategy for Electric Vehicles With Battery and Supercapacitor Integration — Parisa Ranjbaran, Alireza Bakhshai, et al. · (2025) | TGRS Research Map | TGRS