Hierarchical Energy Management and Charging Scheduling in the PV–CS–EV Integrated System

The integration of photovoltaic (PV) systems, electric vehicles (EVs), and charging stations (CSs) faces critical challenges, including PV intermittency, uncertain EV charging demand, and inefficient energy management. Existing strategies often overlook the precision of PV generation forecasts, the economic risks of electricity trading, and the diverse demands of EVs, leading to suboptimal performance. To address these limitations, we propose a two-tier management framework for PV-CS-EV systems, optimizing energy storage charging station (ESCS) operations by balancing profit maximization and risk minimization. The first tier employs accurate PV forecasting and power trading strategies between ESCS, PV farms, and the grid to mitigate economic risks from PV intermittency and market fluctuations. The second tier provides diverse charging strategies to maximize user satisfaction and profit. A key challenge lies in the complex interdependencies between the two tiers, requiring simultaneous optimization of power trading and user-specific charging scheduling under uncertainties. To tackle this, we introduce a hierarchical multi-objective reinforcement learning (MORL) algorithm, which efficiently coordinates decision tasks of both tiers through partial environment information interaction. Experimental results demonstrate the framework’s effectiveness in enhancing the economic performance of PV-CS-EV systems.