Peak Shaving and Solar Utilization for Sustainable Campus EV Charging Using Reinforcement Learning Approach

To reduce the carbon footprint, electric vehicles (EVs) are considered an alternative transportation choice. However, increased use of EVs could lead to overloading the existing power network when accounting for all installed chargers. With the increasing deployment of EV chargers, universities are potential locations for the oversized power network issue. This paper applies reinforcement learning (RL) to optimize for EV charging infrastructure at the university scale using real-world data, directly contributing to sustainable energy management by reducing grid burden and increasing renewable energy utilization. The RL-based charger aims to reduce the burden on the grid while increasing renewable energy utilization. This study investigated practical relevance in real-world systems, considering three demand scenarios: random, stochastic historical demand from Qatar University, and actual online data from Caltech University. Three RL algorithms—Deep Q-Network (DQN), Advantage Actor–Critic (A2C), and Proximal Policy Optimization (PPO)—are applied. While training, the historical stochastic data requires more tuning of the RL framework than the random demand, emphasizing the importance of realistic demand profiles. The performance of the RL approach depends on the type of demand. The results show that the proposed RL approach can efficiently mitigate the peak charging currents. For the Qatar University historical demand scenario, the PPO algorithm minimized the peak charging currents by 50% relative to uncontrolled charging (160 A to 80 A) and Model Predictive Control maintained the energy transfer capability at 99.710%. For the random demand type, the peak charging currents are minimized by 38.3% as compared to uncontrolled charging (128 A to 79 A), with a nominal reduction in energy transfer capability to 95.89%. Scalability is tested by integrating the model into the IEEE-33 bus network. Without solar integration, the proposed RL-based EV charging management model improves the voltage drop by 0.05 p.u., leading to reduction in the line losses by 17% as compared to the MPC benchmark method and by 32% as compared to the uncontrolled charging scheme. Further, the proposed RL approach leads to a 9% reduction in line current during peak hours in the IEEE-33 bus system. With solar integration into the IEEE-bus system, the proposed framework of the RL approach improved the sustainability of the charging infrastructures by enhancing solar energy utilization by 42.5%. These findings validate the applicability of the proposed model used for optimizing the sustainable EV charging infrastructure while managing the charging coordination problem.