Reinforcement Learning Framework for Delivery Capacity Scheduling with Vehicle Constraints

Improving the risk prevention capability of grid operations is a crucial requirement for smart resilient grids, where efficient dispatch and scheduling of delivery capacity play a pivotal role in enhancing grid resilience. Therefore, it is necessary to develop targeted intelligent dispatch algorithms based on operational data. To address this issue, this paper proposes a framework with inherent constraints and utilizes reinforcement learning using recursive neural networks. A constraint module is designed to identify available vehicle combinations based on de-livery capacity, allocate goods considering vehicle number, load, and size constraints, and generate delivery routes sequentially. Additionally, a reinforcement learning model is introduced, using negative trip length as a reward signal, optimizing parameters of the recursive neural network through policy gradient methods to automatically improve strategies for selecting optimal deliv-ery routes with improved vehicle combinations. To validate the effectiveness of this algorithm, extensive experiments were conducted using both real-world application validation data and the TSPLIB public dataset. Within a limited computational budget, the proposed algorithm outperforms several mature methods in terms of effectiveness and real-time performance, achieving near-optimal results in Euclidean graphs with nearly 100 nodes. These results demonstrate that this approach effectively addresses the intelligent scheduling of delivery capacity in digital twin systems for power storage,