Double Deep Q-Network-Based Solution to a Dynamic, Energy-Efficient Hybrid Flow Shop Scheduling System with the Transport Process

In this paper, a dynamic energy-efficient hybrid flow shop (TDEHFSP) scheduling model is proposed, considering random arrivals of new jobs and transport by transfer vehicles. To simultaneously optimise the maximum completion time and the total energy consumption, a co-evolutionary approach (DDQCE) using a double deep Q-network (DDQN) is introduced, where global and local search tasks are assigned to different populations to optimise the use of computational resources. In addition, a multi-objective NEW heuristic strategy is implemented to generate an initial population with enhanced convergence and diversity. The DDQCE incorporates an energy-efficient strategy based on time interval ‘left shift’ and turn-on/off mechanisms, alongside a rescheduling model to manage dynamic disturbances. In addition, 36 test instances of varying sizes, simplified from the excavator boom manufacturing process, are designed for comparative experiments with traditional algorithms. The experimental results demonstrate that DDQCE achieves 40% more Pareto-optimal solutions compared to NSGA-II and MOEA/D while requiring 10% less computational time, confirming that this algorithm efficiently solves the TDEHFSP problem.