Multi-Agent Artificial Intelligence to Self-Organize Machine Networks for Resilient Manufacturing

Abstract Modern manufacturing is increasingly challenged by larger product varieties, shorter product life cycles, and unexpected production disruptions. Examples of such disruptions include market uncertainty, machine failures, and delivery backlogs. These disturbances are intricately interrelated, exacerbating system complexity and necessitating the adaptive organization (or re-configuration) of machine networks within factory layouts. However, traditional factory layouts are often stationary and lack the flexibility to rearrange or adjust machine networks in response to volatile markets and unexpected disruptions. Also, layout planning typically emphasizes offline design and configuration of machine networks and resources within a facility to optimize process flow and production performance, but tends to overlook the self-organizing arrangement of machines in a dynamic environment. Therefore, to address this gap, this paper presents a novel Self-organizing Machine Network (SOMN) model that optimizes the spatial layout of machine positions and queue configurations, thereby enhancing the manufacturing system’s resilience to unexpected disruptions. First, as opposed to traditional fixed machine positions, we design intelligent machine agents that communicate and autonomously reorganize in real-time to optimize key performance indicators (KPIs). Second, we develop the machine network model in a Digital Twin (DT) environment, facilitating cyber-physical interactions and capturing variations of state-action space in machine agents. Third, multi-agent reinforcement learning (MARL) algorithms empower these networked machine agents to adapt layouts and minimize the impact of disruptions on production performance. We evaluate and validate the proposed SOMN model through computer experiments, benchmarking it against random search and simulated annealing approaches. Experimental results show that the SOMN model significantly improves material handling efficiency, reduces computational overhead, and maintains productivity in different scenarios of manufacturing disruptions. This research holds strong potential for enabling distributed intelligence within self-organizing machine networks for resilient manufacturing.