Collaborative production control and distributor selection via multi-agent reinforcement learning with differentiable communication

Collaborative production control and distributor selection are essential for resource allocation and meeting the core of Industry 5.0’s human-centric vision. However, traditional approaches typically handle these decisions independently, failing to adequately address fluctuating market conditions, demand uncertainty, and varying distributor competencies. This paper integrates production control and distributor selection as a Partially Observable Markov Decision Process (POMDP) in a multi-agent system. Specifically, a production control agent optimizes outputs by balancing inventory levels and opportunity costs, while a distributor selection agent dynamically adjusts allocations considering workforce skill diversity, cost efficiency , and equity. The formulated POMDP is solved using a multi-agent reinforcement learning (MARL) framework featuring a differentiable communication layer and GRU-based recurrent neural networks . Numerical experiments conducted under both stable and highly volatile market conditions demonstrate the proposed system’s enhanced adaptability and responsiveness. In particular, inter-agent messaging communication leading to improved welfare metrics and robust performance under diverse distributor-weight configurations. Notably, the resulting system promotes equitable distributor involvement, aligning with Industry 5.0’s emphasis on sustainable, people-centric supply chain operations. • We formulate the collaborative production and distributor selection problem as a partially observable Markov decision process. • The uncertainties in demand, supply, and the stochastic capabilities of distributors are rigorously considered. • We proposed a reinforcement learning approach with a differentiable communication layer to facilitate inter-agent coordination. • Empirical results show improved efficiency, market responsiveness, and equal opportunities for distributors.

Authors

Institutions

Publication Details

Journal
Expert Systems with Applications
Published
2025-04-15
DOI
https://doi.org/10.1016/j.eswa.2025.127539
Citations
3
Primary Topic
Collaboration in agile enterprises
Type
article
Field-Weighted Citation Impact
8.28
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Collaborative production control and distributor selection via multi-agent reinforcement learning with differentiable communication

Andy H.F. Chow, Zicheng Su, Zhili Zhou, Qingshun Bai et al.
3 citations
Expert Systems with Applications
Collaboration in agile enterprises
8.28
article

Collaborative production control and distributor selection via multi-agent reinforcement learning with differentiable communication

Andy H.F. Chow, Zicheng Su, Zhili Zhou, Qingshun Bai, Yang Deng, Guojun Sheng
article en
3 citations

Abstract

Collaborative production control and distributor selection are essential for resource allocation and meeting the core of Industry 5.0’s human-centric vision. However, traditional approaches typically handle these decisions independently, failing to adequately address fluctuating market conditions, demand uncertainty, and varying distributor competencies. This paper integrates production control and distributor selection as a Partially Observable Markov Decision Process (POMDP) in a multi-agent system. Specifically, a production control agent optimizes outputs by balancing inventory levels and opportunity costs, while a distributor selection agent dynamically adjusts allocations considering workforce skill diversity, cost efficiency , and equity. The formulated POMDP is solved using a multi-agent reinforcement learning (MARL) framework featuring a differentiable communication layer and GRU-based recurrent neural networks . Numerical experiments conducted under both stable and highly volatile market conditions demonstrate the proposed system’s enhanced adaptability and responsiveness. In particular, inter-agent messaging communication leading to improved welfare metrics and robust performance under diverse distributor-weight configurations. Notably, the resulting system promotes equitable distributor involvement, aligning with Industry 5.0’s emphasis on sustainable, people-centric supply chain operations. • We formulate the collaborative production and distributor selection problem as a partially observable Markov decision process. • The uncertainties in demand, supply, and the stochastic capabilities of distributors are rigorously considered. • We proposed a reinforcement learning approach with a differentiable communication layer to facilitate inter-agent coordination. • Empirical results show improved efficiency, market responsiveness, and equal opportunities for distributors.

Expert Systems with ApplicationsVol. 282
Tongji University (CN), City University of Hong Kong (HK), Cosmos Corporation (United States) (US), Xi'an Jiaotong University (CN)
Openalex Percentile: Top 3%
Collaboration in agile enterprises
8.28
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.