Multi‐station multi‐robot task assignment method based on deep reinforcement learning

Abstract This paper focuses on the problem of multi‐station multi‐robot spot welding task assignment, and proposes a deep reinforcement learning (DRL) framework, which is made up of a public graph attention network and independent policy networks. The graph of welding spots distribution is encoded using the graph attention network. Independent policy networks with attention mechanism as a decoder can handle the encoded graph and decide to assign robots to different tasks. The policy network is used to convert the large scale welding spots allocation problem to multiple small scale single‐robot welding path planning problems, and the path planning problem is quickly solved through existing methods. Then, the model is trained through reinforcement learning. In addition, the task balancing method is used to allocate tasks to multiple stations. The proposed algorithm is compared with classical algorithms, and the results show that the algorithm based on DRL can produce higher quality solutions.

Authors

Institutions

Publication Details

Journal
CAAI Transactions on Intelligence Technology
Published
2024-11-07
DOI
https://doi.org/10.1049/cit2.12394
Citations
9
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
3.13

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi‐station multi‐robot task assignment method based on deep reinforcement learning

Ke Wang, Chaoxu Mu, Junnan Zhang
9 citations
CAAI Transactions on Intelligence Technology
Reinforcement Learning in Robotics
3.13
article

Multi‐station multi‐robot task assignment method based on deep reinforcement learning

Ke Wang, Chaoxu Mu, Junnan Zhang
article en
9 citations

Abstract

Abstract This paper focuses on the problem of multi‐station multi‐robot spot welding task assignment, and proposes a deep reinforcement learning (DRL) framework, which is made up of a public graph attention network and independent policy networks. The graph of welding spots distribution is encoded using the graph attention network. Independent policy networks with attention mechanism as a decoder can handle the encoded graph and decide to assign robots to different tasks. The policy network is used to convert the large scale welding spots allocation problem to multiple small scale single‐robot welding path planning problems, and the path planning problem is quickly solved through existing methods. Then, the model is trained through reinforcement learning. In addition, the task balancing method is used to allocate tasks to multiple stations. The proposed algorithm is compared with classical algorithms, and the results show that the algorithm based on DRL can produce higher quality solutions.

CAAI Transactions on Intelligence TechnologyVol. 10(1)
Tianjin University (CN)
China Postdoctoral Science Foundation, Postdoctoral Research Foundation of China, National Key Research and Development Program of China
Openalex Percentile: Top 7%
Reinforcement Learning in Robotics
3.13
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.