A Multi-Agent DRL-Based Computation Offloading and Resource Allocation Method With Attention Mechanism in MEC-Enabled IIoT
The widespread adoption of Industrial Internet of Things (IIoT) has significantly transformed various aspects of industrial manufacturing. However, the massive volume and complexity of IIoT data highlight the need for innovative solutions to enhance the overall performance of IIoT systems. In this regard, mobile edge computing, assisted by deep reinforcement learning, can alleviate the burden on IIoT systems through computation offloading. Nevertheless, in increasingly digitized industrial environments, how to make real-time, efficient task offloading decisions remains a subject of deep exploration. To address this issue, we propose a two-stage resource allocation and task offloading method, named MCORM. In the first stage, we use the Combinatorial Upper Confidence Bound algorithm, based on the combinatorial multi-armed bandit problem, to solve the resource allocation problem. In the second stage, the Multi-Agent Proximal Policy Optimization algorithm is employed to determine the approximate optimal offloading strategy. Specifically, the Convolutional Block Attention Module is utilized to process observation information, focusing on important features. Finally, extensive experiments are conducted using both simulated and real datasets. The results demonstrate that our proposed algorithm MCORM can reduce latency and energy consumption effectively, promoting efficient industrial production.
Authors
- Xiaolong Xu (ORCID: https://orcid.org/0000-0003-4879-9803)
- Victor C. M. Leung (ORCID: https://orcid.org/0000-0003-3529-2640)
- Chengfang Ling (ORCID: https://orcid.org/0009-0009-0074-3369)
- Shangguang Wang (ORCID: https://orcid.org/0000-0001-7245-1298)
- Kai Peng (ORCID: https://orcid.org/0000-0003-4809-2234)
Institutions
- Huaqiao University (CN)
- Beijing University of Posts and Telecommunications (CN)
- Shenzhen University (CN)
- Nanjing University of Information Science and Technology (CN)
Publication Details
- Journal
- IEEE Transactions on Services Computing
- Published
- 2024-09-26
- DOI
- https://doi.org/10.1109/tsc.2024.3466852
- Citations
- 21
- Primary Topic
- IoT and Edge/Fog Computing
- Type
- article
- Field-Weighted Citation Impact
- 7.33
Funders
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Fundamental Research Funds for the Central Universities
- Quanzhou City Science and Technology Program