Research on Task Offloading and Delay Optimization of Autonomous Aerial Vehicle-Assisted Medical Edge Computing Based on Deep Reinforcement Learning
Integrating autonomous aerial vehicle (AAV) edge computing with medical systems enhances real-time data processing, but any significant delays could hinder timely medical responses. Additionally, there are technical challenges in optimizing task offloading within high-dimensional continuous action spaces. To address this issue, we propose the Dual Delayed Deep Deterministic Policy Gradient with Behavior Cloning and Softmax (TD3-BC-S) optimization algorithm based on Deep Reinforcement Learning (DRL), which designs optimal computation task offloading strategies within high-dimensional states and continuous action spaces. This algorithm utilizes a dual Q-network to minimize overestimation and combines behavior cloning for stable policy learning. Through extensive simulation results, we demonstrate the superior performance gain of the proposed TD3-BC-S algorithm compared with traditional algorithms in terms of significantly reducing offloading latency and enhancing computational efficiency, thereby improving the overall effectiveness and safety of medical services, particularly during public health emergencies.
Authors
- Huitao Fan (ORCID: https://orcid.org/0000-0001-8250-3696)
- Fazhan Tao (ORCID: https://orcid.org/0000-0001-6721-5354)
- Gaoyuan Zhang
- Shahid Mumtaz (ORCID: https://orcid.org/0000-0001-6364-6149)
- Nan Wang (ORCID: https://orcid.org/0000-0002-1500-6726)
- Baofeng Ji (ORCID: https://orcid.org/0000-0002-5501-2303)
- Ji Zhang (ORCID: https://orcid.org/0000-0001-7642-7607)
- Liujiang Wang
Institutions
- Silesian University of Technology (PL)
- Henan University of Science and Technology (CN)
- Luoyang Institute of Science and Technology (CN)
Publication Details
- Journal
- IEEE Transactions on Consumer Electronics
- Published
- 2024-12-11
- DOI
- https://doi.org/10.1109/tce.2024.3513547
- Citations
- 4
- Primary Topic
- Advanced Technologies in Various Fields
- Type
- article
- Field-Weighted Citation Impact
- 1.39
Funders
- National Natural Science Foundation of China
- National Key Research and Development Program of China