Research on Task Offloading and Delay Optimization of Autonomous Aerial Vehicle-Assisted Medical Edge Computing Based on Deep Reinforcement Learning

Integrating autonomous aerial vehicle (AAV) edge computing with medical systems enhances real-time data processing, but any significant delays could hinder timely medical responses. Additionally, there are technical challenges in optimizing task offloading within high-dimensional continuous action spaces. To address this issue, we propose the Dual Delayed Deep Deterministic Policy Gradient with Behavior Cloning and Softmax (TD3-BC-S) optimization algorithm based on Deep Reinforcement Learning (DRL), which designs optimal computation task offloading strategies within high-dimensional states and continuous action spaces. This algorithm utilizes a dual Q-network to minimize overestimation and combines behavior cloning for stable policy learning. Through extensive simulation results, we demonstrate the superior performance gain of the proposed TD3-BC-S algorithm compared with traditional algorithms in terms of significantly reducing offloading latency and enhancing computational efficiency, thereby improving the overall effectiveness and safety of medical services, particularly during public health emergencies.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Consumer Electronics
Published
2024-12-11
DOI
https://doi.org/10.1109/tce.2024.3513547
Citations
4
Primary Topic
Advanced Technologies in Various Fields
Type
article
Field-Weighted Citation Impact
1.39

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Task Offloading and Delay Optimization of Autonomous Aerial Vehicle-Assisted Medical Edge Computing Based on Deep Reinforcement Learning

Huitao Fan, Fazhan Tao, Gaoyuan Zhang, Shahid Mumtaz et al.
4 citations
IEEE Transactions on Consumer Electronics
Advanced Technologies in Various Fields
1.39
article

Research on Task Offloading and Delay Optimization of Autonomous Aerial Vehicle-Assisted Medical Edge Computing Based on Deep Reinforcement Learning

Huitao Fan, Fazhan Tao, Gaoyuan Zhang, Shahid Mumtaz, Nan Wang, Baofeng Ji, Ji Zhang, Liujiang Wang
article en
4 citations

Abstract

Integrating autonomous aerial vehicle (AAV) edge computing with medical systems enhances real-time data processing, but any significant delays could hinder timely medical responses. Additionally, there are technical challenges in optimizing task offloading within high-dimensional continuous action spaces. To address this issue, we propose the Dual Delayed Deep Deterministic Policy Gradient with Behavior Cloning and Softmax (TD3-BC-S) optimization algorithm based on Deep Reinforcement Learning (DRL), which designs optimal computation task offloading strategies within high-dimensional states and continuous action spaces. This algorithm utilizes a dual Q-network to minimize overestimation and combines behavior cloning for stable policy learning. Through extensive simulation results, we demonstrate the superior performance gain of the proposed TD3-BC-S algorithm compared with traditional algorithms in terms of significantly reducing offloading latency and enhancing computational efficiency, thereby improving the overall effectiveness and safety of medical services, particularly during public health emergencies.

IEEE Transactions on Consumer ElectronicsVol. 71(2)
Silesian University of Technology (PL), Henan University of Science and Technology (CN), Luoyang Institute of Science and Technology (CN)
National Natural Science Foundation of China, National Key Research and Development Program of China
Openalex Percentile: Top 15%
Advanced Technologies in Various Fields
1.39
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.