Application of SARSA-Based Reinforcement Learning Approach for Resource Allocation in Vehicular Edge Computing

Vehicular Edge Computing (VEC) holds significant promise for enhancing the performance and resource utilization of Internet of Vehicles (loV) applications. However, the dynamic nature of vehicular networks, characterized by high mobility and limited capabilities of VEC servers, poses significant challenges for resource allocation. This paper proposes a Reinforcement Learning (RL) based approach, employing the SARSA algorithm, to learn optimal resource allocation strategies in Multi-access Edge Computing (MEC) environments designed for vehicular networks. Our strategy aims to minimize service delays and balance resource utilization effectively by dynamically deciding whether to offload tasks to edge servers or cloud servers. We evaluate the proposed approach using the EdgeCloudSim simulator, comparing its performance against conventional static and heuristic resource allocation methods. Simulation results, considering various parameters and application characteristics, demonstrate the superior efficiency of our SARSA-based resource allocation solution for VEC compared to traditional methods, in terms of overall service time and resource utilization.

Authors

Institutions

Publication Details

Published
2024-10-17
DOI
https://doi.org/10.1109/icoa62581.2024.10754501
Citations
1
Primary Topic
IoT and Edge/Fog Computing
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Application of SARSA-Based Reinforcement Learning Approach for Resource Allocation in Vehicular Edge Computing

Abderrazak Farchane, Anouar Darif, Marouane Myyara
1 citations
IoT and Edge/Fog Computing
0.35
article

Application of SARSA-Based Reinforcement Learning Approach for Resource Allocation in Vehicular Edge Computing

Abderrazak Farchane, Anouar Darif, Marouane Myyara
article en
1 citations

Abstract

Vehicular Edge Computing (VEC) holds significant promise for enhancing the performance and resource utilization of Internet of Vehicles (loV) applications. However, the dynamic nature of vehicular networks, characterized by high mobility and limited capabilities of VEC servers, poses significant challenges for resource allocation. This paper proposes a Reinforcement Learning (RL) based approach, employing the SARSA algorithm, to learn optimal resource allocation strategies in Multi-access Edge Computing (MEC) environments designed for vehicular networks. Our strategy aims to minimize service delays and balance resource utilization effectively by dynamically deciding whether to offload tasks to edge servers or cloud servers. We evaluate the proposed approach using the EdgeCloudSim simulator, comparing its performance against conventional static and heuristic resource allocation methods. Simulation results, considering various parameters and application characteristics, demonstrate the superior efficiency of our SARSA-based resource allocation solution for VEC compared to traditional methods, in terms of overall service time and resource utilization.

Université Sultan Moulay Slimane (MA)
Openalex Percentile: Top 36%
IoT and Edge/Fog Computing
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.