Modification of Reward Function in Reinforcement Q-learning Agent to Improve Quality of Service in Federated Edge Cloud

This study proposed the modification of reward function based on logarithmic approach and reduction variable as well as introduces the additional variables which are MIPS (Million Instructions per Second) and RAM (Random Access Memory).The evaluation of several modification toward reward function used in Reinforcement Q-Learning in FEC (Federated Edge Cloud) has been conducted.The Quality of Services (QoS) evaluation using workload dataset from PlanetLab shows the proposed reward function based on Logarithmic MIPS or RAM with reduction parameter was able to improve the SLA (Service Level Agreement) Violation up to 10.6% followed by SLA-PDM (Performance Degradation due to Migration) up to 10%.Furthermore, energy efficiency was preserved, consistent with the previous study, which had already demonstrated efficient energy usage.Overall, it can be concluded that the proposed modification of reward function has more influence on improving QoS performance (SLA Violation and SLA-PDM) than reducing energy use in FEC environment.

Publication Details

Journal
International journal of intelligent engineering and systems
Published
2024-10-25
DOI
https://doi.org/10.22266/ijies2024.1231.83
Primary Topic
IoT and Edge/Fog Computing
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Modification of Reward Function in Reinforcement Q-learning Agent to Improve Quality of Service in Federated Edge Cloud

International journal of intelligent engineering and systems
IoT and Edge/Fog Computing
article

Modification of Reward Function in Reinforcement Q-learning Agent to Improve Quality of Service in Federated Edge Cloud

article en

Abstract

This study proposed the modification of reward function based on logarithmic approach and reduction variable as well as introduces the additional variables which are MIPS (Million Instructions per Second) and RAM (Random Access Memory).The evaluation of several modification toward reward function used in Reinforcement Q-Learning in FEC (Federated Edge Cloud) has been conducted.The Quality of Services (QoS) evaluation using workload dataset from PlanetLab shows the proposed reward function based on Logarithmic MIPS or RAM with reduction parameter was able to improve the SLA (Service Level Agreement) Violation up to 10.6% followed by SLA-PDM (Performance Degradation due to Migration) up to 10%.Furthermore, energy efficiency was preserved, consistent with the previous study, which had already demonstrated efficient energy usage.Overall, it can be concluded that the proposed modification of reward function has more influence on improving QoS performance (SLA Violation and SLA-PDM) than reducing energy use in FEC environment.

International journal of intelligent engineering and systemsVol. 17(6)
Kementerian Pendidikan, Kebudayaan, Riset, dan Teknologi
Openalex Percentile: Top 79%
IoT and Edge/Fog Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Modification of Reward Function in Reinforcement Q-learning Agent to Improve Quality of Service in Federated Edge Cloud · International journal of intelligent engineering and systems (2024) | TGRS Research Map | TGRS