Gymnasium Library Interface for Multi Access Edge Computing

This paper addresses the problem of developing reinforcement learning algorithms for capsule placement decision making tasks in a geo-distributed Multi Access Edge Computing environment. A Python library called gym-Iwmecps has been developed to speed up and simplify the process of developing machine learning algorithms with reinforcement learning for decision-making system tasks in MEC networks. At the same time, the Gymnasium Capability API has not been used previously in the tasks of organizing and testing MEC platforms. We also tested basic algorithms Q-network and DQN in conjunction with gym-lwmecps and proved the performance of the developed Python library.

Authors

Institutions

Publication Details

Published
2024-11-13
DOI
https://doi.org/10.1109/summa64428.2024.10803891
Citations
1
Primary Topic
Multimedia Communication and Technology
Type
article
Field-Weighted Citation Impact
1.13
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Gymnasium Library Interface for Multi Access Edge Computing

Aleksandr Kapitonov, Ivan Filianin, Artem Timoshchuk-Bondar
1 citations
Multimedia Communication and Technology
1.13
article

Gymnasium Library Interface for Multi Access Edge Computing

Aleksandr Kapitonov, Ivan Filianin, Artem Timoshchuk-Bondar
article en
1 citations

Abstract

This paper addresses the problem of developing reinforcement learning algorithms for capsule placement decision making tasks in a geo-distributed Multi Access Edge Computing environment. A Python library called gym-Iwmecps has been developed to speed up and simplify the process of developing machine learning algorithms with reinforcement learning for decision-making system tasks in MEC networks. At the same time, the Gymnasium Capability API has not been used previously in the tasks of organizing and testing MEC platforms. We also tested basic algorithms Q-network and DQN in conjunction with gym-lwmecps and proved the performance of the developed Python library.

ITMO University (RU)
Openalex Percentile: Top 14%
Multimedia Communication and Technology
1.13
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.