Model-Based Q-Learning for Dynamic Cache Allocation in Multi-Tenant Edge Computing

In multi-tenant edge computing, several Service Providers (SPs) share a limited cache. Because the traffic demand of each SP changes over time, a fixed cache partition can leave space unused for one SP while another SP suffers cache misses and longer response delay. This paper proposes a dynamic cache allocation framework that monitors the traffic demand and cache usage of every SP and moves unused cache space to the SPs that need it. Allocation decisions are supported by model-based reinforcement learning (MB-RL) built on Q-learning. A regression model estimates cost or performance from system conditions, experience replay reuses past experiences during learning, and an epsilon-greedy policy balances trying new actions with choosing learned ones. Every candidate action is checked against two hard rules before it is applied: the total allocation must not exceed the cache capacity, and every SP must keep a minimum cache share. Fair sharing is therefore enforced by construction rather than left to the learning signal. The paper presents the system architecture, the allocation procedure, a worked example with a 100 GB cache, and a planned evaluation based on cache utilization, response delay, cache hit ratio, and fairness. The framework is expected to improve cache usage, reduce unnecessary cache misses and response delay, and support fair sharing among tenants compared with fixed allocation.

Authors

Institutions

Publication Details

Journal
International Research Journal on Advanced Engineering Hub (IRJAEH)
Published
2026-11-05
DOI
https://doi.org/10.47392/irjaeh.2026.0743
Primary Topic
Caching and Content Delivery
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Model-Based Q-Learning for Dynamic Cache Allocation in Multi-Tenant Edge Computing

Surbhi Kumari, Safrin Suhaina A, Pooranakalai S, Ms. R. Punithagowri
International Research Journal on Advanced Engineering Hub (IRJAEH)
Caching and Content Delivery
article

Model-Based Q-Learning for Dynamic Cache Allocation in Multi-Tenant Edge Computing

Surbhi Kumari, Safrin Suhaina A, Pooranakalai S, Ms. R. Punithagowri
article en

Abstract

In multi-tenant edge computing, several Service Providers (SPs) share a limited cache. Because the traffic demand of each SP changes over time, a fixed cache partition can leave space unused for one SP while another SP suffers cache misses and longer response delay. This paper proposes a dynamic cache allocation framework that monitors the traffic demand and cache usage of every SP and moves unused cache space to the SPs that need it. Allocation decisions are supported by model-based reinforcement learning (MB-RL) built on Q-learning. A regression model estimates cost or performance from system conditions, experience replay reuses past experiences during learning, and an epsilon-greedy policy balances trying new actions with choosing learned ones. Every candidate action is checked against two hard rules before it is applied: the total allocation must not exceed the cache capacity, and every SP must keep a minimum cache share. Fair sharing is therefore enforced by construction rather than left to the learning signal. The paper presents the system architecture, the allocation procedure, a worked example with a 100 GB cache, and a planned evaluation based on cache utilization, response delay, cache hit ratio, and fairness. The framework is expected to improve cache usage, reduce unnecessary cache misses and response delay, and support fair sharing among tenants compared with fixed allocation.

International Research Journal on Advanced Engineering Hub (IRJAEH)Vol. 4(10)
Sengunthar Engineering College (Autonomous) (IN)
Openalex Percentile: Top 14%
Caching and Content Delivery
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
Model-Based Q-Learning for Dynamic Cache Allocation in Multi-Tenant Edge Computing — Surbhi Kumari, Safrin Suhaina A, et al. · International Research Journal on Advanced Engineering Hub (IRJAEH) (2026) | TGRS Research Map | TGRS