Factorized coordinated double deep Q-learning for multi-user computation offloading and resource allocation in mobile edge computing
Efficient computation offloading in Multi Access edge-computing (MEC) requires joint decisions on whether tasks should be processed locally or remotely and how limited edge-computing resources should be allocated among simultaneously active users. Such coupling produces a challenging sequential decision problem because independently selected offloading actions may generate competing resource requests under a shared MEC capacity. This work proposes Factorized Coordinated Double Deep Q-Learning (FC-DDQN), a value-based multi-agent framework that separates the binary local/offloading decision from the discrete MEC CPU request decision using dedicated value heads. A lightweight MEC-side coordination mechanism ranks simultaneous offloading proposals according to their learned Q-value advantage and admits resource requests subject to the shared server-capacity constraint. Importantly, coordinated actions are applied during policy learning, ensuring consistency between the behavior executed in the environment and the transitions stored for training. The proposed approach is evaluated using independently trained models, validation based checkpoint selection, and held-out test scenarios. Across ten training seeds, FC-DDQN achieves a mean normalized constraint-aware system objective of 0.02005 with low inter-seed dispersion and zero mean MEC overload. Relative to conventional DDQN, the proposed architecture reduces the mean system objective by approximately 25%, while also reducing queue backlog and maintaining low deadline-violation rates. FC-DDQN approaches the performance of a strong Weighted Earliest Deadline First scheduler under the nominal configuration, with an objective gap of approximately 4%, while a model-based myopic controller remains the strongest reference when explicit analytical system knowledge is available. Ablation experiments show that training-time coordination and factorization of the offloading and CPU allocation decisions are responsible for most of the observed performance improvement. These findings indicate that explicit coordination and structured action representations can substantially improve value based multi-agent reinforcement learning for constrained MEC resource management, while also clarifying the operating regimes in which model-based scheduling remains advantageous.
Authors
- Hicham Zougagh (ORCID: https://orcid.org/0000-0002-3810-6893)
- Mohamed Amine Meddaoui (ORCID: https://orcid.org/0000-0001-8068-9001)
- Driss Ait Omar (ORCID: https://orcid.org/0000-0002-4096-8273)
- Moulay Amzil
- Youssef Oukissou
- Aziz OUYIDIR
Institutions
- Université Sultan Moulay Slimane (MA)
Publication Details
- Journal
- Scientific Reports
- Published
- 2026-11-18
- DOI
- https://doi.org/10.1038/s41598-026-75235-3
- Primary Topic
- IoT and Edge/Fog Computing
- Type
- article
- Field-Weighted Citation Impact
- 0.00