Intelligence-Based Reinforcement Learning for Dynamic Resource Optimization in Edge Computing-Enabled Vehicular Networks
Intelligent transportation systems demand efficient resource allocation and task offloading to ensure low-latency, high-bandwidth vehicular services. The dynamic nature of vehicular environments, characterized by high mobility and extensive interactions among vehicles, necessitates considering time-varying statistical regularities, especially in scenarios with sharp variations. Despite the widespread use of traditional reinforcement learning for resource allocation, its limitations in generalization and interpretability are evident. To overcome these challenges, we propose an Intelligence-based Reinforcement Learning (IRL) algorithm. This algorithm utilizes active inference to infer the real world and maintain an internal model by minimizing free energy. Enhancing the efficiency of active inference, we incorporate prior knowledge as macro guidance, ensuring more accurate and efficient training. By constructing an intelligence-based model, we eliminate the need for designing reward functions, aligning better with human thinking, and providing a method to reflect the learning, information transmission and intelligence accumulation processes. This approach also allows for quantifying intelligence to a certain extent. Considering the dynamic and uncertain nature of vehicular scenarios, we apply the IRL algorithm to environments with constantly changing parameters. Extensive simulations confirm the effectiveness of IRL, significantly improving the generalization and interpretability of intelligent models in vehicular networks.
Authors
- Kaishun Wu (ORCID: https://orcid.org/0000-0003-2216-0737)
- Yuhang Wang (ORCID: https://orcid.org/0000-0002-0873-2295)
- Shanzhi Chen (ORCID: https://orcid.org/0000-0002-5409-8168)
- F. Richard Yu (ORCID: https://orcid.org/0000-0003-1006-7594)
- Ying He (ORCID: https://orcid.org/0000-0003-1733-9791)
Institutions
- China Mobile (China) (CN)
- Shenzhen University (CN)
- State Key Laboratory of Wireless Mobile Communications
- University of Hong Kong (HK)
Publication Details
- Journal
- IEEE Transactions on Mobile Computing
- Published
- 2024-11-25
- DOI
- https://doi.org/10.1109/tmc.2024.3506161
- Citations
- 2
- Primary Topic
- IoT and Edge/Fog Computing
- Type
- article
- Field-Weighted Citation Impact
- 0.70