Learning Resilient Distributed Channel Access Policies in V2I Networks Under Intelligent Jamming

While the Internet of Vehicles (IoV) can revolutionize transportation systems through intelligent connectivity, a critical challenge in realizing this potential lies in ensuring efficient channel allocation in the IoV ecosystem, particularly considering dynamic channel conditions and adversarial jamming exacerbated by the emergence of artificial intelligence (AI)-based jamming. To address these challenges, in this study, we use distributed edge intelligence (DEI) to propose a distributed channel access mechanism for the vehicle-to-infrastructure (V2I) mode of IoV networks. Specifically, using an actor-critic-based multiagent reinforcement learning (MARL) framework with a common critic, we model the distributed channel access problem in V2I communications under varying channel conditions and an intelligent jamming device <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$(\tt {iJD})$ </tex-math></inline-formula> interference as a decentralized partially observable stochastic game (Dec-POSG). Furthermore, by addressing challenges, such as partial observations, nonstationarity, and credit assignment, our proposed approach fosters collaboration among intelligent vehicles (<inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\tt {iV}$ </tex-math></inline-formula>s) without direct communication. In addition, our unique counterfactual reasoning-aided action evaluation mechanism and a novel utility function design enable the <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\tt {iV}$ </tex-math></inline-formula>s to learn mixed collaborative-competitive channel access policies, thereby enhancing channel utilization, mitigating the impact of the <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\tt {iJD}$ </tex-math></inline-formula>, and improving the network’s sum cross-layer achievable rate (SCLAR).