PDCF-DRL: a contention window backoff scheme based on deep reinforcement learning for differentiating access categories

Abstract In wireless networks, the Contention Window (CW) is a crucial parameter for wireless channel sharing among numerous stations, directly influencing overall network performance. With the rapid growth and increasing diversity of traffic in wireless networks, differentiating and serving various types of traffic to enhance network performance has become a pressing issue that needs to be addressed. Deep Reinforcement Learning (DRL) optimizes decision-making through the interaction between an agent and its environment, enabling it to handle complex state spaces and high-dimensional data, making it particularly suitable for dynamically adjusting the contention window and adapting to environmental changes in real time. Access Category (AC) is used to differentiate various types of traffic to support different quality of service (QoS) requirements. Therefore, this paper proposes the integration of DRL techniques into the EDCA mechanism, utilizing AC to differentiate network traffic, while the DRL technology adjusts the contention window to adequately ensure QoS for different types of traffic and enhance overall network performance. This paper proposes a CW back off scheme based on DRL for differentiating ACs. The scheme uses DRL technology to observe the channel collision rate and sense the current network conditions, thereby adaptively adjusting the CW size for ACs. In addition, it dynamically adjusts the back off strategy according to the perceived current network conditions to optimize the data transmission process. In the range of 20–120 stations, the scheme was tested in both single AC and multiple AC traffic scenarios, demonstrating excellent performance. The collision rate consistently remained below 18%, while the normalized throughput was maintained above 76%. Additionally, there is a significant improvement compared to existing deep reinforcement learning-based optimization schemes. Experimental results show that this scheme effectively discriminates between different ACs, resulting in lower latency and higher throughput for high-priority traffic. Furthermore, adaptively adjusting the CW size and improving the back off strategy maintains a low collision rate and stable throughput even under heavy load conditions, significantly improving the overall network performance.