Energy Efficient Uplink Communications for Wireless Powered Networks with EH Diversity: A DRL-Driven Strategy

With the increasing number of Internet-of-things (IoT) devices, the need for energy-efficient and spectrum-efficient networks that can support resource-constrained devices within existing wireless infrastructures becomes critical. This paper investigates the application of deep reinforcement learning (DRL) algorithms to optimize the energy efficiency (EE) of a secondary device (SD) equipped with radio frequency energy harvesting (RF-EH) antennas. The system models a wireless powered communication network (WPCN) where the SD employs a cognitive-radio non-orthogonal multiple access (CR-NOMA) scheme to transmit data during uplink communications of neighboring primary devices (PDs). Among the DRL approaches evaluated, proximal policy optimization (PPO) emerged as the most effective, achieving the highest EE values and demonstrating its suitability for this problem. Additionally, our results show that equal gain combining (EGC) consistently achieves superior EE compared to other diversity-combining techniques, making it a favorable choice for self-sustaining IoT networks. These findings provide valuable insights into the role of diversity-combining techniques and DRL algorithms in enhancing SD performance in dynamic EH environments.