Energy optimized scheduling in wireless sensor networks (WSNs) using hybrid bio-inspired reinforcement learning approach

There has been huge positive changes in smart infrastructure management due to the creation of systems that perform real time environmental tracking, and process cyber-physical data. These changes are apparent due to the combination of Wireless Sensor Networks (WSNs) with Internet of Things (IoT). Large WSN deployments face obstacles in scheduling, due to restricted energy supplies and operational environments being too hostile or inaccessible. Genetic Algorithms like Simulated Annealing and Artificial Bee Colony tends to perform in suboptimal standards as these algorithms fail to adapt well to environments that have energy depletion along with changing topologies. Hence, a new method for WSN scheduling known as RL-HAPSO, that utilizes Ant Colony Optimization (ACO) and the Particle Swarm Optimization (PSO) algorithms along with the adaptive capability of Q-learning Reinforcement Learning has been addressed in this paper. An energy-efficient node selection by ACO operates during the first phase, followed by PSO optimization, which improves coverage and minimizes redundancy before execution of real-time reinforcement learning algorithm that selects activation schedules based on network states. The model runs multiple simulations, and does performance validation by assessing its execution time and convergence cost along with energy utilization, which is compared to each algorithm independently and the also the hybrid model without RL implementation. Results indicate execution in microseconds interval by each algorithm, yet RL-HAPSO stands out, as it achieves better optimization costs through enhanced fault tolerance, coverage and minimal energy usage. During performance alterations the system automatically adjusts its operations leading to consistent robust behaviour, even in case of node failure and environmental variations. The obtained results indicate that this proposed methodology functions as a viable approach for future-generation IoT applications that support resource-aware and smart WSN scheduling.