Hybrid Energy-Efficient Clustering With Reinforcement Learning for IoT-WSNs Using Knapsack and K -Means

Wireless Sensor Networks (WSNs) play a fundamental role in the Internet of Things (IoT), with widespread applications in areas such as smart city infrastructure, industrial control systems, and environmental monitoring. Despite their broad utility, challenges related to energy efficiency and network longevity persist. To address these issues, this paper introduces an integrated framework that leverages Distributed Energy-Efficient Clustering (DEEC), the Energy Efficient Knapsack Algorithm (EEKA), K-Means clustering, and Reinforcement Learning (RL) to optimize energy usage and improve overall network performance. While cluster-head (CHs) selection is conducted in a balanced manner by DEEC to prevent energy depletion, the selection of sensor node cluster-heads also avoids exhausting sensor node energy. EEKA optimizes task allocation under energy constraints, allowing for efficient distribution of tasks based on available energy levels. This approach conserves more energy spent on data transmission compared to other techniques, as K-Means clustering minimizes intracluster communication overhead. Moreover, during varying conditions such as cluster sizes or transmission power, parameters related to the network can be adaptively tuned in real-time by Reinforcement Learning, enhancing stability and performance. Simulation results demonstrate a significant improvement in energy efficiency with this hybrid model compared to traditional approaches under similar conditions. Therefore, for sustainable energy management within IoT-enabled WSNs, the DEEC-EEKA-K-Means-RL framework offers a robust adaptive method for efficient resource utilization across diverse operational contexts, rather than relying solely on robustness and resilience-based solutions.