Deep reinforcement learning and enhanced optimization for real-time energy management in wireless sensor networks

Abstract

Constraints are a major issue in radio-based communication in Wireless Sensor Networks, where each sensor node has a limited amount of power. Conventional clustering and optimization methods have been inappropriate for dynamic conditions which lead to timely energy drainage and reduce the network lifetime. In this research, the novel Deep Reinforcement Learning-Enhanced Hybrid African Vulture and Aquila Optimizer has been proposed that optimizes the dynamic clustering and energy-based parameters in real time. The proposed model is designed for optimizing the Wireless Sensor Networks, by including Deep Reinforcement Learning to adjust the dynamic formation of the base of the cluster on real-time data which leads to efficient energy utilization among all the sensor nodes. It combines the best properties of the Aquila and African Vulture Optimizer to optimize the network lifetime and energy consumption. The network lifetime, which is one of the most crucial characteristics, is optimized by using the global search algorithm of African Vulture Optimiser. In contrast, it is optimized by the localized search of Aquila optimizer to reduce energy consumption. The presented novel African Vulture and Aquila model outperforms the existing methods used convention-based optimization methods. It shows a 20 % improvement in energy efficiency and faster convergence with better robustness while keeping the network scalability. The proposed approach is perfectly suited for the scalable WSNs which are mainly used in the environment such as smart cities and IoT systems where a timely adaptation process is inevitable.