Improving performance of WSNs in IoT applications by transmission power control and adaptive learning rates in reinforcement learning

Abstract

The paper investigates the effect of controlling the transmission power used for communication of data packets at physical layer to prolong longevity of network and adaptive learning rates in a reinforcement-learning algorithm working at network layer for dynamic and quick decision making. A routing protocol is proposed for data communication, which works in tandem with physical layer, to improve performance of Wireless Sensor Networks used in IoT applications. The proposed methodology employs Q-learning, a form of reinforcement learning algorithm at network layer. Here, an agent at each sensor node employs the Q-learning algorithm to decide on an agent which is to be used as packet forwarder and also helps in mitigating energy-hole problem. On the other hand, the transmission power control method saves agents’ battery energy by determining the appropriate power level to be used for packet transmission, and also achieving reduction in overhearing among neighboring agents. An agent derives its learning rate from its environment comprising of its neighboring agents. Each agents determines its own learning rate by using the hop distance to sink, and the residual energy (RE) of neighboring agents. The proposed method uses a higher learning rate at first, which is gradually decreased with the reduction in energy levels of agents over time. The proposed protocol is simulated to work in high-traffic scenarios with multiple source-sink pairs, which is a common feature of IoT applications in the monitoring and surveillance domain. Based on the NS3 simulation results, the proposed strategy significantly improved network performance in comparison with other routing protocols using Q-learning.