Sohail Ahmad, Saud Khan, Komal S. Khan, Faisal Naeem, Muhammad Tariq
{"title":"Resource Allocation for IRS-Assisted Networks: A Deep Reinforcement Learning Approach","authors":"Sohail Ahmad, Saud Khan, Komal S. Khan, Faisal Naeem, Muhammad Tariq","doi":"10.1109/mcomstd.0002.2200007","DOIUrl":null,"url":null,"abstract":"In a wireless communication network, the propagation medium has been perceived as a randomly behaving entity between the transmitter and receiver for a long time. However future wireless networks, such as 5G and beyond, rely on Intelligent Reflecting Surfaces (IRS) for promising energy efficiency and spectrum improvement as it enables the proactive control of the wireless channel. In this article, we take a step further and discuss the role of Deep Reinforcement Learning (DRL)-based IRS-assisted network in delivering performance enhancement in a wireless communication network. We provide an insight into DRL followed by the challenges in place for an IRS-assisted wireless network. We then lay out a case study to show the channel processing using two state-of-the-art DRL algorithms, that is, deep Q-network (DQN) and deep deterministic policy gradient (DDPG), in an IRS-assisted network and work on jointly optimizing the transmit beamforming and the IRS phase angles for sum-rate maximization. The sum-rate improvement is shown in reference to the number of reflecting IRS elements. Opportunities in DRL-based IRS-assisted wireless networks are then discussed to showcase the exciting future opportunities in this domain.","PeriodicalId":36719,"journal":{"name":"IEEE Communications Standards Magazine","volume":"32 3 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Communications Standards Magazine","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/mcomstd.0002.2200007","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Social Sciences","Score":null,"Total":0}
引用次数: 0
Abstract
In a wireless communication network, the propagation medium has been perceived as a randomly behaving entity between the transmitter and receiver for a long time. However future wireless networks, such as 5G and beyond, rely on Intelligent Reflecting Surfaces (IRS) for promising energy efficiency and spectrum improvement as it enables the proactive control of the wireless channel. In this article, we take a step further and discuss the role of Deep Reinforcement Learning (DRL)-based IRS-assisted network in delivering performance enhancement in a wireless communication network. We provide an insight into DRL followed by the challenges in place for an IRS-assisted wireless network. We then lay out a case study to show the channel processing using two state-of-the-art DRL algorithms, that is, deep Q-network (DQN) and deep deterministic policy gradient (DDPG), in an IRS-assisted network and work on jointly optimizing the transmit beamforming and the IRS phase angles for sum-rate maximization. The sum-rate improvement is shown in reference to the number of reflecting IRS elements. Opportunities in DRL-based IRS-assisted wireless networks are then discussed to showcase the exciting future opportunities in this domain.