Syed Asad Ullah;Aamir Mahmood;Ali Arshad Nasir;Mikael Gidlund;Syed Ali Hassan
{"title":"DRL-Driven Optimization of a Wireless Powered Symbiotic Radio With Nonlinear EH Model","authors":"Syed Asad Ullah;Aamir Mahmood;Ali Arshad Nasir;Mikael Gidlund;Syed Ali Hassan","doi":"10.1109/OJCOMS.2024.3447152","DOIUrl":null,"url":null,"abstract":"Given the rising demand for low-power sensing, integrating additional devices into an existing wireless infrastructure calls for innovative energy- and spectrum-efficient wireless connectivity strategies. In this respect, wireless-powered or energy-harvesting symbiotic radio (EHSR) is gaining attention for establishing the secondary relationship with the primary wireless systems in terms of RF EH and opportunistically sharing the spectrum or schedule. In this paper, assuming the commensalistic relationship with the primary system, we consider the energy-efficient optimization of such an EHSR by intelligently making EH and transmission decisions under the inherent nonlinearity of the EH circuitry and dynamics of pre-scheduled primary devices. We present a state-of-the-art deep reinforcement learning (DRL)-engineered, energy-efficient transmission strategy, which intelligently orchestrates EHSR’s uplink transmissions, leveraging the cognitive radio-inspired non-orthogonal multiple access (CR-NOMA) scheme. We first formulate the energy efficiency (EE) optimization metric for EHSR considering the nonlinear EH model, and then we decompose the inherently complex, non-convex problem into two optimization layers. The strategy first derives the optimal transmit power and time-sharing coefficient parameters, using convex optimization. Subsequently, these inferred parameters are substituted in the subsequent layer, where the optimization problem with continuous action space is addressed via a DRL framework, named modified deep deterministic policy gradient (MDDPG). Simulation results reveal that, compared to the baseline DDPG algorithm, our proposed solution provides a 6% EE gain with the linear EH model and approximately a 7% EE gain with the non-linear EH model.","PeriodicalId":33803,"journal":{"name":"IEEE Open Journal of the Communications Society","volume":null,"pages":null},"PeriodicalIF":6.3000,"publicationDate":"2024-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10643143","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Open Journal of the Communications Society","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10643143/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Given the rising demand for low-power sensing, integrating additional devices into an existing wireless infrastructure calls for innovative energy- and spectrum-efficient wireless connectivity strategies. In this respect, wireless-powered or energy-harvesting symbiotic radio (EHSR) is gaining attention for establishing the secondary relationship with the primary wireless systems in terms of RF EH and opportunistically sharing the spectrum or schedule. In this paper, assuming the commensalistic relationship with the primary system, we consider the energy-efficient optimization of such an EHSR by intelligently making EH and transmission decisions under the inherent nonlinearity of the EH circuitry and dynamics of pre-scheduled primary devices. We present a state-of-the-art deep reinforcement learning (DRL)-engineered, energy-efficient transmission strategy, which intelligently orchestrates EHSR’s uplink transmissions, leveraging the cognitive radio-inspired non-orthogonal multiple access (CR-NOMA) scheme. We first formulate the energy efficiency (EE) optimization metric for EHSR considering the nonlinear EH model, and then we decompose the inherently complex, non-convex problem into two optimization layers. The strategy first derives the optimal transmit power and time-sharing coefficient parameters, using convex optimization. Subsequently, these inferred parameters are substituted in the subsequent layer, where the optimization problem with continuous action space is addressed via a DRL framework, named modified deep deterministic policy gradient (MDDPG). Simulation results reveal that, compared to the baseline DDPG algorithm, our proposed solution provides a 6% EE gain with the linear EH model and approximately a 7% EE gain with the non-linear EH model.
期刊介绍:
The IEEE Open Journal of the Communications Society (OJ-COMS) is an open access, all-electronic journal that publishes original high-quality manuscripts on advances in the state of the art of telecommunications systems and networks. The papers in IEEE OJ-COMS are included in Scopus. Submissions reporting new theoretical findings (including novel methods, concepts, and studies) and practical contributions (including experiments and development of prototypes) are welcome. Additionally, survey and tutorial articles are considered. The IEEE OJCOMS received its debut impact factor of 7.9 according to the Journal Citation Reports (JCR) 2023.
The IEEE Open Journal of the Communications Society covers science, technology, applications and standards for information organization, collection and transfer using electronic, optical and wireless channels and networks. Some specific areas covered include:
Systems and network architecture, control and management
Protocols, software, and middleware
Quality of service, reliability, and security
Modulation, detection, coding, and signaling
Switching and routing
Mobile and portable communications
Terminals and other end-user devices
Networks for content distribution and distributed computing
Communications-based distributed resources control.