Ke Zhao, Zhiqun Song, Yong Li, Xingjian Li, Lizhe Liu, Bin Wang
{"title":"A Deep Evolution Policy-Based Approach for RIS-Enhanced Communication System.","authors":"Ke Zhao, Zhiqun Song, Yong Li, Xingjian Li, Lizhe Liu, Bin Wang","doi":"10.3390/e26121056","DOIUrl":null,"url":null,"abstract":"<p><p>This paper investigates the design of active and passive beamforming in a reconfigurable intelligent surface (RIS)-aided multi-user multiple-input single-output (MU-MISO) system with the objective of maximizing the sum rate. We propose a deep evolution policy (DEP)-based algorithm to derive the optimal beamforming strategy by generating multiple agents, each utilizing distinct deep neural networks (DNNs). Additionally, a random subspace selection (RSS) strategy is incorporated to effectively balance exploitation and exploration. The proposed DEP-based algorithm operates without the need for alternating iterations, gradient descent, or backpropagation, enabling simultaneous optimization of both active and passive beamforming. Simulation results indicate that the proposed algorithm can bring significant performance enhancements.</p>","PeriodicalId":11694,"journal":{"name":"Entropy","volume":"26 12","pages":""},"PeriodicalIF":2.1000,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11675288/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Entropy","FirstCategoryId":"101","ListUrlMain":"https://doi.org/10.3390/e26121056","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PHYSICS, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
This paper investigates the design of active and passive beamforming in a reconfigurable intelligent surface (RIS)-aided multi-user multiple-input single-output (MU-MISO) system with the objective of maximizing the sum rate. We propose a deep evolution policy (DEP)-based algorithm to derive the optimal beamforming strategy by generating multiple agents, each utilizing distinct deep neural networks (DNNs). Additionally, a random subspace selection (RSS) strategy is incorporated to effectively balance exploitation and exploration. The proposed DEP-based algorithm operates without the need for alternating iterations, gradient descent, or backpropagation, enabling simultaneous optimization of both active and passive beamforming. Simulation results indicate that the proposed algorithm can bring significant performance enhancements.
期刊介绍:
Entropy (ISSN 1099-4300), an international and interdisciplinary journal of entropy and information studies, publishes reviews, regular research papers and short notes. Our aim is to encourage scientists to publish as much as possible their theoretical and experimental details. There is no restriction on the length of the papers. If there are computation and the experiment, the details must be provided so that the results can be reproduced.