A Multi-Agent DRL Method for Distributed Energy-Efficient Association and Hybrid Precoding in mmWave Cell-Free Massive MIMO Systems

IF 3.7 3区计算机科学 Q2 TELECOMMUNICATIONS IEEE Communications Letters Pub Date : 2024-11-08 DOI:10.1109/LCOMM.2024.3494537

Huiting Li;Yanxiang Jiang;Yige Huang;Fu-Chun Zheng;Gang Wu

引用次数: 0

Abstract

In this letter, we investigate a distributed design integrating user-centric association with local sub-connected hybrid precoding in mmWave cell-free massive MIMO (CF-mMIMO) systems, aiming to maximize the long-term global energy efficiency (EE) under quality-of-service and power budget constraints. The joint optimization problem is formulated as a Markov Game problem and a novel weighted critic update multi-agent twin-delayed deep deterministic policy gradient (WCU-MATD3) algorithm is proposed to solve it, which promotes cooperation among access point agents and reduces power consumption in front-haul links. The results show that the proposed WCU-MATD3 algorithm significantly improves the global EE and the trade-off between spectral efficiency (SE) and EE, providing a practical and stable distributed collaboration framework for dynamic distributed environments.

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

毫米波无小区大规模MIMO系统中分布式节能关联和混合预编码的多智能体DRL方法

在本文中，我们研究了一种在毫米波无蜂窝大规模MIMO （CF-mMIMO）系统中集成以用户为中心的关联和本地子连接混合预编码的分布式设计，旨在最大限度地提高服务质量和功率预算约束下的长期全球能源效率（EE）。将联合优化问题表述为马尔可夫博弈问题，提出了一种新的加权评论更新多智能体双延迟深度确定性策略梯度（WCU-MATD3）算法来解决该问题，该算法促进了接入点智能体之间的合作，降低了前传链路的功耗。结果表明，所提出的WCU-MATD3算法显著提高了全局EE和频谱效率（SE）与EE之间的权衡，为动态分布式环境提供了一个实用稳定的分布式协作框架。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊

IEEE Communications Letters 工程技术-电信学

CiteScore

8.10

自引率

7.30%

发文量

590

审稿时长

2.8 months

期刊介绍： The IEEE Communications Letters publishes short papers in a rapid publication cycle on advances in the state-of-the-art of communication over different media and channels including wire, underground, waveguide, optical fiber, and storage channels. Both theoretical contributions (including new techniques, concepts, and analyses) and practical contributions (including system experiments and prototypes, and new applications) are encouraged. This journal focuses on the physical layer and the link layer of communication systems.

期刊最新文献

IEEE Communications Letters Publication Information IEEE Communications Letters Publication Information Few-Shot Specific Emitter Identification Based on a Contrastive Masked Learning Framework Cooperative Spectrum Sensing Using Weighted Graph Sparsity Low-Complexity Sparse Compensation MRC Detection Algorithm for OTSM Systems