Fusion of self-attention mechanism for CSI feedback in massive MIMO systems

IF 4.2 3区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS ICT Express Pub Date : 2025-02-01 Epub Date: 2024-11-28 DOI:10.1016/j.icte.2024.10.010
Tingting Zhang , Youyun Xu , Changpeng Zhou
{"title":"Fusion of self-attention mechanism for CSI feedback in massive MIMO systems","authors":"Tingting Zhang ,&nbsp;Youyun Xu ,&nbsp;Changpeng Zhou","doi":"10.1016/j.icte.2024.10.010","DOIUrl":null,"url":null,"abstract":"<div><div>In massive MIMO systems, obtaining accurate channel state information (CSI) is crucial for optimal channel coding and beamforming. However, traditional CSI feedback methods require high bandwidth and also consume a large amount of power and computing resources. To address these challenges, several compressed sensing-based techniques have been implemented in recent years. These techniques, however, are often iterative and computationally complex to implement in power-constrained user equipment. In this paper, we propose a novel fusion of the self-attention mechanism, called <em>FSAMNet</em>, to efficiently and accurately implement the CSI feedback task for massive MIMO systems. Our proposed FSAMNet adopts both the residual connections in the attention mechanism and a sequence of depth-separable convolutional layers to enhance the model’s performance and expressive ability. Specifically, we apply a multi-layer self-attention mechanism in the encoder part to achieve feature extraction and compression. In the decoder part, we use multiple convolutional layers and self-attention mechanisms to convert the embedding vector generated by the encoder back into the original image. Experimental results show that the performance of our proposed FSAMNet outperforms conventional benchmark schemes in terms of feedback network performance.</div></div>","PeriodicalId":48526,"journal":{"name":"ICT Express","volume":"11 1","pages":"Pages 124-128"},"PeriodicalIF":4.2000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ICT Express","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2405959524001334","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/11/28 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

In massive MIMO systems, obtaining accurate channel state information (CSI) is crucial for optimal channel coding and beamforming. However, traditional CSI feedback methods require high bandwidth and also consume a large amount of power and computing resources. To address these challenges, several compressed sensing-based techniques have been implemented in recent years. These techniques, however, are often iterative and computationally complex to implement in power-constrained user equipment. In this paper, we propose a novel fusion of the self-attention mechanism, called FSAMNet, to efficiently and accurately implement the CSI feedback task for massive MIMO systems. Our proposed FSAMNet adopts both the residual connections in the attention mechanism and a sequence of depth-separable convolutional layers to enhance the model’s performance and expressive ability. Specifically, we apply a multi-layer self-attention mechanism in the encoder part to achieve feature extraction and compression. In the decoder part, we use multiple convolutional layers and self-attention mechanisms to convert the embedding vector generated by the encoder back into the original image. Experimental results show that the performance of our proposed FSAMNet outperforms conventional benchmark schemes in terms of feedback network performance.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
大规模MIMO系统中CSI反馈自注意机制的融合
在大规模MIMO系统中,获取准确的信道状态信息是优化信道编码和波束形成的关键。然而,传统的CSI反馈方法需要高带宽,并且消耗大量的功率和计算资源。为了应对这些挑战,近年来已经实施了几种基于压缩感知的技术。然而,这些技术通常是迭代的,并且在功率受限的用户设备中实现计算复杂。在本文中,我们提出了一种新的自关注融合机制,称为FSAMNet,以有效和准确地实现大规模MIMO系统的CSI反馈任务。我们提出的FSAMNet采用了注意机制中的残差连接和深度可分离的卷积层序列来提高模型的性能和表达能力。具体来说,我们在编码器部分采用了多层自关注机制来实现特征提取和压缩。在解码器部分,我们使用多个卷积层和自关注机制将编码器生成的嵌入向量转换回原始图像。实验结果表明,我们提出的FSAMNet在反馈网络性能方面优于传统的基准方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
ICT Express
ICT Express Multiple-
CiteScore
10.20
自引率
1.90%
发文量
167
审稿时长
35 weeks
期刊介绍: The ICT Express journal published by the Korean Institute of Communications and Information Sciences (KICS) is an international, peer-reviewed research publication covering all aspects of information and communication technology. The journal aims to publish research that helps advance the theoretical and practical understanding of ICT convergence, platform technologies, communication networks, and device technologies. The technology advancement in information and communication technology (ICT) sector enables portable devices to be always connected while supporting high data rate, resulting in the recent popularity of smartphones that have a considerable impact in economic and social development.
期刊最新文献
Performance evaluation and optimization for 6G networks: A survey of KPIs, Tools, and AI models AI-enhanced Digital Twin systems for warehouse logistics optimization: A review of challenges with solutions and future directions Activity recognition and user identification using mmWave radar with a shared-backbone graph network and task-specific heads Semantic-aware communication and computation co-optimization in digital twin-assisted Internet of Drones networks using federated deep reinforcement learning Gated side adapters with memory-efficient fine tuning for RGB-T tracking
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1