基于张量环分解的低复杂度神经信念传播解码算法

IF 7 1区 计算机科学 Q1 TELECOMMUNICATIONS IEEE Transactions on Cognitive Communications and Networking Pub Date : 2024-10-30 DOI:10.1109/TCCN.2024.3487999
Yuanhui Liang;Chan-Tong Lam;Qingle Wu;Benjamin K. Ng;Sio Kei Im
{"title":"基于张量环分解的低复杂度神经信念传播解码算法","authors":"Yuanhui Liang;Chan-Tong Lam;Qingle Wu;Benjamin K. Ng;Sio Kei Im","doi":"10.1109/TCCN.2024.3487999","DOIUrl":null,"url":null,"abstract":"Neural belief propagation (NBP) decoding can improve the performance of belief propagation (BP) decoding for high-density parity check (HDPC) codes, at the expense of higher memory storage requirement and computational complexity due to the addition of trainable weight coefficients. To reduce the high storage requirement of NBP, the cyclically equivariant neural BP (CENBP) algorithm makes full use of the cyclically invariant property of the cyclic code, optimizes and reuses the weight coefficients of the NBP algorithm, at the expense of further increasing the computational complexity of NBP. In this paper, we propose low-complexity, in terms of both memory storage requirement and computational complexity, NBP and CENBP decoding algorithms based on Tensor Ring (TR) decomposition. First, in order to reduce the memory storage and computational complexity of the NBP algorithm, we propose a TR-based compression algorithm to compress the messages and mathematical calculations in the NBP decoding algorithm, called TR-NBP algorithm. Second, to address the high computational complexity of the CENBP algorithm, we propose to apply TR decomposition-based compression to the odd layers of the CENBP decoding algorithm, called TR-CENBP, to reduce the computational complexity, and further reduce the required memory storage requirement of the CENBP algorithm. Furthermore, we use TR decomposition-based compression to simplify the mathematical computations associated with the <monospace>tanh</monospace> function in the NBP algorithm to further reduce the complexity of the hardware implementation. Experimental results show that direct compression of BP algorithm using TR decomposition results in significant performance degradation and our proposed low complexity TR-NBP algorithm and TR-CENBP algorithm can greatly reduce both the memory storage requirement and computation complexity, without significant performance degradation for typical BCH and LDPC codes.","PeriodicalId":13069,"journal":{"name":"IEEE Transactions on Cognitive Communications and Networking","volume":"11 3","pages":"1563-1575"},"PeriodicalIF":7.0000,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Low-Complexity Neural Belief Propagation Decoding Algorithm Based on Tensor Ring Decomposition\",\"authors\":\"Yuanhui Liang;Chan-Tong Lam;Qingle Wu;Benjamin K. Ng;Sio Kei Im\",\"doi\":\"10.1109/TCCN.2024.3487999\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Neural belief propagation (NBP) decoding can improve the performance of belief propagation (BP) decoding for high-density parity check (HDPC) codes, at the expense of higher memory storage requirement and computational complexity due to the addition of trainable weight coefficients. To reduce the high storage requirement of NBP, the cyclically equivariant neural BP (CENBP) algorithm makes full use of the cyclically invariant property of the cyclic code, optimizes and reuses the weight coefficients of the NBP algorithm, at the expense of further increasing the computational complexity of NBP. In this paper, we propose low-complexity, in terms of both memory storage requirement and computational complexity, NBP and CENBP decoding algorithms based on Tensor Ring (TR) decomposition. First, in order to reduce the memory storage and computational complexity of the NBP algorithm, we propose a TR-based compression algorithm to compress the messages and mathematical calculations in the NBP decoding algorithm, called TR-NBP algorithm. Second, to address the high computational complexity of the CENBP algorithm, we propose to apply TR decomposition-based compression to the odd layers of the CENBP decoding algorithm, called TR-CENBP, to reduce the computational complexity, and further reduce the required memory storage requirement of the CENBP algorithm. Furthermore, we use TR decomposition-based compression to simplify the mathematical computations associated with the <monospace>tanh</monospace> function in the NBP algorithm to further reduce the complexity of the hardware implementation. Experimental results show that direct compression of BP algorithm using TR decomposition results in significant performance degradation and our proposed low complexity TR-NBP algorithm and TR-CENBP algorithm can greatly reduce both the memory storage requirement and computation complexity, without significant performance degradation for typical BCH and LDPC codes.\",\"PeriodicalId\":13069,\"journal\":{\"name\":\"IEEE Transactions on Cognitive Communications and Networking\",\"volume\":\"11 3\",\"pages\":\"1563-1575\"},\"PeriodicalIF\":7.0000,\"publicationDate\":\"2024-10-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Cognitive Communications and Networking\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10738425/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"TELECOMMUNICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Cognitive Communications and Networking","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10738425/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

神经信念传播(Neural belief propagation, NBP)译码可以提高高密度奇偶校验码(HDPC)的信念传播译码性能,但由于增加了可训练权系数,增加了存储空间和计算复杂度。为了降低NBP对存储空间的高要求,循环等变神经BP (CENBP)算法充分利用循环码的循环不变特性,对NBP算法的权系数进行优化和重用,但代价是进一步增加NBP的计算复杂度。本文提出了基于张量环(Tensor Ring, TR)分解的NBP和CENBP解码算法,在内存存储需求和计算复杂度方面都较低。首先,为了降低NBP算法的内存存储和计算复杂度,我们提出了一种基于tr的压缩算法来压缩NBP解码算法中的消息和数学计算,称为TR-NBP算法。其次,针对CENBP算法计算复杂度高的问题,提出对CENBP解码算法的奇数层(TR-CENBP)进行基于TR分解的压缩,以降低计算复杂度,进一步降低CENBP算法所需的内存存储需求。此外,我们使用基于TR分解的压缩来简化NBP算法中与tanh函数相关的数学计算,以进一步降低硬件实现的复杂性。实验结果表明,使用TR分解直接压缩BP算法会导致显著的性能下降,我们提出的低复杂度TR- nbp算法和TR- cenbp算法可以大大降低内存存储需求和计算复杂度,对于典型的BCH和LDPC代码没有明显的性能下降。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Low-Complexity Neural Belief Propagation Decoding Algorithm Based on Tensor Ring Decomposition
Neural belief propagation (NBP) decoding can improve the performance of belief propagation (BP) decoding for high-density parity check (HDPC) codes, at the expense of higher memory storage requirement and computational complexity due to the addition of trainable weight coefficients. To reduce the high storage requirement of NBP, the cyclically equivariant neural BP (CENBP) algorithm makes full use of the cyclically invariant property of the cyclic code, optimizes and reuses the weight coefficients of the NBP algorithm, at the expense of further increasing the computational complexity of NBP. In this paper, we propose low-complexity, in terms of both memory storage requirement and computational complexity, NBP and CENBP decoding algorithms based on Tensor Ring (TR) decomposition. First, in order to reduce the memory storage and computational complexity of the NBP algorithm, we propose a TR-based compression algorithm to compress the messages and mathematical calculations in the NBP decoding algorithm, called TR-NBP algorithm. Second, to address the high computational complexity of the CENBP algorithm, we propose to apply TR decomposition-based compression to the odd layers of the CENBP decoding algorithm, called TR-CENBP, to reduce the computational complexity, and further reduce the required memory storage requirement of the CENBP algorithm. Furthermore, we use TR decomposition-based compression to simplify the mathematical computations associated with the tanh function in the NBP algorithm to further reduce the complexity of the hardware implementation. Experimental results show that direct compression of BP algorithm using TR decomposition results in significant performance degradation and our proposed low complexity TR-NBP algorithm and TR-CENBP algorithm can greatly reduce both the memory storage requirement and computation complexity, without significant performance degradation for typical BCH and LDPC codes.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Cognitive Communications and Networking
IEEE Transactions on Cognitive Communications and Networking Computer Science-Artificial Intelligence
CiteScore
15.50
自引率
7.00%
发文量
108
期刊介绍: The IEEE Transactions on Cognitive Communications and Networking (TCCN) aims to publish high-quality manuscripts that push the boundaries of cognitive communications and networking research. Cognitive, in this context, refers to the application of perception, learning, reasoning, memory, and adaptive approaches in communication system design. The transactions welcome submissions that explore various aspects of cognitive communications and networks, focusing on innovative and holistic approaches to complex system design. Key topics covered include architecture, protocols, cross-layer design, and cognition cycle design for cognitive networks. Additionally, research on machine learning, artificial intelligence, end-to-end and distributed intelligence, software-defined networking, cognitive radios, spectrum sharing, and security and privacy issues in cognitive networks are of interest. The publication also encourages papers addressing novel services and applications enabled by these cognitive concepts.
期刊最新文献
Large-Scale Model Enabled Semantic Communication via Robust Knowledge Distillation and Lightweight Architecture Search Topology-Cognitive Task Offloading and Resource Allocation: A GAT-Enhanced MADRL Approach Inception-ResNet-Crop-Based Deep Learning for Multi-Cell Intelligent Beamforming Optimization TAAformer: Transposed Angular Attention for Channel Estimation With Fluid Antennas RadioDUN: A Physics-Inspired Deep Unfolding Network for Radio Map Estimation
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1