首页 > 最新文献

2022 IEEE International Symposium on Information Theory (ISIT)最新文献

英文 中文
Distributed Joint Source-Channel Polar Coding 分布式联合源信道极性编码
Pub Date : 2022-06-26 DOI: 10.1109/ISIT50566.2022.9834726
Yanfei Dong, K. Niu, Jincheng Dai
In this paper, we propose a new class of distributed joint source-channel coding (DJSCC) methods, namely triple polar codes (T-PC), for transmitting a pair of correlated binary sources over noisy channels. In the T-PC structure, one source is protected by a systematic polar code (SPC), and the other source is encoded into a double polar code (D-PC) word. Following this, we prove the T-PC approaches the corner point of the achievable rate-region of DJSCC. We further propose a distributed joint source-channel decoding algorithm, which involves two components: a cyclic redundancy check (CRC) aided successive cancellation list (CA-SCL) decoding of the SPC and a joint successive cancellation list (J-SCL) decoding of the D-PC. The CA-SCL and J-SCL decoding procedures alternately generate hard-decisions of sources which are iteratively exchanged as the side information and result in superior performance compared with the state-of-the-art polar code based DJSCC scheme.
本文提出了一种新的分布式联合信源信道编码(DJSCC)方法,即三极码(T-PC),用于在噪声信道上传输一对相关二进制信源。在T-PC结构中,一个源由系统极性码(SPC)保护,另一个源被编码成双极性码(D-PC)字。在此基础上,证明了T-PC逼近DJSCC可达速率区域的角点。我们进一步提出了一种分布式联合源信道译码算法,该算法包括两个部分:SPC的循环冗余校验(CRC)辅助连续取消列表(CA-SCL)译码和D-PC的联合连续取消列表(J-SCL)译码。CA-SCL和J-SCL解码过程交替产生源的硬决策,这些源作为侧信息迭代交换,与最先进的基于极码的DJSCC方案相比,具有优越的性能。
{"title":"Distributed Joint Source-Channel Polar Coding","authors":"Yanfei Dong, K. Niu, Jincheng Dai","doi":"10.1109/ISIT50566.2022.9834726","DOIUrl":"https://doi.org/10.1109/ISIT50566.2022.9834726","url":null,"abstract":"In this paper, we propose a new class of distributed joint source-channel coding (DJSCC) methods, namely triple polar codes (T-PC), for transmitting a pair of correlated binary sources over noisy channels. In the T-PC structure, one source is protected by a systematic polar code (SPC), and the other source is encoded into a double polar code (D-PC) word. Following this, we prove the T-PC approaches the corner point of the achievable rate-region of DJSCC. We further propose a distributed joint source-channel decoding algorithm, which involves two components: a cyclic redundancy check (CRC) aided successive cancellation list (CA-SCL) decoding of the SPC and a joint successive cancellation list (J-SCL) decoding of the D-PC. The CA-SCL and J-SCL decoding procedures alternately generate hard-decisions of sources which are iteratively exchanged as the side information and result in superior performance compared with the state-of-the-art polar code based DJSCC scheme.","PeriodicalId":348168,"journal":{"name":"2022 IEEE International Symposium on Information Theory (ISIT)","volume":"56 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115295620","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Bandwidth Expansion for Over-the-Air Computation with One-Sided CSI 单向CSI下无线计算的带宽扩展
Pub Date : 2022-06-26 DOI: 10.1109/ISIT50566.2022.9834270
N. Mital, Deniz Gündüz
We consider a distributed computation problem over a multiple access channel (MAC), with N devices. It is known that over-the-air computation (OAC) can provide significant gains for this problem, but existing works are limited to the scenario with matched source and channel bandwidths. We propose OAC schemes for block-fading MACs that modulate the source to fit the available channel bandwidth in a wideband channel, while having channel state information (CSI) only at the transmitter or the receiver. Our results show that the proposed OAC scheme outperforms even ideal capacity-achieving digital schemes when the CSI is available only at the transmitter, and the distortion does not scale with the number of participating devices. We demonstrate the effectiveness of our proposed scheme in federated edge learning (FEEL), where OAC is used to aggregate model updates from the participating devices.
我们考虑了一个具有N个设备的多址通道(MAC)上的分布式计算问题。众所周知,无线计算(OAC)可以为这个问题提供显著的增益,但现有的工作仅限于具有匹配的源和信道带宽的场景。我们提出了块衰落mac的OAC方案,该方案调制源以适应宽带信道中的可用信道带宽,同时仅在发送端或接收端具有信道状态信息(CSI)。我们的结果表明,当CSI仅在发射机可用时,所提出的OAC方案甚至优于理想的容量实现数字方案,并且失真不随参与设备的数量而缩放。我们证明了我们提出的方案在联邦边缘学习(FEEL)中的有效性,其中OAC用于聚合来自参与设备的模型更新。
{"title":"Bandwidth Expansion for Over-the-Air Computation with One-Sided CSI","authors":"N. Mital, Deniz Gündüz","doi":"10.1109/ISIT50566.2022.9834270","DOIUrl":"https://doi.org/10.1109/ISIT50566.2022.9834270","url":null,"abstract":"We consider a distributed computation problem over a multiple access channel (MAC), with N devices. It is known that over-the-air computation (OAC) can provide significant gains for this problem, but existing works are limited to the scenario with matched source and channel bandwidths. We propose OAC schemes for block-fading MACs that modulate the source to fit the available channel bandwidth in a wideband channel, while having channel state information (CSI) only at the transmitter or the receiver. Our results show that the proposed OAC scheme outperforms even ideal capacity-achieving digital schemes when the CSI is available only at the transmitter, and the distortion does not scale with the number of participating devices. We demonstrate the effectiveness of our proposed scheme in federated edge learning (FEEL), where OAC is used to aggregate model updates from the participating devices.","PeriodicalId":348168,"journal":{"name":"2022 IEEE International Symposium on Information Theory (ISIT)","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115459780","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Optimizing Federated Averaging over Fading Channels 在衰落信道上优化联邦平均
Pub Date : 2022-06-26 DOI: 10.1109/ISIT50566.2022.9834609
Yujia Mu, Cong Shen, Yonina C. Eldar
Deep fading represents the typical error event when communicating over wireless channels. We show that deep fading is particularly detrimental for federated learning (FL) over wireless communications. In particular, the celebrated FEDAVG and several of its variants break down for FL tasks when deep fading exists in the communication phase. The main contribution of this paper is an optimal global model aggregation method at the parameter server, which allocates different weights to different clients based on not only their learning characteristics but also the instantaneous channel state information at the receiver (CSIR). This is accomplished by first deriving an upper bound on the parallel stochastic gradient descent (SGD) convergence over fading channels, and then solving an optimization problem for the server aggregation weights that minimizes this upper bound. The derived optimal aggregation solution is closed-form, and achieves the well-known O(1/t) convergence rate for strongly-convex loss functions under arbitrary fading and decaying learning rates. We validate our approach using several real-world FL tasks.
深度衰落是通过无线信道通信时的典型错误事件。我们表明,深度衰落对无线通信中的联邦学习(FL)尤其有害。特别是,当通信阶段存在深度衰落时,著名的FEDAVG及其几个变体在FL任务中失效。本文的主要贡献是在参数服务器上提出了一种最优全局模型聚合方法,该方法不仅根据客户端的学习特征,而且根据接收端的瞬时信道状态信息(CSIR)为不同的客户端分配不同的权重。这是通过首先在衰落信道上推导并行随机梯度下降(SGD)收敛的上界来实现的,然后解决使该上界最小化的服务器聚合权的优化问题。导出的最优聚合解是封闭形式的,在任意衰落和衰减学习率下实现了众所周知的强凸损失函数的O(1/t)收敛速率。我们用几个真实的FL任务验证了我们的方法。
{"title":"Optimizing Federated Averaging over Fading Channels","authors":"Yujia Mu, Cong Shen, Yonina C. Eldar","doi":"10.1109/ISIT50566.2022.9834609","DOIUrl":"https://doi.org/10.1109/ISIT50566.2022.9834609","url":null,"abstract":"Deep fading represents the typical error event when communicating over wireless channels. We show that deep fading is particularly detrimental for federated learning (FL) over wireless communications. In particular, the celebrated FEDAVG and several of its variants break down for FL tasks when deep fading exists in the communication phase. The main contribution of this paper is an optimal global model aggregation method at the parameter server, which allocates different weights to different clients based on not only their learning characteristics but also the instantaneous channel state information at the receiver (CSIR). This is accomplished by first deriving an upper bound on the parallel stochastic gradient descent (SGD) convergence over fading channels, and then solving an optimization problem for the server aggregation weights that minimizes this upper bound. The derived optimal aggregation solution is closed-form, and achieves the well-known O(1/t) convergence rate for strongly-convex loss functions under arbitrary fading and decaying learning rates. We validate our approach using several real-world FL tasks.","PeriodicalId":348168,"journal":{"name":"2022 IEEE International Symposium on Information Theory (ISIT)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125203307","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
New Results on AVCs with Omniscient and Myopic Adversaries 具有全知和近视对手的AVCs的新结果
Pub Date : 2022-06-26 DOI: 10.1109/ISIT50566.2022.9834632
Anuj Kumar Yadav, Mohammadreza Alimohammadi, Yihan Zhang, Amitalok J. Budkuley, S. Jaggi
In the classic adversarial communication problem, two parties communicate over a noisy channel in the presence of a malicious jamming adversary. The arbitrarily varying channels (AVCs) offer an elegant framework to study a wide range of interesting adversary models. The optimal throughput or capacity over such AVCs is intimately tied to the underlying adversary model; in some cases, capacity is unknown and the problem is known to be notoriously hard. The omniscient adversary, one which knows the sender’s entire channel transmission a priori, is one of such classic models of interest; the capacity under such an adversary remains an exciting open problem. The myopic adversary is a generalization of that model where the adversary’s observation may be corrupted over a noisy discrete memoryless channel. Through the adversary’s myopicity, one can unify the slew of different adversary models, ranging from the omniscient adversary to one that is completely blind to the transmission (the latter is the well known oblivious model where the capacity is fully characterized).In this work, we present new results on the capacity under both the omniscient and myopic adversary models. We completely characterize the positive capacity threshold over general AVCs with omniscient adversaries. The characterization is in terms of two key combinatorial objects: the set of completely positive distributions and the CP-confusability set. For omniscient AVCs with positive capacity, we present non-trivial lower and upper bounds on the capacity; unlike some of the previous bounds, our bounds hold under fairly general input and jamming constraints. Our lower bound improves upon the generalized Gilbert-Varshamov bound for general AVCs while the upper bound generalizes the well known Elias-Bassalygo bound (known for binary and q-ary alphabets). For the myopic AVCs, we build on prior results known for the so-called sufficiently myopic model, and present new results on the positive rate communication threshold over the so-called insufficiently myopic regime (a completely insufficient myopic adversary specializes to an omniscient adversary). We present interesting examples for the widely studied models of adversarial bit-flip and bit-erasure channels. In fact, for the bit-flip AVC with additive adversarial noise as well as random noise, we completely characterize the omniscient model capacity when the random noise is sufficiently large vis-a-vis the adversary’s budget.
在经典的对抗性通信问题中,双方在存在恶意干扰对手的噪声信道上进行通信。任意变化通道(avc)为研究各种有趣的对手模型提供了一个优雅的框架。这种avc的最佳吞吐量或容量与潜在的对手模型密切相关;在某些情况下,容量是未知的,并且已知问题非常困难。无所不知的对手,即先验地知道发送方整个信道传输的对手,就是这种经典模型之一;在这样一个对手之下的能力仍然是一个令人兴奋的悬而未决的问题。近视对手是该模型的泛化,对手的观察可能在有噪声的离散无记忆信道上被破坏。通过对手的近视,我们可以统一一系列不同的对手模型,从无所不知的对手到对传输完全视而不见的对手(后者是众所周知的遗忘模型,其能力得到了充分的表征)。在这项工作中,我们提出了在全知和短视对手模型下的能力的新结果。我们完全描述了具有全知对手的普通avc的正容量阈值。表征是根据两个关键的组合对象:完全正分布集和cp -混淆集。对于具有正容量的全知avc,我们给出了其容量的非平凡下界和上界;与之前的一些边界不同,我们的边界在相当一般的输入和干扰约束下成立。我们的下界改进了一般avc的广义Gilbert-Varshamov界,而上界推广了众所周知的Elias-Bassalygo界(众所周知的二进制和q-ary字母表)。对于近视avc,我们建立在所谓的充分近视模型的先前结果的基础上,并在所谓的不充分近视制度(完全不充分近视的对手专门针对无所不知的对手)上提出了关于正速率通信阈值的新结果。我们为广泛研究的对抗性比特翻转和比特擦除信道模型提供了有趣的例子。事实上,对于具有附加对抗噪声和随机噪声的位翻转AVC,当随机噪声相对于对手的预算足够大时,我们完全表征了全知模型容量。
{"title":"New Results on AVCs with Omniscient and Myopic Adversaries","authors":"Anuj Kumar Yadav, Mohammadreza Alimohammadi, Yihan Zhang, Amitalok J. Budkuley, S. Jaggi","doi":"10.1109/ISIT50566.2022.9834632","DOIUrl":"https://doi.org/10.1109/ISIT50566.2022.9834632","url":null,"abstract":"In the classic adversarial communication problem, two parties communicate over a noisy channel in the presence of a malicious jamming adversary. The arbitrarily varying channels (AVCs) offer an elegant framework to study a wide range of interesting adversary models. The optimal throughput or capacity over such AVCs is intimately tied to the underlying adversary model; in some cases, capacity is unknown and the problem is known to be notoriously hard. The omniscient adversary, one which knows the sender’s entire channel transmission a priori, is one of such classic models of interest; the capacity under such an adversary remains an exciting open problem. The myopic adversary is a generalization of that model where the adversary’s observation may be corrupted over a noisy discrete memoryless channel. Through the adversary’s myopicity, one can unify the slew of different adversary models, ranging from the omniscient adversary to one that is completely blind to the transmission (the latter is the well known oblivious model where the capacity is fully characterized).In this work, we present new results on the capacity under both the omniscient and myopic adversary models. We completely characterize the positive capacity threshold over general AVCs with omniscient adversaries. The characterization is in terms of two key combinatorial objects: the set of completely positive distributions and the CP-confusability set. For omniscient AVCs with positive capacity, we present non-trivial lower and upper bounds on the capacity; unlike some of the previous bounds, our bounds hold under fairly general input and jamming constraints. Our lower bound improves upon the generalized Gilbert-Varshamov bound for general AVCs while the upper bound generalizes the well known Elias-Bassalygo bound (known for binary and q-ary alphabets). For the myopic AVCs, we build on prior results known for the so-called sufficiently myopic model, and present new results on the positive rate communication threshold over the so-called insufficiently myopic regime (a completely insufficient myopic adversary specializes to an omniscient adversary). We present interesting examples for the widely studied models of adversarial bit-flip and bit-erasure channels. In fact, for the bit-flip AVC with additive adversarial noise as well as random noise, we completely characterize the omniscient model capacity when the random noise is sufficiently large vis-a-vis the adversary’s budget.","PeriodicalId":348168,"journal":{"name":"2022 IEEE International Symposium on Information Theory (ISIT)","volume":"22 6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116635701","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Locally Decodable Slepian-Wolf Compression 局部可解码的睡眠狼压缩
Pub Date : 2022-06-26 DOI: 10.1109/ISIT50566.2022.9834371
Shashank Vatedka, V. Chandar, A. Tchamkerten
This paper investigates the Slepian-Wolf distributed compression of two sources Xn and Yn with the additional property that any pair (Xi, Yi) should reliably be decoded by probing a small number d of compressed bits. We show that for certain source distributions, the error probability of any such local decoder is lower bounded by 2–O(d), in the worst case over index i, whenever one of the sources is compressed below its entropy. Unlike the single-source setup, it is thus impossible to simultaneously achieve constant local decodability d and vanishing local decoding error probability as n increases. We also provide a compression scheme with a local decoder that almost achieves the above lower bound.
我们表明,对于某些源分布,在索引i的最坏情况下,当其中一个源被压缩到其熵以下时,任何此类局部解码器的错误概率的下限为2-O (d)。与单源设置不同,因此不可能同时实现恒定的局部可解码性d和随着n的增加而消失的局部解码错误概率。我们还提供了一个带有本地解码器的压缩方案,几乎可以达到上述下界。
{"title":"Locally Decodable Slepian-Wolf Compression","authors":"Shashank Vatedka, V. Chandar, A. Tchamkerten","doi":"10.1109/ISIT50566.2022.9834371","DOIUrl":"https://doi.org/10.1109/ISIT50566.2022.9834371","url":null,"abstract":"This paper investigates the Slepian-Wolf distributed compression of two sources Xn and Yn with the additional property that any pair (Xi, Yi) should reliably be decoded by probing a small number d of compressed bits. We show that for certain source distributions, the error probability of any such local decoder is lower bounded by 2–O(d), in the worst case over index i, whenever one of the sources is compressed below its entropy. Unlike the single-source setup, it is thus impossible to simultaneously achieve constant local decodability d and vanishing local decoding error probability as n increases. We also provide a compression scheme with a local decoder that almost achieves the above lower bound.","PeriodicalId":348168,"journal":{"name":"2022 IEEE International Symposium on Information Theory (ISIT)","volume":"3 5","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120905079","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
An improved coded caching scheme for partially cooperative D2D networks 一种改进的部分协作D2D网络编码缓存方案
Pub Date : 2022-06-26 DOI: 10.1109/ISIT50566.2022.9834579
Aniruddha Phatak, M. Varanasi
A model of device-to-device (D2D) coded caching in which only a subset of users transmit information during the D2D transmission process was recently introduced. Such networks are referred to as partially cooperative D2D networks. Tebbi and Sung proposed a coded caching achievability scheme for such networks that enables all users to obtain their respective file demands. This is done by forming user sets and employing some of the transmitting users to compensate for the non-transmitting users in each such user set. In this paper, we show that this approach is sub-optimal. In particular, we show that by forming groups of such user sets that satisfy certain properties, it is possible to exploit additional coding opportunities across all the user sets in that group that are not exploited in the previously proposed scheme. We also show how to construct such groups and characterize the resulting improvement in the device-to-device transmission rate.
最近引入了一种设备到设备(D2D)编码缓存模型,在该模型中,只有一部分用户在D2D传输过程中传输信息。这样的网络被称为部分协作D2D网络。Tebbi和Sung为这种网络提出了一种编码缓存可实现性方案,使所有用户都能获得各自的文件需求。这是通过形成用户集并使用一些传输用户来补偿每个这样的用户集中的非传输用户来实现的。在本文中,我们证明了这种方法是次优的。特别是,我们表明,通过形成满足某些属性的用户集的组,可以利用该组中所有用户集的额外编码机会,而这些机会在先前提出的方案中没有被利用。我们还展示了如何构建这样的组,并描述了设备到设备传输速率的改进结果。
{"title":"An improved coded caching scheme for partially cooperative D2D networks","authors":"Aniruddha Phatak, M. Varanasi","doi":"10.1109/ISIT50566.2022.9834579","DOIUrl":"https://doi.org/10.1109/ISIT50566.2022.9834579","url":null,"abstract":"A model of device-to-device (D2D) coded caching in which only a subset of users transmit information during the D2D transmission process was recently introduced. Such networks are referred to as partially cooperative D2D networks. Tebbi and Sung proposed a coded caching achievability scheme for such networks that enables all users to obtain their respective file demands. This is done by forming user sets and employing some of the transmitting users to compensate for the non-transmitting users in each such user set. In this paper, we show that this approach is sub-optimal. In particular, we show that by forming groups of such user sets that satisfy certain properties, it is possible to exploit additional coding opportunities across all the user sets in that group that are not exploited in the previously proposed scheme. We also show how to construct such groups and characterize the resulting improvement in the device-to-device transmission rate.","PeriodicalId":348168,"journal":{"name":"2022 IEEE International Symposium on Information Theory (ISIT)","volume":"96 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127103395","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A Semi Linear State Space Model for Error Floor Estimation of LDPC codes over the AWGN Channel AWGN信道上LDPC码误差层估计的半线性状态空间模型
Pub Date : 2022-06-26 DOI: 10.1109/ISIT50566.2022.9834504
Ali Farsiabi, A. Banihashemi
In this paper, we propose a novel state-space model to represent the behavior of sum-product algorithm (SPA) in the vicinity of a trapping set (TS) of a low-density parity-check (LDPC) code over the additive white Gaussian noise (AWGN) channel in the error floor region. The proposed model takes into account the non-linear behavior of SPA and dynamically adjusts the operating point of the model in accordance to the statistical properties of TS messages. This is in contrast to the existing linear state-space models which linearly approximate such behavior at around the operating point of zero. Simulation results are provided to demonstrate the higher accuracy of the proposed model in estimating the error floor of LDPC codes compared to the linear state-space model.
在本文中,我们提出了一种新的状态空间模型来表示和积算法(SPA)在低密度奇偶校验(LDPC)码的捕获集(TS)附近在误差底区加性高斯白噪声(AWGN)信道上的行为。该模型考虑了SPA的非线性行为,并根据TS消息的统计特性动态调整模型的工作点。这与现有的线性状态空间模型形成对比,该模型在工作点0附近线性近似这种行为。仿真结果表明,与线性状态空间模型相比,该模型在估计LDPC码的误差层时具有更高的精度。
{"title":"A Semi Linear State Space Model for Error Floor Estimation of LDPC codes over the AWGN Channel","authors":"Ali Farsiabi, A. Banihashemi","doi":"10.1109/ISIT50566.2022.9834504","DOIUrl":"https://doi.org/10.1109/ISIT50566.2022.9834504","url":null,"abstract":"In this paper, we propose a novel state-space model to represent the behavior of sum-product algorithm (SPA) in the vicinity of a trapping set (TS) of a low-density parity-check (LDPC) code over the additive white Gaussian noise (AWGN) channel in the error floor region. The proposed model takes into account the non-linear behavior of SPA and dynamically adjusts the operating point of the model in accordance to the statistical properties of TS messages. This is in contrast to the existing linear state-space models which linearly approximate such behavior at around the operating point of zero. Simulation results are provided to demonstrate the higher accuracy of the proposed model in estimating the error floor of LDPC codes compared to the linear state-space model.","PeriodicalId":348168,"journal":{"name":"2022 IEEE International Symposium on Information Theory (ISIT)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125856967","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Entropic Central Limit Theorem for Discrete Random Variables 离散随机变量的熵中心极限定理
Pub Date : 2022-06-26 DOI: 10.1109/ISIT50566.2022.9834855
Lampros Gavalakis, I. Kontoyiannis
An information-theoretic proof of a strengthened version of the classical discrete central limit theorem is presented. Using only information-theoretic and elementary arguments, convergence to zero of the relative entropy between the standardised sum of n independent and identically distributed lattice random variables and an appropriately discretised Gaussian is established.
给出了经典离散中心极限定理的一个强化版的信息论证明。仅利用信息论和初等论证,建立了n个独立同分布格随机变量的标准化和与一个适当离散高斯变量的相对熵收敛于零的定理。
{"title":"The Entropic Central Limit Theorem for Discrete Random Variables","authors":"Lampros Gavalakis, I. Kontoyiannis","doi":"10.1109/ISIT50566.2022.9834855","DOIUrl":"https://doi.org/10.1109/ISIT50566.2022.9834855","url":null,"abstract":"An information-theoretic proof of a strengthened version of the classical discrete central limit theorem is presented. Using only information-theoretic and elementary arguments, convergence to zero of the relative entropy between the standardised sum of n independent and identically distributed lattice random variables and an appropriately discretised Gaussian is established.","PeriodicalId":348168,"journal":{"name":"2022 IEEE International Symposium on Information Theory (ISIT)","volume":"80 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123241975","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Statistical Delay and Error-Rate Bounded QoS Control for URLLC in the Non-Asymptotic Regime 非渐近状态下URLLC的统计延迟和错误率有界QoS控制
Pub Date : 2022-06-26 DOI: 10.1109/ISIT50566.2022.9834874
Xi Zhang, Jingqing Wang, H. Poor
To support increasing demands for real-time multimedia wireless data traffic, there have been considerable efforts toward guaranteeing stringent quality-of-service (QoS) when designing mobile wireless network architectures for ultra-reliable and low-latency communications (URLLC). One of the major design issues raised by URLLC is how to characterize QoS metrics for upper-bounding both delay and error-rate when implementing short-packet data communications, such as finite blocklength coding (FBC), over highly time-varying wireless fading channels. To efficiently accommodate statistical QoS provisioning for URLLC traffic, it is crucial to model and investigate wireless fading channels’ stochastic-characteristics by defining and identifying new statistical QoS metrics and their analytical relationships, such as delay-bound-violating probability, effective capacity, decoding error probability, outage capacity, etc., in the non-asymptotic regime. However, how to rigorously and efficiently characterize the stochastic dynamics of mobile wireless networks in terms of statistically upper-bounding FBC-based both delay and error-rate QoS metrics has been neither well understood nor thoroughly studied before. To overcome these challenges, in this paper we develop analytical modeling frameworks and controlling mechanisms for statistical delay and error-rate bounded QoS provisioning in the non-asymptotic regime. First, we establish FBC-based system models by characterizing various information-theoretic specifications. Second, we characterize the outage-probability and outage capacity functions in the non-asymptotic regime. Third, we develop a set of new statistical delay and error-rate bounded QoS metrics and control mechanisms including delay-bound-violation probability, QoS-exponent functions, and the -effective capacity in the non-asymptotic regime. Finally, the obtained simulation results validate and evaluate our proposed controlling mechanisms for statistical QoS in supporting URLLC.
为了支持对实时多媒体无线数据流量日益增长的需求,在设计用于超可靠和低延迟通信(URLLC)的移动无线网络架构时,已经在保证严格的服务质量(QoS)方面做出了相当大的努力。URLLC提出的一个主要设计问题是,在实现短包数据通信(如有限块长度编码(FBC))时,在高度时变的无线衰落信道上,如何表征延迟和错误率上限的QoS指标。为了有效地适应URLLC业务的统计QoS提供,在非渐近状态下,通过定义和识别新的统计QoS指标及其分析关系(如延迟边界违反概率、有效容量、译码错误概率、中断容量等)来建模和研究无线衰落信道的随机特性至关重要。然而,如何根据基于fbc的时延和错误率QoS指标的统计上限来严格有效地表征移动无线网络的随机动力学,在此之前既没有得到很好的理解,也没有得到深入的研究。为了克服这些挑战,本文开发了非渐近状态下统计延迟和错误率有界QoS提供的分析建模框架和控制机制。首先,我们通过描述各种信息论规范,建立了基于fbc的系统模型。其次,刻画了非渐近状态下的停电概率和停电容量函数。第三,我们开发了一套新的统计延迟和错误率有界QoS度量和控制机制,包括延迟有界违规概率、QoS指数函数和非渐近区域的有效容量。最后,仿真结果验证和评价了我们提出的支持URLLC的统计QoS控制机制。
{"title":"Statistical Delay and Error-Rate Bounded QoS Control for URLLC in the Non-Asymptotic Regime","authors":"Xi Zhang, Jingqing Wang, H. Poor","doi":"10.1109/ISIT50566.2022.9834874","DOIUrl":"https://doi.org/10.1109/ISIT50566.2022.9834874","url":null,"abstract":"To support increasing demands for real-time multimedia wireless data traffic, there have been considerable efforts toward guaranteeing stringent quality-of-service (QoS) when designing mobile wireless network architectures for ultra-reliable and low-latency communications (URLLC). One of the major design issues raised by URLLC is how to characterize QoS metrics for upper-bounding both delay and error-rate when implementing short-packet data communications, such as finite blocklength coding (FBC), over highly time-varying wireless fading channels. To efficiently accommodate statistical QoS provisioning for URLLC traffic, it is crucial to model and investigate wireless fading channels’ stochastic-characteristics by defining and identifying new statistical QoS metrics and their analytical relationships, such as delay-bound-violating probability, effective capacity, decoding error probability, outage capacity, etc., in the non-asymptotic regime. However, how to rigorously and efficiently characterize the stochastic dynamics of mobile wireless networks in terms of statistically upper-bounding FBC-based both delay and error-rate QoS metrics has been neither well understood nor thoroughly studied before. To overcome these challenges, in this paper we develop analytical modeling frameworks and controlling mechanisms for statistical delay and error-rate bounded QoS provisioning in the non-asymptotic regime. First, we establish FBC-based system models by characterizing various information-theoretic specifications. Second, we characterize the outage-probability and outage capacity functions in the non-asymptotic regime. Third, we develop a set of new statistical delay and error-rate bounded QoS metrics and control mechanisms including delay-bound-violation probability, QoS-exponent functions, and the -effective capacity in the non-asymptotic regime. Finally, the obtained simulation results validate and evaluate our proposed controlling mechanisms for statistical QoS in supporting URLLC.","PeriodicalId":348168,"journal":{"name":"2022 IEEE International Symposium on Information Theory (ISIT)","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123399340","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Modeling Network Contagion Via Interacting Finite Memory Pólya Urns 通过相互作用的有限记忆建模网络传染Pólya Urns
Pub Date : 2022-06-26 DOI: 10.1109/ISIT50566.2022.9834759
Somya Singh, F. Alajaji, B. Gharesifard
We construct a system of interacting finite memory Pólya urns to model contagion spread in a network. The urns, which are composed of red and black balls (representing degrees of infection and healthiness, respectively) interact in the sense that the probability at any time instant of drawing a red ball for a given urn not only depends on that urn’s ratio of red balls, but also on the ratio of red balls in the other urns of the network, hence accounting for the effect of spatial contagion. The urns have a finite memory, M, in the sense that reinforcing (black or red) balls added to each urn at time t are only kept in that urn for M future time instants (until time t + M). The resulting vector of all urn drawing variables forms an Mth order time-invariant irreducible and aperiodic Markov chain. We analytically examine the properties of the underlying Markov process and derive its asymptotic behaviour for the case of homogeneous system parameters. We further use mean-field approximation to obtain a class of approximating linear and nonlinear dynamical systems for the non-homogeneous case. Finally, we present simulations to assess the quality of these mean-field approximations.
我们构建了一个相互作用的有限记忆系统Pólya瓮来模拟传染在网络中的传播。由红球和黑球(分别代表感染程度和健康程度)组成的瓮在任何时刻为给定瓮画出红球的概率不仅取决于该瓮的红球比例,还取决于网络中其他瓮中红球的比例,因此考虑了空间传染的影响。瓮有一个有限的记忆,M,从某种意义上说,在时间t时添加到每个瓮中的强化(黑色或红色)球只在该瓮中保存M个未来的时间瞬间(直到时间t + M)。所有瓮绘制变量的结果向量形成了一个M阶时不变不可约的非周期马尔可夫链。在齐次系统参数的情况下,我们分析地研究了底层马尔可夫过程的性质,并推导了它的渐近性质。在非齐次情况下,我们进一步利用平均场近似得到了一类近似的线性和非线性动力系统。最后,我们提供模拟来评估这些平均场近似的质量。
{"title":"Modeling Network Contagion Via Interacting Finite Memory Pólya Urns","authors":"Somya Singh, F. Alajaji, B. Gharesifard","doi":"10.1109/ISIT50566.2022.9834759","DOIUrl":"https://doi.org/10.1109/ISIT50566.2022.9834759","url":null,"abstract":"We construct a system of interacting finite memory Pólya urns to model contagion spread in a network. The urns, which are composed of red and black balls (representing degrees of infection and healthiness, respectively) interact in the sense that the probability at any time instant of drawing a red ball for a given urn not only depends on that urn’s ratio of red balls, but also on the ratio of red balls in the other urns of the network, hence accounting for the effect of spatial contagion. The urns have a finite memory, M, in the sense that reinforcing (black or red) balls added to each urn at time t are only kept in that urn for M future time instants (until time t + M). The resulting vector of all urn drawing variables forms an Mth order time-invariant irreducible and aperiodic Markov chain. We analytically examine the properties of the underlying Markov process and derive its asymptotic behaviour for the case of homogeneous system parameters. We further use mean-field approximation to obtain a class of approximating linear and nonlinear dynamical systems for the non-homogeneous case. Finally, we present simulations to assess the quality of these mean-field approximations.","PeriodicalId":348168,"journal":{"name":"2022 IEEE International Symposium on Information Theory (ISIT)","volume":"54 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126614005","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
2022 IEEE International Symposium on Information Theory (ISIT)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1