首页 > 最新文献

2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton)最新文献

英文 中文
Information-theoretic private interactive mechanism 信息论私有交互机制
Pub Date : 2015-09-01 DOI: 10.1109/ALLERTON.2015.7447104
Bahman Moraffah, L. Sankar
An information-theoretic mechanism for privacy-guaranteed interactions is introduced between two memoryless correlated sources where each source is characterized by a pair of public and private variables. The interactions are modeled as a collection of K/2 pairs of random mappings, one pair for each of the K rounds of interactions. The K/2 random mapping pairs are chosen jointly to minimize the information leakage (privacy measure) over K rounds of the private variable of each source at the other source while ensuring that a desired measure of utility (distortion) of the revealed public variable is satisfied. Arguing that an average case information-theoretic privacy metric can be appropriate for streaming data settings, this paper shows that in general, interaction reduces privacy leakage by drawing some parallels between this problem and the classic interactive source coding problem. Specifically, for the log-loss distortion metric it is shown that the resulting interaction problem is an analog of an interactive information bottleneck problem for which a one-shot interactive mechanism is, in general, not optimal. For the resulting problem with a non-convex constraint space, an algorithm that extends the one-way agglomerative information bottleneck algorithm to the interactive setting is introduced.
在两个无内存相关源之间引入了一种保证隐私的信息论机制,其中每个源由一对公共变量和私有变量表征。相互作用被建模为K/2对随机映射的集合,每K轮相互作用对应一对。联合选择K/2个随机映射对,以最大限度地减少每个源的私有变量在另一个源的K轮信息泄漏(隐私度量),同时确保满足所披露的公共变量的期望效用度量(失真)。本文认为,一般情况下,信息论的隐私度量可以适用于流数据设置,并通过将该问题与经典的交互式源编码问题进行类比,表明交互通常可以减少隐私泄漏。具体来说,对于对数损失失真度量,结果表明,所产生的交互问题是一个模拟的交互信息瓶颈问题,其中一次性交互机制通常不是最优的。针对非凸约束空间的结果问题,提出了一种将单向聚集信息瓶颈算法扩展到交互设置的算法。
{"title":"Information-theoretic private interactive mechanism","authors":"Bahman Moraffah, L. Sankar","doi":"10.1109/ALLERTON.2015.7447104","DOIUrl":"https://doi.org/10.1109/ALLERTON.2015.7447104","url":null,"abstract":"An information-theoretic mechanism for privacy-guaranteed interactions is introduced between two memoryless correlated sources where each source is characterized by a pair of public and private variables. The interactions are modeled as a collection of K/2 pairs of random mappings, one pair for each of the K rounds of interactions. The K/2 random mapping pairs are chosen jointly to minimize the information leakage (privacy measure) over K rounds of the private variable of each source at the other source while ensuring that a desired measure of utility (distortion) of the revealed public variable is satisfied. Arguing that an average case information-theoretic privacy metric can be appropriate for streaming data settings, this paper shows that in general, interaction reduces privacy leakage by drawing some parallels between this problem and the classic interactive source coding problem. Specifically, for the log-loss distortion metric it is shown that the resulting interaction problem is an analog of an interactive information bottleneck problem for which a one-shot interactive mechanism is, in general, not optimal. For the resulting problem with a non-convex constraint space, an algorithm that extends the one-way agglomerative information bottleneck algorithm to the interactive setting is introduced.","PeriodicalId":112948,"journal":{"name":"2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115792496","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
On the representability of integer polymatroids: Applications in linear code construction 整数多拟阵的可表示性:在线性码构造中的应用
Pub Date : 2015-09-01 DOI: 10.1109/ALLERTON.2015.7447046
Amir Salimi, M. Médard, Shuguang Cui
It has been shown that there is a duality between the linear network coding solution and the entropic vectors induced by collection of subspaces in a vector space over a finite field (dubbed linearly constructed entropic vectors). The region of all linearly constructed vectors, coincides with the set of all representable polymatroids. For any integer polymatroid, there is an associated matroid, which uniquely identifies the polymatroid. We conjecture that the representability of the underlying matroid is a sufficient condition for integer polymatroids to be linearly representable. We prove that the conjecture holds for representation over real numbers. Furthermore, we show that any real-valued submodular function (such as Shannon entropy) can be approximated (arbitrarily close) by an integer polymatroid.
证明了线性网络编码解与由有限域上向量空间的子空间集合诱导的熵向量(称为线性构造熵向量)之间存在对偶性。所有线性构造向量的区域,与所有可表示的多边形集合重合。对于任何整数多边形,都有一个关联的矩阵,它唯一地标识该多边形。我们推测下拟阵的可表示性是整数多拟阵线性可表示的充分条件。我们证明了这个猜想对于实数表示是成立的。此外,我们证明了任何实值子模函数(如香农熵)都可以用整数多边形近似(任意接近)。
{"title":"On the representability of integer polymatroids: Applications in linear code construction","authors":"Amir Salimi, M. Médard, Shuguang Cui","doi":"10.1109/ALLERTON.2015.7447046","DOIUrl":"https://doi.org/10.1109/ALLERTON.2015.7447046","url":null,"abstract":"It has been shown that there is a duality between the linear network coding solution and the entropic vectors induced by collection of subspaces in a vector space over a finite field (dubbed linearly constructed entropic vectors). The region of all linearly constructed vectors, coincides with the set of all representable polymatroids. For any integer polymatroid, there is an associated matroid, which uniquely identifies the polymatroid. We conjecture that the representability of the underlying matroid is a sufficient condition for integer polymatroids to be linearly representable. We prove that the conjecture holds for representation over real numbers. Furthermore, we show that any real-valued submodular function (such as Shannon entropy) can be approximated (arbitrarily close) by an integer polymatroid.","PeriodicalId":112948,"journal":{"name":"2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124497393","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Design of linear & nonlinear observers for a turning process with implicit State-Dependent Delay 具有隐式状态相关延迟的车削过程线性和非线性观测器的设计
Pub Date : 2015-09-01 DOI: 10.1109/ALLERTON.2015.7447052
Aftab Ahmed, Erik I. Verriest
Analysis and design of present machining methods used in mechanical engineering are based on Taylor series approximations and linearizations which cause erroneous and anomalous results. High precision machining cannot tolerate such errors. We consider and analyze an exact mathematical model of the turning process without performing any kind of linearization of the model. We give a strategic design of an estimator for the position of a machining tool based on first principles. The system's dynamics are characterized by a nonlinear State-Dependent Delay Differential Equation (SD-DDE). This delay is extremely convoluted with the state by an implicit relation. The central tenet is to use inversion of the delay model and to extract the state vector given the delay. We use our recently developed observation technique referred to as Delay Injection. Both linear asymptotic and nonlinear observers with different architectures are designed for the state estimation of a machine tool based on state-dependent delay measurement. Simulation results are depicted at the end which portray the effectiveness, validity and usefulness of the proposed observer schemes.
目前机械工程中使用的加工方法的分析和设计是基于泰勒级数近似和线性化的,这会导致错误和异常的结果。高精度加工不能容忍这样的误差。我们考虑并分析了车削过程的精确数学模型,而没有对模型进行任何线性化。给出了一种基于第一性原理的机床位置估计器的设计策略。系统动力学用非线性状态相关时滞微分方程(SD-DDE)表征。这种延迟通过隐式关系与状态极其复杂。其核心原则是使用延迟模型的反演并提取给定延迟的状态向量。我们使用我们最近开发的观测技术,称为延迟注入。针对基于状态相关延迟测量的机床状态估计,设计了不同结构的线性渐近观测器和非线性观测器。仿真结果说明了所提观测器方案的有效性、有效性和实用性。
{"title":"Design of linear & nonlinear observers for a turning process with implicit State-Dependent Delay","authors":"Aftab Ahmed, Erik I. Verriest","doi":"10.1109/ALLERTON.2015.7447052","DOIUrl":"https://doi.org/10.1109/ALLERTON.2015.7447052","url":null,"abstract":"Analysis and design of present machining methods used in mechanical engineering are based on Taylor series approximations and linearizations which cause erroneous and anomalous results. High precision machining cannot tolerate such errors. We consider and analyze an exact mathematical model of the turning process without performing any kind of linearization of the model. We give a strategic design of an estimator for the position of a machining tool based on first principles. The system's dynamics are characterized by a nonlinear State-Dependent Delay Differential Equation (SD-DDE). This delay is extremely convoluted with the state by an implicit relation. The central tenet is to use inversion of the delay model and to extract the state vector given the delay. We use our recently developed observation technique referred to as Delay Injection. Both linear asymptotic and nonlinear observers with different architectures are designed for the state estimation of a machine tool based on state-dependent delay measurement. Simulation results are depicted at the end which portray the effectiveness, validity and usefulness of the proposed observer schemes.","PeriodicalId":112948,"journal":{"name":"2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121883845","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Scheduling, pricing, and efficiency of non-preemptive flexible loads under direct load control 直接负荷控制下非抢占柔性负荷的调度、定价和效率
Pub Date : 2015-09-01 DOI: 10.1109/ALLERTON.2015.7447118
Abhishek K. Gupta, R. Jain, R. Rajagopal
A market comprising a scheduler with a renewable generator and a pumped water storage system, a certain number of flexible and inflexible loads, and a non-renewable generator is considered. At the beginning of activity, the scheduler receives the following three information from each of the loads - consumption (in MW), duration (in hours) and start window. The start window of a load is the time interval in which the load must be started. A load is inflexible if its start window is singleton. The loads are assumed to be non-preemptive, that is, after a load is started, it cannot be interrupted or paused, and it must be served for its duration. The goal of the scheduler is to develop a scheduling policy that minimizes the aggregate cost of buying electricity from the non-renewable generator. We develop an understanding of the nature of optimal solutions to such an optimization problem and propose an approximately optimal scheduling policy for a sufficiently wide class of scheduling problems.
考虑一个包含可再生能源发电机组和抽水蓄能系统的调度器、一定数量的灵活负荷和不灵活负荷以及不可再生能源发电机组的市场。在活动开始时,调度器从每个负载接收以下三个信息——消耗(以MW为单位)、持续时间(以小时为单位)和启动窗口。负载的开始窗口是必须启动负载的时间间隔。如果一个加载的开始窗口是单例的,那么它就是不灵活的。假设负载是非抢占式的,也就是说,负载启动后,它不能被中断或暂停,并且必须在其持续时间内为其提供服务。调度程序的目标是制定一个调度策略,使从不可再生发电机购买电力的总成本最小化。我们对这类优化问题的最优解的本质进行了理解,并对一类足够广泛的调度问题提出了近似最优调度策略。
{"title":"Scheduling, pricing, and efficiency of non-preemptive flexible loads under direct load control","authors":"Abhishek K. Gupta, R. Jain, R. Rajagopal","doi":"10.1109/ALLERTON.2015.7447118","DOIUrl":"https://doi.org/10.1109/ALLERTON.2015.7447118","url":null,"abstract":"A market comprising a scheduler with a renewable generator and a pumped water storage system, a certain number of flexible and inflexible loads, and a non-renewable generator is considered. At the beginning of activity, the scheduler receives the following three information from each of the loads - consumption (in MW), duration (in hours) and start window. The start window of a load is the time interval in which the load must be started. A load is inflexible if its start window is singleton. The loads are assumed to be non-preemptive, that is, after a load is started, it cannot be interrupted or paused, and it must be served for its duration. The goal of the scheduler is to develop a scheduling policy that minimizes the aggregate cost of buying electricity from the non-renewable generator. We develop an understanding of the nature of optimal solutions to such an optimization problem and propose an approximately optimal scheduling policy for a sufficiently wide class of scheduling problems.","PeriodicalId":112948,"journal":{"name":"2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"79 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126331852","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
An information theoretic technique for harnessing attenuation of high spatial frequencies to design ultra-high-density EEG 利用高空间频率衰减的信息理论技术设计超高密度脑电图
Pub Date : 2015-09-01 DOI: 10.1109/ALLERTON.2015.7447102
P. Grover, J. Weldon, S. Kelly, Praveen Venkatesh, Haewon Jeong
It is widely believed in the clinical and biosciences community that Electroencephalography (EEG) is fundamentally limited in the spatial resolution achieved using a few hundred electrodes. This belief rests on the well known decay of high-spatial frequencies as the signal passes from the brain surface to the scalp surface. These high spatial frequencies carry high spatial resolution information about the source. However, recent experimental work as well as our theoretical and numerical analyses strongly suggest that EEG's resolution could be improved significantly through increased electrode density despite this decay. Somewhat counterintuitively, instead of viewing this decay of spatial frequencies as a detriment to signal quality (which it is), in this work we propose an information-theoretic strategy to harness this decay to reduce circuit area and energy needed for high-resolution signal acquisition. This is made possible by the observation that this spatial-low-pass filtering of the signal as it passes from the brain to the scalp induces large spatial correlations that can be exploited information-theoretically. The proposed techniques are shown in idealized head models to reduce requirements on energy required for sensing by 3×. These results are being applied towards an ongoing project on developing the “Neural Web,” a 10,000 electrode portable EEG system at CMU.
临床和生物科学界普遍认为,脑电图(EEG)基本上局限于使用几百个电极实现的空间分辨率。这种观点基于众所周知的高空间频率衰减,即当信号从大脑表面传递到头皮表面时。这些高空间频率携带有关源的高空间分辨率信息。然而,最近的实验工作以及我们的理论和数值分析强烈表明,尽管存在这种衰减,但通过增加电极密度可以显著提高EEG的分辨率。在这项工作中,我们提出了一种信息理论策略来利用这种衰减来减少高分辨率信号采集所需的电路面积和能量,而不是将这种空间频率的衰减视为对信号质量的损害(事实确实如此)。当信号从大脑传递到头皮时,这种空间低通滤波引起了可以利用信息理论的大空间相关性,这使得这一点成为可能。所提出的技术在理想的头部模型中显示,可以将传感所需的能量要求降低3倍。这些结果正在应用于一个正在进行的开发“神经网络”的项目,这是CMU的一个10,000电极便携式脑电图系统。
{"title":"An information theoretic technique for harnessing attenuation of high spatial frequencies to design ultra-high-density EEG","authors":"P. Grover, J. Weldon, S. Kelly, Praveen Venkatesh, Haewon Jeong","doi":"10.1109/ALLERTON.2015.7447102","DOIUrl":"https://doi.org/10.1109/ALLERTON.2015.7447102","url":null,"abstract":"It is widely believed in the clinical and biosciences community that Electroencephalography (EEG) is fundamentally limited in the spatial resolution achieved using a few hundred electrodes. This belief rests on the well known decay of high-spatial frequencies as the signal passes from the brain surface to the scalp surface. These high spatial frequencies carry high spatial resolution information about the source. However, recent experimental work as well as our theoretical and numerical analyses strongly suggest that EEG's resolution could be improved significantly through increased electrode density despite this decay. Somewhat counterintuitively, instead of viewing this decay of spatial frequencies as a detriment to signal quality (which it is), in this work we propose an information-theoretic strategy to harness this decay to reduce circuit area and energy needed for high-resolution signal acquisition. This is made possible by the observation that this spatial-low-pass filtering of the signal as it passes from the brain to the scalp induces large spatial correlations that can be exploited information-theoretically. The proposed techniques are shown in idealized head models to reduce requirements on energy required for sensing by 3×. These results are being applied towards an ongoing project on developing the “Neural Web,” a 10,000 electrode portable EEG system at CMU.","PeriodicalId":112948,"journal":{"name":"2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129749269","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Finite-state approximations to constrained Markov decision processes with Borel spaces Borel空间约束马尔可夫决策过程的有限状态逼近
Pub Date : 2015-09-01 DOI: 10.1109/ALLERTON.2015.7447055
Naci Saldi, S. Yüksel, T. Linder
We consider the finite-state approximation of a discrete-time constrained Markov decision process with compact state space, under the discounted cost criterion. Using the linear programming formulation of the constrained problem, we prove the convergence of the optimal value function of the finite-state model to the optimal value function of the original model. Under further continuity condition on the transition probability of the original model, we also establish a method to compute approximately optimal policies.
考虑了具有紧态空间的离散时间约束马尔可夫决策过程在折现代价准则下的有限状态逼近。利用约束问题的线性规划公式,证明了有限状态模型的最优值函数收敛于原模型的最优值函数。在原模型转移概率的进一步连续性条件下,我们还建立了近似最优策略的计算方法。
{"title":"Finite-state approximations to constrained Markov decision processes with Borel spaces","authors":"Naci Saldi, S. Yüksel, T. Linder","doi":"10.1109/ALLERTON.2015.7447055","DOIUrl":"https://doi.org/10.1109/ALLERTON.2015.7447055","url":null,"abstract":"We consider the finite-state approximation of a discrete-time constrained Markov decision process with compact state space, under the discounted cost criterion. Using the linear programming formulation of the constrained problem, we prove the convergence of the optimal value function of the finite-state model to the optimal value function of the original model. Under further continuity condition on the transition probability of the original model, we also establish a method to compute approximately optimal policies.","PeriodicalId":112948,"journal":{"name":"2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128061332","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Memoryless sampling rate distortion 无记忆采样率失真
Pub Date : 2015-09-01 DOI: 10.1109/ALLERTON.2015.7447105
Vinay Praneeth Boda, P. Narayan
Consider a discrete memoryless multiple source with m component sources. A subset of k ≤ m sources are sampled at each time instant and jointly compressed in order to reconstruct all the m sources under a given distortion criterion. A sampling rate distortion function is characterized for the case of memoryless random sampling with the sampler possibly depending on the source outputs; and the decoder is informed of the sequence of sampled sets. Examining the structure of the optimal sampler, it is shown that deterministic sampling, characterized by a conditional point-mass, suffices. Restricted forms of sampling are also addressed. An upper bound for the sampling rate distortion function is provided when the decoder is not informed of the sequence of sampled sets.
考虑一个具有m个分量源的离散无内存多源。在每个时刻采样k≤m个源的子集并进行联合压缩,以便在给定的失真准则下重构所有m个源。采样率失真函数的特征是用于无记忆随机采样的情况,采样器可能依赖于源输出;解码器被告知采样集的序列。通过对最优采样器结构的检验,表明以条件点质量为特征的确定性采样就足够了。还讨论了抽样的限制形式。当解码器不被告知采样集的序列时,提供采样率失真函数的上界。
{"title":"Memoryless sampling rate distortion","authors":"Vinay Praneeth Boda, P. Narayan","doi":"10.1109/ALLERTON.2015.7447105","DOIUrl":"https://doi.org/10.1109/ALLERTON.2015.7447105","url":null,"abstract":"Consider a discrete memoryless multiple source with m component sources. A subset of k ≤ m sources are sampled at each time instant and jointly compressed in order to reconstruct all the m sources under a given distortion criterion. A sampling rate distortion function is characterized for the case of memoryless random sampling with the sampler possibly depending on the source outputs; and the decoder is informed of the sequence of sampled sets. Examining the structure of the optimal sampler, it is shown that deterministic sampling, characterized by a conditional point-mass, suffices. Restricted forms of sampling are also addressed. An upper bound for the sampling rate distortion function is provided when the decoder is not informed of the sequence of sampled sets.","PeriodicalId":112948,"journal":{"name":"2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125090579","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Near-optimal multi-version codes 近乎最佳的多版本代码
Pub Date : 2015-09-01 DOI: 10.1109/ALLERTON.2015.7447076
M. Khabbazian
Motivated by applications to distributed storage and computing, the multi-version coding problem was formulated by Wang and Cadambe in [4]. In this problem, a client sequently over time stores v independent versions of a message in a storage system with n server nodes. It is assumed that, a message version may not reach some servers, and that each server is unaware of what has been stored in other servers. The problem requires that any c servers must be able to reconstruct their latest common version. An extended multi-version problem introduced in [5] relaxes the above requirement by requiring any c servers to be able to reconstruct their latest common version or any version later than that. The objective in both the original and extended multi-version problem is to minimize the worst case storage cost. In this work, we propose codes for both the multi-version problem and its extension. For the original multi-version coding problem, we show that the storage cost of our proposed codes are near-optimal. For the extended multi-version coding problem, we show that the storage cost of our first algorithm is optimal when v|c - 1. Our second proposed extended multi-version code shows that storage cost of strictly less than one is achievable even when v is 50% larger than c. This is interesting, as the storage cost of existing codes becomes one as soon as v becomes larger than c.
受分布式存储和计算应用的影响,Wang和Cadambe在[4]中提出了多版本编码问题。在这个问题中,客户端在具有n个服务器节点的存储系统中依次存储消息的v个独立版本。假设消息版本可能无法到达某些服务器,并且每个服务器都不知道其他服务器中存储的内容。该问题要求任何c服务器都必须能够重建其最新的公共版本。[5]中引入的扩展多版本问题放宽了上述要求,要求任何c服务器能够重构其最新的通用版本或任何更新的版本。原始多版本问题和扩展多版本问题的目标都是最小化最坏情况下的存储成本。在这项工作中,我们提出了多版本问题及其扩展的代码。对于原始的多版本编码问题,我们证明了我们所提出的编码的存储成本接近最优。对于扩展的多版本编码问题,我们证明了第一种算法的存储成本在v|c - 1时是最优的。我们提出的第二个扩展多版本代码表明,即使v比c大50%,也可以实现严格小于1的存储成本。这很有趣,因为一旦v大于c,现有代码的存储成本就会变为1。
{"title":"Near-optimal multi-version codes","authors":"M. Khabbazian","doi":"10.1109/ALLERTON.2015.7447076","DOIUrl":"https://doi.org/10.1109/ALLERTON.2015.7447076","url":null,"abstract":"Motivated by applications to distributed storage and computing, the multi-version coding problem was formulated by Wang and Cadambe in [4]. In this problem, a client sequently over time stores v independent versions of a message in a storage system with n server nodes. It is assumed that, a message version may not reach some servers, and that each server is unaware of what has been stored in other servers. The problem requires that any c servers must be able to reconstruct their latest common version. An extended multi-version problem introduced in [5] relaxes the above requirement by requiring any c servers to be able to reconstruct their latest common version or any version later than that. The objective in both the original and extended multi-version problem is to minimize the worst case storage cost. In this work, we propose codes for both the multi-version problem and its extension. For the original multi-version coding problem, we show that the storage cost of our proposed codes are near-optimal. For the extended multi-version coding problem, we show that the storage cost of our first algorithm is optimal when v|c - 1. Our second proposed extended multi-version code shows that storage cost of strictly less than one is achievable even when v is 50% larger than c. This is interesting, as the storage cost of existing codes becomes one as soon as v becomes larger than c.","PeriodicalId":112948,"journal":{"name":"2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121134255","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Spatially-coupled codes for write-once memories 一次性写入存储器的空间耦合代码
Pub Date : 2015-09-01 DOI: 10.1109/ALLERTON.2015.7446994
Santhosh Kumar, Avinash Vem, K. Narayanan, H. Pfister
The focus of this article is on low-complexity capacity-achieving coding schemes for write-once memory (WOM) systems. The construction is based on spatially-coupled compound LDGM/LDPC codes. Both noiseless systems and systems with read errors are considered. Compound LDGM/LDPC codes are known to achieve capacity under MAP decoding for the closely related Gelfand-Pinsker problem and their coset decomposition provides an elegant way to encode the messages while simultaneously providing error protection. The application of compound codes to the WOM system is new. The main result is that spatial coupling enables these codes to achieve the capacity region of the 2-write WOM system with low-complexity message-passing encoding and decoding algorithms.
本文的重点是用于一次性写入内存(WOM)系统的低复杂度容量实现编码方案。该结构基于空间耦合的LDGM/LDPC复合规范。研究了无噪声系统和有读错误的系统。已知复合LDGM/LDPC码可以在MAP解码下实现与Gelfand-Pinsker问题密切相关的容量,并且它们的协集分解提供了一种优雅的方式来编码消息,同时提供错误保护。复合码在WOM系统中的应用是一种新方法。主要结果是空间耦合使这些代码能够以低复杂度的消息传递编码和解码算法实现2写WOM系统的容量区域。
{"title":"Spatially-coupled codes for write-once memories","authors":"Santhosh Kumar, Avinash Vem, K. Narayanan, H. Pfister","doi":"10.1109/ALLERTON.2015.7446994","DOIUrl":"https://doi.org/10.1109/ALLERTON.2015.7446994","url":null,"abstract":"The focus of this article is on low-complexity capacity-achieving coding schemes for write-once memory (WOM) systems. The construction is based on spatially-coupled compound LDGM/LDPC codes. Both noiseless systems and systems with read errors are considered. Compound LDGM/LDPC codes are known to achieve capacity under MAP decoding for the closely related Gelfand-Pinsker problem and their coset decomposition provides an elegant way to encode the messages while simultaneously providing error protection. The application of compound codes to the WOM system is new. The main result is that spatial coupling enables these codes to achieve the capacity region of the 2-write WOM system with low-complexity message-passing encoding and decoding algorithms.","PeriodicalId":112948,"journal":{"name":"2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127203978","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Distributed information-theoretic biclustering of two memoryless sources 两个无内存源的分布式信息论双聚类
Pub Date : 2015-09-01 DOI: 10.1109/ALLERTON.2015.7447035
Georg Pichler, P. Piantanida, G. Matz
A novel multi-terminal source coding problem motivated by biclustering applications is investigated. In this setting, two separate encoders observe two dependent memoryless processes Xn and Zn, respectively. The encoders' goal is to find rate-limited functions f(Xn) and g(Zn) that maximize asymptotically the mutual information I(f(Xn); g(Zn)) ≥ nμ. We derive non-trivial inner and outer bounds on the optimal characterization of the achievable rates for this problem. Applications also arise in the context of distributed hypothesis testing against independence under communication constraints.
研究了一种由双聚类应用驱动的新型多终端源编码问题。在此设置中,两个独立的编码器分别观察两个相关的无内存进程Xn和Zn。编码器的目标是找到速率限制函数f(Xn)和g(Zn),使互信息I(f(Xn))渐近最大化;g(Zn))≥nμ。我们导出了该问题可达率最优表征的非平凡内界和外界。应用程序还出现在通信约束下针对独立性的分布式假设检验的上下文中。
{"title":"Distributed information-theoretic biclustering of two memoryless sources","authors":"Georg Pichler, P. Piantanida, G. Matz","doi":"10.1109/ALLERTON.2015.7447035","DOIUrl":"https://doi.org/10.1109/ALLERTON.2015.7447035","url":null,"abstract":"A novel multi-terminal source coding problem motivated by biclustering applications is investigated. In this setting, two separate encoders observe two dependent memoryless processes X<sup>n</sup> and Z<sup>n</sup>, respectively. The encoders' goal is to find rate-limited functions f(X<sup>n</sup>) and g(Z<sup>n</sup>) that maximize asymptotically the mutual information I(f(X<sup>n</sup>); g(Z<sup>n</sup>)) ≥ nμ. We derive non-trivial inner and outer bounds on the optimal characterization of the achievable rates for this problem. Applications also arise in the context of distributed hypothesis testing against independence under communication constraints.","PeriodicalId":112948,"journal":{"name":"2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126695529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
期刊
2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1