首页 > 最新文献

2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS)最新文献

英文 中文
Statistical Query Lower Bounds for Robust Estimation of High-Dimensional Gaussians and Gaussian Mixtures 高维高斯和高斯混合鲁棒估计的统计查询下界
Pub Date : 2016-11-10 DOI: 10.1109/FOCS.2017.16
Ilias Diakonikolas, D. Kane, Alistair Stewart
We describe a general technique that yields the first Statistical Query lower bounds} fora range of fundamental high-dimensional learning problems involving Gaussian distributions. Our main results are for the problems of (1) learning Gaussian mixture models (GMMs), and (2) robust (agnostic) learning of a single unknown Gaussian distribution. For each of these problems, we show a super-polynomial gap} between the (information-theoretic)sample complexity and the computational complexity of any} Statistical Query algorithm for the problem. Statistical Query (SQ) algorithms are a class of algorithms that are only allowed to query expectations of functions of the distribution rather than directly access samples. This class of algorithms is quite broad: a wide range of known algorithmic techniques in machine learning are known to be implementable using SQs.Moreover, for the unsupervised learning problems studied in this paper, all known algorithms with non-trivial performance guarantees are SQ or are easily implementable using SQs. Our SQ lower bound for Problem (1)is qualitatively matched by known learning algorithms for GMMs. At a conceptual level, this result implies that – as far as SQ algorithms are concerned – the computational complexity of learning GMMs is inherently exponential in the dimension of the latent space} – even though there is no such information-theoretic barrier. Our lower bound for Problem (2) implies that the accuracy of the robust learning algorithm in cite{DiakonikolasKKLMS16} is essentially best possible among all polynomial-time SQ algorithms. On the positive side, we also give a new (SQ) learning algorithm for Problem (2) achievingthe information-theoretically optimal accuracy, up to a constant factor, whose running time essentially matches our lower bound. Our algorithm relies on a filtering technique generalizing cite{DiakonikolasKKLMS16} that removes outliers based on higher-order tensors.Our SQ lower bounds are attained via a unified moment-matching technique that is useful in other contexts and may be of broader interest. Our technique yields nearly-tight lower bounds for a number of related unsupervised estimation problems. Specifically, for the problems of (3) robust covariance estimation in spectral norm, and (4) robust sparse mean estimation, we establish a quadratic statistical–computational tradeoff} for SQ algorithms, matching known upper bounds. Finally, our technique can be used to obtain tight sample complexitylower bounds for high-dimensional testing} problems. Specifically, for the classical problem of robustly testing} an unknown mean (known covariance) Gaussian, our technique implies an information-theoretic sample lower bound that scales linearly} in the dimension. Our sample lower bound matches the sample complexity of the corresponding robust learning} problem and separates the sample complexity of robust testing from standard (non-robust) testing. This separation is surpri
我们描述了一种通用技术,该技术为涉及高斯分布的一系列基本高维学习问题提供了第一个统计查询下界。我们的主要成果是针对(1)学习高斯混合模型(GMMs)的问题,以及(2)单个未知高斯分布的鲁棒(不可知)学习。对于这些问题中的每一个,我们都展示了(信息论的)样本复杂度和任何统计查询算法的计算复杂度之间的超多项式差距。统计查询(SQ)算法是一类只允许查询分布函数的期望而不能直接访问样本的算法。这类算法非常广泛:机器学习中已知的许多算法技术都可以使用SQs实现。此外,对于本文研究的无监督学习问题,所有具有非平凡性能保证的已知算法都是SQ或易于使用SQ实现。问题(1)的SQ下界与gmm的已知学习算法定性匹配。在概念层面上,这个结果意味着–就SQ算法而言–学习GMMs的计算复杂度在潜在空间的维度上是指数级的}–即使没有这样的信息理论障碍。问题(2)的下界意味着cite{DiakonikolasKKLMS16}中鲁棒学习算法的精度本质上是所有多项式时间SQ算法中最好的。在积极的一面,我们也给出了一个新的(SQ)学习算法的问题(2)实现信息论的最优精度,直到一个常数因子,其运行时间基本上符合我们的下界。我们的算法依赖于一种过滤技术,它泛化cite{DiakonikolasKKLMS16},去除基于高阶张量的异常值。我们的SQ下限是通过统一的矩匹配技术获得的,该技术在其他情况下很有用,可能具有更广泛的意义。我们的技术为许多相关的无监督估计问题提供了近乎严格的下界。具体而言,针对(3)谱范数的鲁棒协方差估计问题和(4)鲁棒稀疏均值估计问题,我们建立了SQ算法的二次统计–计算权衡},匹配已知上界。最后,我们的技术可用于获得高维测试问题的紧密样本复杂度下界。具体来说,对于稳健性测试未知均值(已知协方差)高斯的经典问题,我们的技术意味着在维度上线性扩展的信息论样本下界。我们的样本下界匹配相应鲁棒学习问题的样本复杂度,并将鲁棒测试的样本复杂度从标准(非鲁棒)测试中分离出来。这种分离是令人惊讶的,因为对于相应的学习问题,不存在这样的差距。
{"title":"Statistical Query Lower Bounds for Robust Estimation of High-Dimensional Gaussians and Gaussian Mixtures","authors":"Ilias Diakonikolas, D. Kane, Alistair Stewart","doi":"10.1109/FOCS.2017.16","DOIUrl":"https://doi.org/10.1109/FOCS.2017.16","url":null,"abstract":"We describe a general technique that yields the first Statistical Query lower bounds} fora range of fundamental high-dimensional learning problems involving Gaussian distributions. Our main results are for the problems of (1) learning Gaussian mixture models (GMMs), and (2) robust (agnostic) learning of a single unknown Gaussian distribution. For each of these problems, we show a super-polynomial gap} between the (information-theoretic)sample complexity and the computational complexity of any} Statistical Query algorithm for the problem. Statistical Query (SQ) algorithms are a class of algorithms that are only allowed to query expectations of functions of the distribution rather than directly access samples. This class of algorithms is quite broad: a wide range of known algorithmic techniques in machine learning are known to be implementable using SQs.Moreover, for the unsupervised learning problems studied in this paper, all known algorithms with non-trivial performance guarantees are SQ or are easily implementable using SQs. Our SQ lower bound for Problem (1)is qualitatively matched by known learning algorithms for GMMs. At a conceptual level, this result implies that – as far as SQ algorithms are concerned – the computational complexity of learning GMMs is inherently exponential in the dimension of the latent space} – even though there is no such information-theoretic barrier. Our lower bound for Problem (2) implies that the accuracy of the robust learning algorithm in cite{DiakonikolasKKLMS16} is essentially best possible among all polynomial-time SQ algorithms. On the positive side, we also give a new (SQ) learning algorithm for Problem (2) achievingthe information-theoretically optimal accuracy, up to a constant factor, whose running time essentially matches our lower bound. Our algorithm relies on a filtering technique generalizing cite{DiakonikolasKKLMS16} that removes outliers based on higher-order tensors.Our SQ lower bounds are attained via a unified moment-matching technique that is useful in other contexts and may be of broader interest. Our technique yields nearly-tight lower bounds for a number of related unsupervised estimation problems. Specifically, for the problems of (3) robust covariance estimation in spectral norm, and (4) robust sparse mean estimation, we establish a quadratic statistical–computational tradeoff} for SQ algorithms, matching known upper bounds. Finally, our technique can be used to obtain tight sample complexitylower bounds for high-dimensional testing} problems. Specifically, for the classical problem of robustly testing} an unknown mean (known covariance) Gaussian, our technique implies an information-theoretic sample lower bound that scales linearly} in the dimension. Our sample lower bound matches the sample complexity of the corresponding robust learning} problem and separates the sample complexity of robust testing from standard (non-robust) testing. This separation is surpri","PeriodicalId":311592,"journal":{"name":"2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS)","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125554997","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 191
Oracle-Efficient Online Learning and Auction Design oracle -高效在线学习和拍卖设计
Miroslav Dudík, Nika Haghtalab, Haipeng Luo, R. Schapire, Vasilis Syrgkanis, Jennifer Wortman Vaughan
We consider the design of computationally efficient online learning algorithms in an adversarial setting in which the learner has access to an offline optimization oracle. We present an algorithm called Generalized Followthe- Perturbed-Leader and provide conditions under which it is oracle-efficient while achieving vanishing regret. Our results make significant progress on an open problem raised by Hazan and Koren [1], who showed that oracle-efficient algorithms do not exist in full generality and asked whether one can identify conditions under which oracle-efficient online learning may be possible. Our auction-design framework considers an auctioneer learning an optimal auction for a sequence of adversarially selected valuations with the goal of achieving revenue that is almost as good as the optimal auction in hindsight, among a class of auctions. We give oracle-efficient learning results for: (1) VCG auctions with bidder-specific reserves in singleparameter settings, (2) envy-free item-pricing auctions in multiitem settings, and (3) the level auctions of Morgenstern and Roughgarden [2] for single-item settings. The last result leads to an approximation of the overall optimal Myerson auction when bidders’ valuations are drawn according to a fast-mixing Markov process, extending prior work that only gave such guarantees for the i.i.d. setting.We also derive various extensions, including: (1) oracleefficient algorithms for the contextual learning setting in which the learner has access to side information (such as bidder demographics), (2) learning with approximate oracles such as those based on Maximal-in-Range algorithms, and (3) no-regret bidding algorithms in simultaneous auctions, which resolve an open problem of Daskalakis and Syrgkanis [3].
我们考虑在对抗设置中设计计算效率高的在线学习算法,其中学习者可以访问离线优化oracle。本文提出了一种广义跟随摄动领导者的算法,并给出了该算法在实现后悔消失的同时具有预言效率的条件。我们的研究结果在Hazan和Koren[1]提出的一个开放问题上取得了重大进展,他们表明,oracle-efficient算法并不完全普遍存在,并询问人们是否可以确定在哪些条件下可以实现oracle-efficient在线学习。我们的拍卖设计框架考虑拍卖师学习一系列对抗性选择估值的最优拍卖,其目标是在一类拍卖中实现几乎与后见之明的最优拍卖一样好的收入。我们给出了oracle高效的学习结果:(1)单参数设置下投标人特定储备金的VCG拍卖,(2)多项目设置下无嫉妒物品定价拍卖,以及(3)单项目设置下Morgenstern和Roughgarden[2]的水平拍卖。最后的结果近似于出价人’估值是根据快速混合马尔可夫过程绘制的,扩展了之前只对i.i.d设置提供这种保证的工作。我们还推导了各种扩展,包括:(1)用于上下文学习设置的oracle高效算法,其中学习者可以访问侧信息(例如投标人人口统计数据),(2)使用近似oracle学习,例如基于最大范围算法的算法,以及(3)同步拍卖中的无遗憾竞价算法,该算法解决了Daskalakis和sygkanis的公开问题[3]。
{"title":"Oracle-Efficient Online Learning and Auction Design","authors":"Miroslav Dudík, Nika Haghtalab, Haipeng Luo, R. Schapire, Vasilis Syrgkanis, Jennifer Wortman Vaughan","doi":"10.1145/3402203","DOIUrl":"https://doi.org/10.1145/3402203","url":null,"abstract":"We consider the design of computationally efficient online learning algorithms in an adversarial setting in which the learner has access to an offline optimization oracle. We present an algorithm called Generalized Followthe- Perturbed-Leader and provide conditions under which it is oracle-efficient while achieving vanishing regret. Our results make significant progress on an open problem raised by Hazan and Koren [1], who showed that oracle-efficient algorithms do not exist in full generality and asked whether one can identify conditions under which oracle-efficient online learning may be possible. Our auction-design framework considers an auctioneer learning an optimal auction for a sequence of adversarially selected valuations with the goal of achieving revenue that is almost as good as the optimal auction in hindsight, among a class of auctions. We give oracle-efficient learning results for: (1) VCG auctions with bidder-specific reserves in singleparameter settings, (2) envy-free item-pricing auctions in multiitem settings, and (3) the level auctions of Morgenstern and Roughgarden [2] for single-item settings. The last result leads to an approximation of the overall optimal Myerson auction when bidders’ valuations are drawn according to a fast-mixing Markov process, extending prior work that only gave such guarantees for the i.i.d. setting.We also derive various extensions, including: (1) oracleefficient algorithms for the contextual learning setting in which the learner has access to side information (such as bidder demographics), (2) learning with approximate oracles such as those based on Maximal-in-Range algorithms, and (3) no-regret bidding algorithms in simultaneous auctions, which resolve an open problem of Daskalakis and Syrgkanis [3].","PeriodicalId":311592,"journal":{"name":"2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117285263","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 48
A Dichotomy for Regular Expression Membership Testing 正则表达式隶属性测试的二分法
Pub Date : 2016-11-03 DOI: 10.1109/FOCS.2017.36
K. Bringmann, A. Jørgensen, Kasper Green Larsen
We study regular expression membership testing: Given a regular expression of size m and a string of size n, decide whether the string is in the language described by the regular expression. Its classic O(nm) algorithm is one of the big success stories of the 70s, which allowed pattern matching to develop into the standard tool that it is today.Many special cases of pattern matching have been studied that can be solved faster than in quadratic time. However, a systematic study of tractable cases was made possible only recently, with the first conditional lower bounds reported by Backurs and Indyk [FOCS16]. Restricted to any type of homogeneous regular expressions of depth 2 or 3, they either presented a near-linear time algorithm or a quadratic conditional lower bound, with one exception known as the Word Break problem.In this paper we complete their work as follows:• We present two almost-linear time algorithms that generalize all known almost-linear time algorithms for special cases of regular expression membership testing.• We classify all types, except for the Word Break problem, into almost-linear time or quadratic time assuming the Strong Exponential Time Hypothesis. This extends the classification from depth 2 and 3 to any constant depth.• For the Word Break problem we give an improved O(nm1/3 + m) algorithm. Surprisingly, we also prove a matching conditional lower bound for combinatorial algorithms. This establishes Word Break as the only intermediate problem.In total, we prove matching upper and lower bounds for any type of bounded-depth homogeneous regular expressions, which yields a full dichotomy for regular expression member-ship testing.
我们研究正则表达式的隶属性测试:给定大小为m的正则表达式和大小为n的字符串,判断该字符串是否使用正则表达式所描述的语言。其经典的0 (nm)算法是70年代的一大成功案例,它使模式匹配发展成为今天的标准工具。研究了许多特殊的模式匹配问题,这些问题的求解速度比二次型时间更快。然而,直到最近才有可能对可处理病例进行系统研究,Backurs和Indyk报道了第一个条件下界[FOCS16]。对于深度为2或3的任何类型的齐次正则表达式,他们要么提出了一个近线性时间算法,要么提出了一个二次条件下界,只有一个例外,即所谓的断字问题。本文完成的工作如下:•我们提出了两种近似线性时间算法,它们推广了所有已知的近似线性时间算法,用于正则表达式隶属性测试的特殊情况。•假设强指数时间假设,我们将除断词问题外的所有类型划分为几乎线性时间或二次时间。这将分类从深度2和3扩展到任何恒定深度。•对于断字问题,我们给出了一种改进的O(nm3 /3 + m)算法。令人惊讶的是,我们还证明了组合算法的匹配条件下界。这就确定了Break是唯一的中间问题。总之,我们证明了任何类型的有界深度齐次正则表达式的上界和下界的匹配,从而得到了正则表达式隶属性测试的完全二分类。
{"title":"A Dichotomy for Regular Expression Membership Testing","authors":"K. Bringmann, A. Jørgensen, Kasper Green Larsen","doi":"10.1109/FOCS.2017.36","DOIUrl":"https://doi.org/10.1109/FOCS.2017.36","url":null,"abstract":"We study regular expression membership testing: Given a regular expression of size m and a string of size n, decide whether the string is in the language described by the regular expression. Its classic O(nm) algorithm is one of the big success stories of the 70s, which allowed pattern matching to develop into the standard tool that it is today.Many special cases of pattern matching have been studied that can be solved faster than in quadratic time. However, a systematic study of tractable cases was made possible only recently, with the first conditional lower bounds reported by Backurs and Indyk [FOCS16]. Restricted to any type of homogeneous regular expressions of depth 2 or 3, they either presented a near-linear time algorithm or a quadratic conditional lower bound, with one exception known as the Word Break problem.In this paper we complete their work as follows:• We present two almost-linear time algorithms that generalize all known almost-linear time algorithms for special cases of regular expression membership testing.• We classify all types, except for the Word Break problem, into almost-linear time or quadratic time assuming the Strong Exponential Time Hypothesis. This extends the classification from depth 2 and 3 to any constant depth.• For the Word Break problem we give an improved O(nm1/3 + m) algorithm. Surprisingly, we also prove a matching conditional lower bound for combinatorial algorithms. This establishes Word Break as the only intermediate problem.In total, we prove matching upper and lower bounds for any type of bounded-depth homogeneous regular expressions, which yields a full dichotomy for regular expression member-ship testing.","PeriodicalId":311592,"journal":{"name":"2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121789550","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 47
Optimal Compression of Approximate Inner Products and Dimension Reduction 近似内积的最优压缩与降维
Pub Date : 2016-10-02 DOI: 10.1109/FOCS.2017.65
N. Alon, B. Klartag
Let X be a set of n points of norm at most 1 in the Euclidean space R^k, and suppose ≥0. An ≥-distance sketch for X is a data structure that, given any two points of X enables one to recover the square of the (Euclidean) distance between them up to an additive} error of ≥. Let f(n,k,≥) denote the minimum possible number of bits of such a sketch. Here we determine f(n,k,≥) up to a constant factor for all n ≥ k ≥ 1 and all ≥ ≥ frac{1}{n^{0.49}}. Our proof is algorithmic, and provides an efficient algorithm for computing a sketch of size O(f(n,k,≥)/n) for each point, so that the square of the distance between any two points can be computed from their sketches up to an additive error of ≥ in time linear in the length of the sketches. We also discuss the case of smaller ≥2/√ n and obtain some new results about dimension reduction in this range. In particular, we show that for any such ≥ and any k ≤ t=frac{log (2+≥^2 n)}{≥^2} there are configurations of n points in R^k that cannot be embedded in R^{ℓ} for ℓ
设X是欧氏空间R^k中n个范数不超过1的点的集合,设≥0。X的≥-距离草图是一种数据结构,给定X的任意两点,可以恢复它们之间(欧几里得)距离的平方,直至加性误差≥。设f(n,k,≥)表示这样一个草图的最小可能位数。这里我们确定f(n,k,≥)对于所有n ≥K ≥1和所有≥≥frac{1}{n^{0.49}}。我们的证明是算法的,并提供了一种有效的算法来计算每个点的大小为O(f(n,k,≥)/n)的草图,从而可以从它们的草图中计算任意两点之间距离的平方,直到加性误差为≥在时间上,草图的长度是线性的。我们还讨论了较小的≥2/√并在此范围内得到了一些关于降维的新结果。特别地,我们证明对于任何这样的≥任意k ≤t= frac{log (2+≥^2 n)}{≥^2}存在R^k中n个点的构型不能嵌入到R^{&#x2113中;}For ℓ
{"title":"Optimal Compression of Approximate Inner Products and Dimension Reduction","authors":"N. Alon, B. Klartag","doi":"10.1109/FOCS.2017.65","DOIUrl":"https://doi.org/10.1109/FOCS.2017.65","url":null,"abstract":"Let X be a set of n points of norm at most 1 in the Euclidean space R^k, and suppose ≥0. An ≥-distance sketch for X is a data structure that, given any two points of X enables one to recover the square of the (Euclidean) distance between them up to an additive} error of ≥. Let f(n,k,≥) denote the minimum possible number of bits of such a sketch. Here we determine f(n,k,≥) up to a constant factor for all n ≥ k ≥ 1 and all ≥ ≥ frac{1}{n^{0.49}}. Our proof is algorithmic, and provides an efficient algorithm for computing a sketch of size O(f(n,k,≥)/n) for each point, so that the square of the distance between any two points can be computed from their sketches up to an additive error of ≥ in time linear in the length of the sketches. We also discuss the case of smaller ≥2/√ n and obtain some new results about dimension reduction in this range. In particular, we show that for any such ≥ and any k ≤ t=frac{log (2+≥^2 n)}{≥^2} there are configurations of n points in R^k that cannot be embedded in R^{ℓ} for ℓ","PeriodicalId":311592,"journal":{"name":"2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS)","volume":"64 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115713868","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 43
On the Power of Statistical Zero Knowledge 论统计零知识的力量
Pub Date : 2016-09-09 DOI: 10.1109/FOCS.2017.71
Adam Bouland, Lijie Chen, D. Holden, J. Thaler, Prashant Nalini Vasudevan
We examine the power of statistical zero knowledge proofs (captured by the complexity class SZK) and their variants. First, we give the strongest known relativized evidence that SZK contains hard problems, by exhibiting an oracle relative to which SZK (indeed, even NISZK) is not contained in the class UPP, containing those problems solvable by randomized algorithms with unbounded error. This answers an open question of Watrous from 2002. Second, we lift this oracle separation to the setting of communication complexity, thereby answering a question of Göös et al. (ICALP 2016). Third, we give relativized evidence that perfect zero knowledge proofs (captured by the class PZK) are weaker than general zero knowledge proofs. Specifically, we exhibit oracles which separate SZK from PZK, NISZK from NIPZK and PZK from coPZK. The first of these results answers a question raised in 1991 by Aiello and Håstad (Information and Computation), and the second answers a question of Lovett and Zhang (2016). We also describe additional applications of these results outside of structural complexity.The technical core of our results is a stronger hardness amplification theorem for approximate degree, which roughly says that composing the gapped-majority function with any function of high approximate degree yields a function with high threshold degree.
我们研究了统计零知识证明(由复杂性类SZK捕获)及其变体的力量。首先,我们给出了SZK包含困难问题的已知最强的相对证据,通过展示一个相对于SZK(实际上,甚至是NISZK)不包含在UPP类中的oracle,包含那些由具有无界误差的随机算法可解决的问题。这回答了2002年沃特劳斯提出的一个悬而未决的问题。其次,我们将这种oracle分离提升到通信复杂性的设置,从而回答了Göös等人的问题(ICALP 2016)。第三,我们给出了相对证据,证明完美零知识证明(由类PZK捕获)比一般零知识证明弱。具体来说,我们展示了区分SZK和PZK、NISZK和NIPZK、PZK和coPZK的预言机。这些结果中的第一个回答了Aiello和Håstad(信息与计算)在1991年提出的问题,第二个回答了Lovett和Zhang(2016)提出的问题。我们还描述了这些结果在结构复杂性之外的其他应用。我们研究结果的技术核心是一个更强的近似度的硬度放大定理,粗略地说,用任何高近似度的函数组成间隙多数函数,得到一个高阈值度的函数。
{"title":"On the Power of Statistical Zero Knowledge","authors":"Adam Bouland, Lijie Chen, D. Holden, J. Thaler, Prashant Nalini Vasudevan","doi":"10.1109/FOCS.2017.71","DOIUrl":"https://doi.org/10.1109/FOCS.2017.71","url":null,"abstract":"We examine the power of statistical zero knowledge proofs (captured by the complexity class SZK) and their variants. First, we give the strongest known relativized evidence that SZK contains hard problems, by exhibiting an oracle relative to which SZK (indeed, even NISZK) is not contained in the class UPP, containing those problems solvable by randomized algorithms with unbounded error. This answers an open question of Watrous from 2002. Second, we lift this oracle separation to the setting of communication complexity, thereby answering a question of Göös et al. (ICALP 2016). Third, we give relativized evidence that perfect zero knowledge proofs (captured by the class PZK) are weaker than general zero knowledge proofs. Specifically, we exhibit oracles which separate SZK from PZK, NISZK from NIPZK and PZK from coPZK. The first of these results answers a question raised in 1991 by Aiello and Håstad (Information and Computation), and the second answers a question of Lovett and Zhang (2016). We also describe additional applications of these results outside of structural complexity.The technical core of our results is a stronger hardness amplification theorem for approximate degree, which roughly says that composing the gapped-majority function with any function of high approximate degree yields a function with high threshold degree.","PeriodicalId":311592,"journal":{"name":"2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS)","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128262362","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 28
Optimality of the Johnson-Lindenstrauss Lemma Johnson-Lindenstrauss引理的最优性
Pub Date : 2016-09-07 DOI: 10.1109/FOCS.2017.64
Kasper Green Larsen, Jelani Nelson
For any d, n ≥ 2 and 1=(min{n, d})0.4999
对于任意d, n ≥2和1=(min{n, d})0.4999
{"title":"Optimality of the Johnson-Lindenstrauss Lemma","authors":"Kasper Green Larsen, Jelani Nelson","doi":"10.1109/FOCS.2017.64","DOIUrl":"https://doi.org/10.1109/FOCS.2017.64","url":null,"abstract":"For any d, n ≥ 2 and 1=(min{n, d})0.4999","PeriodicalId":311592,"journal":{"name":"2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS)","volume":"73 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122776853","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 122
First Efficient Convergence for Streaming k-PCA: A Global, Gap-Free, and Near-Optimal Rate 流k-PCA的首次有效收敛:一个全局、无间隙和近最优速率
Pub Date : 2016-07-26 DOI: 10.1109/FOCS.2017.51
Zeyuan Allen-Zhu, Yuanzhi Li
We study streaming principal component analysis (PCA), that is to find, in O(dk) space, the top k eigenvectors of a d× d hidden matrix bold Sigma with online vectors drawn from covariance matrix bold Sigma.We provide global convergence for Ojas algorithm which is popularly used in practice but lacks theoretical understanding for k≈1. We also provide a modified variant mathsf{Oja}^{++} that runs even faster than Ojas. Our results match the information theoretic lower bound in terms of dependency on error, on eigengap, on rank k, and on dimension d, up to poly-log factors. In addition, our convergence rate can be made gap-free, that is proportional to the approximation error and independent of the eigengap.In contrast, for general rank k, before our work (1) it was open to design any algorithm with efficient global convergence rate; and (2) it was open to design any algorithm with (even local) gap-free convergence rate in O(dk) space.
我们研究了流主成分分析(PCA),即在O(dk)空间中找到d×的前k个特征向量;d隐矩阵bold Sigma与从协方差矩阵bold Sigma绘制的在线向量。我们提供了Ojas算法的全局收敛性,该算法在实践中广泛使用,但对k≈1缺乏理论认识。我们还提供了一个修改过的变体mathsf{Oja}^{++},它的运行速度甚至比Ojas还要快。我们的结果在对误差、对特征、对秩k和对维d的依赖方面符合信息理论的下界,直到多对数因子。此外,我们的收敛速度可以是无间隙的,这与近似误差成正比,与特征无关。相比之下,对于一般秩k,在我们的工作(1)之前,可以设计任何具有高效全局收敛率的算法;(2)可以在O(dk)空间中设计任何具有(甚至局部)无间隙收敛率的算法。
{"title":"First Efficient Convergence for Streaming k-PCA: A Global, Gap-Free, and Near-Optimal Rate","authors":"Zeyuan Allen-Zhu, Yuanzhi Li","doi":"10.1109/FOCS.2017.51","DOIUrl":"https://doi.org/10.1109/FOCS.2017.51","url":null,"abstract":"We study streaming principal component analysis (PCA), that is to find, in O(dk) space, the top k eigenvectors of a d× d hidden matrix bold Sigma with online vectors drawn from covariance matrix bold Sigma.We provide global convergence for Ojas algorithm which is popularly used in practice but lacks theoretical understanding for k≈1. We also provide a modified variant mathsf{Oja}^{++} that runs even faster than Ojas. Our results match the information theoretic lower bound in terms of dependency on error, on eigengap, on rank k, and on dimension d, up to poly-log factors. In addition, our convergence rate can be made gap-free, that is proportional to the approximation error and independent of the eigengap.In contrast, for general rank k, before our work (1) it was open to design any algorithm with efficient global convergence rate; and (2) it was open to design any algorithm with (even local) gap-free convergence rate in O(dk) space.","PeriodicalId":311592,"journal":{"name":"2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128500631","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 90
Local Hamiltonians Whose Ground States Are Hard to Approximate 基态难以近似的局部哈密顿量
Pub Date : 2015-10-07 DOI: 10.1109/FOCS.2017.46
Lior Eldar, A. Harrow
Ground states of local Hamiltonians can be generally highly entangled: any quantum circuit that generates them (even approximately) must be sufficiently deep to allow coupling (entanglement) between any pair of qubits. Until now this property was not known to be robust - the marginals of such states to a subset of the qubits containing all but a small constant fraction of them may be only locally entangled, and hence approximable by shallow quantum circuits. In this work we construct a family of 16-local Hamiltonians for which any 1-10^-8 fraction of qubits of any ground state must be highly entangled.This provides evidence that quantum entanglement is not very fragile, and perhaps our intuition about its instability is an artifact of considering local Hamiltonians which are not only local but spatially local. Formally, it provides positive evidence for two wide-open conjectures in condensed-matter physics and quantum complexity theory which are the qLDPC conjecture, positing the existence of good quantum LDPC codes, and the NLTS conjecture due to Freedman and Hastings positing the existence of local Hamiltonians in which any low-energy state is highly-entangled.Our Hamiltonian is based on applying the hypergraph product by Tillich-Zemor to the repetition code with checks from an expander graph. A key tool in our proof is a new lower bound on the vertex expansion of the output of low-depth quantum circuits, which may be of independent interest.
局部哈密顿子的基态通常是高度纠缠的:任何产生它们的量子电路(即使是近似的)必须足够深,以允许任何一对量子位之间的耦合(纠缠)。到目前为止,这种特性还不知道是否具有鲁棒性——除了一小部分恒定的量子比特之外,所有量子比特的子集的这种状态的边缘可能只是局部纠缠,因此可以用浅量子电路近似。在这项工作中,我们构造了一个包含16个局部哈密顿量的族,对于这个族,任何基态的量子位元的任何1-10^-8分数必须是高度纠缠的。这提供了量子纠缠不是很脆弱的证据,也许我们对其不稳定性的直觉是考虑局部哈密顿量的产物,不仅是局部的,而且是空间局部的。在形式上,它为凝聚态物理和量子复杂性理论中的两个大开放猜想提供了积极的证据,即假设存在良好量子LDPC码的qLDPC猜想,以及由于弗里德曼和黑斯廷斯假设存在任何低能态高度纠缠的局部哈密顿量的NLTS猜想。我们的哈密顿量是基于将Tillich-Zemor的超图积应用于具有扩展图检查的重复码。我们证明的一个关键工具是低深度量子电路输出的顶点展开的一个新的下界,这可能是一个独立的兴趣。
{"title":"Local Hamiltonians Whose Ground States Are Hard to Approximate","authors":"Lior Eldar, A. Harrow","doi":"10.1109/FOCS.2017.46","DOIUrl":"https://doi.org/10.1109/FOCS.2017.46","url":null,"abstract":"Ground states of local Hamiltonians can be generally highly entangled: any quantum circuit that generates them (even approximately) must be sufficiently deep to allow coupling (entanglement) between any pair of qubits. Until now this property was not known to be robust - the marginals of such states to a subset of the qubits containing all but a small constant fraction of them may be only locally entangled, and hence approximable by shallow quantum circuits. In this work we construct a family of 16-local Hamiltonians for which any 1-10^-8 fraction of qubits of any ground state must be highly entangled.This provides evidence that quantum entanglement is not very fragile, and perhaps our intuition about its instability is an artifact of considering local Hamiltonians which are not only local but spatially local. Formally, it provides positive evidence for two wide-open conjectures in condensed-matter physics and quantum complexity theory which are the qLDPC conjecture, positing the existence of good quantum LDPC codes, and the NLTS conjecture due to Freedman and Hastings positing the existence of local Hamiltonians in which any low-energy state is highly-entangled.Our Hamiltonian is based on applying the hypergraph product by Tillich-Zemor to the repetition code with checks from an expander graph. A key tool in our proof is a new lower bound on the vertex expansion of the output of low-depth quantum circuits, which may be of independent interest.","PeriodicalId":311592,"journal":{"name":"2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115610658","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 56
期刊
2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1