{"title":"大规模并行计算中的等价类和条件硬度","authors":"Danupon Nanongkai, Michele Scquizzato","doi":"10.1007/s00446-021-00418-2","DOIUrl":null,"url":null,"abstract":"<p><p>The <i>Massively Parallel Computation</i> (MPC) model serves as a common abstraction of many modern large-scale data processing frameworks, and has been receiving increasingly more attention over the past few years, especially in the context of classical graph problems. So far, the only way to argue lower bounds for this model is to condition on conjectures about the hardness of some specific problems, such as graph connectivity on promise graphs that are either one cycle or two cycles, usually called the <i>one cycle versus two cycles</i> problem. This is unlike the traditional arguments based on conjectures about complexity classes (e.g., <math><mrow><mi>P</mi> <mo>≠</mo> <mi>NP</mi></mrow> </math> ), which are often more robust in the sense that refuting them would lead to groundbreaking algorithms for a whole bunch of problems. In this paper we present connections between problems and classes of problems that allow the latter type of arguments. These connections concern the class of problems solvable in a sublogarithmic amount of rounds in the MPC model, denoted by <math><mrow><mi>MPC</mi> <mo>(</mo> <mi>o</mi> <mo>(</mo> <mo>log</mo> <mi>N</mi> <mo>)</mo> <mo>)</mo></mrow> </math> , and the standard space complexity classes <math><mi>L</mi></math> and <math><mi>NL</mi></math> , and suggest conjectures that are robust in the sense that refuting them would lead to many surprisingly fast new algorithms in the MPC model. We also obtain new conditional lower bounds, and prove new reductions and equivalences between problems in the MPC model. Specifically, our main results are as follows.Lower bounds conditioned on the one cycle versus two cycles conjecture can be instead argued under the <math><mrow><mi>L</mi> <mo>⊈</mo> <mi>MPC</mi> <mo>(</mo> <mi>o</mi> <mo>(</mo> <mo>log</mo> <mi>N</mi> <mo>)</mo> <mo>)</mo></mrow> </math> conjecture: these two assumptions are equivalent, and refuting either of them would lead to <math><mrow><mi>o</mi> <mo>(</mo> <mo>log</mo> <mi>N</mi> <mo>)</mo></mrow> </math> -round MPC algorithms for a large number of challenging problems, including list ranking, minimum cut, and planarity testing. In fact, we show that these problems and many others require asymptotically the same number of rounds as the seemingly much easier problem of distinguishing between a graph being one cycle or two cycles.Many lower bounds previously argued under the one cycle versus two cycles conjecture can be argued under an even more robust (thus harder to refute) conjecture, namely <math><mrow><mi>NL</mi> <mo>⊈</mo> <mi>MPC</mi> <mo>(</mo> <mi>o</mi> <mo>(</mo> <mo>log</mo> <mi>N</mi> <mo>)</mo> <mo>)</mo></mrow> </math> . Refuting this conjecture would lead to <math><mrow><mi>o</mi> <mo>(</mo> <mo>log</mo> <mi>N</mi> <mo>)</mo></mrow> </math> -round MPC algorithms for an even larger set of problems, including all-pairs shortest paths, betweenness centrality, and all aforementioned ones. Lower bounds under this conjecture hold for problems such as perfect matching and network flow.</p>","PeriodicalId":50569,"journal":{"name":"Distributed Computing","volume":"35 1","pages":"165-183"},"PeriodicalIF":1.3000,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8907129/pdf/","citationCount":"0","resultStr":"{\"title\":\"Equivalence classes and conditional hardness in massively parallel computations.\",\"authors\":\"Danupon Nanongkai, Michele Scquizzato\",\"doi\":\"10.1007/s00446-021-00418-2\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>The <i>Massively Parallel Computation</i> (MPC) model serves as a common abstraction of many modern large-scale data processing frameworks, and has been receiving increasingly more attention over the past few years, especially in the context of classical graph problems. So far, the only way to argue lower bounds for this model is to condition on conjectures about the hardness of some specific problems, such as graph connectivity on promise graphs that are either one cycle or two cycles, usually called the <i>one cycle versus two cycles</i> problem. This is unlike the traditional arguments based on conjectures about complexity classes (e.g., <math><mrow><mi>P</mi> <mo>≠</mo> <mi>NP</mi></mrow> </math> ), which are often more robust in the sense that refuting them would lead to groundbreaking algorithms for a whole bunch of problems. In this paper we present connections between problems and classes of problems that allow the latter type of arguments. These connections concern the class of problems solvable in a sublogarithmic amount of rounds in the MPC model, denoted by <math><mrow><mi>MPC</mi> <mo>(</mo> <mi>o</mi> <mo>(</mo> <mo>log</mo> <mi>N</mi> <mo>)</mo> <mo>)</mo></mrow> </math> , and the standard space complexity classes <math><mi>L</mi></math> and <math><mi>NL</mi></math> , and suggest conjectures that are robust in the sense that refuting them would lead to many surprisingly fast new algorithms in the MPC model. We also obtain new conditional lower bounds, and prove new reductions and equivalences between problems in the MPC model. Specifically, our main results are as follows.Lower bounds conditioned on the one cycle versus two cycles conjecture can be instead argued under the <math><mrow><mi>L</mi> <mo>⊈</mo> <mi>MPC</mi> <mo>(</mo> <mi>o</mi> <mo>(</mo> <mo>log</mo> <mi>N</mi> <mo>)</mo> <mo>)</mo></mrow> </math> conjecture: these two assumptions are equivalent, and refuting either of them would lead to <math><mrow><mi>o</mi> <mo>(</mo> <mo>log</mo> <mi>N</mi> <mo>)</mo></mrow> </math> -round MPC algorithms for a large number of challenging problems, including list ranking, minimum cut, and planarity testing. In fact, we show that these problems and many others require asymptotically the same number of rounds as the seemingly much easier problem of distinguishing between a graph being one cycle or two cycles.Many lower bounds previously argued under the one cycle versus two cycles conjecture can be argued under an even more robust (thus harder to refute) conjecture, namely <math><mrow><mi>NL</mi> <mo>⊈</mo> <mi>MPC</mi> <mo>(</mo> <mi>o</mi> <mo>(</mo> <mo>log</mo> <mi>N</mi> <mo>)</mo> <mo>)</mo></mrow> </math> . Refuting this conjecture would lead to <math><mrow><mi>o</mi> <mo>(</mo> <mo>log</mo> <mi>N</mi> <mo>)</mo></mrow> </math> -round MPC algorithms for an even larger set of problems, including all-pairs shortest paths, betweenness centrality, and all aforementioned ones. Lower bounds under this conjecture hold for problems such as perfect matching and network flow.</p>\",\"PeriodicalId\":50569,\"journal\":{\"name\":\"Distributed Computing\",\"volume\":\"35 1\",\"pages\":\"165-183\"},\"PeriodicalIF\":1.3000,\"publicationDate\":\"2022-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8907129/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Distributed Computing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1007/s00446-021-00418-2\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2022/1/20 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, THEORY & METHODS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Distributed Computing","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s00446-021-00418-2","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2022/1/20 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"COMPUTER SCIENCE, THEORY & METHODS","Score":null,"Total":0}
引用次数: 0
摘要
大规模并行计算(MPC)模型是许多现代大规模数据处理框架的通用抽象,在过去几年中受到越来越多的关注,尤其是在经典图问题方面。迄今为止,论证该模型下限的唯一方法是以某些特定问题的难易度猜想为条件,例如单循环或双循环许诺图上的图连通性,通常称为单循环与双循环问题。这与传统的基于复杂度类猜想(如 P ≠ NP)的论证不同,后者通常更稳健,因为反驳它们会为一大堆问题带来突破性的算法。在本文中,我们将介绍允许后一类论证的问题和问题类之间的联系。这些联系涉及在 MPC 模型中可在亚对数回合数内求解的一类问题,用 MPC ( o ( log N ) ) 表示。 以及标准空间复杂度类 L 和 NL,并提出了一些稳健的猜想,即反驳这些猜想会在 MPC 模型中产生许多速度惊人的新算法。我们还获得了新的条件下界,并证明了 MPC 模型中问题间的新还原和等价性。以一个循环与两个循环猜想为条件的下界可以在 L ⊈ MPC ( o ( log N ) ) 猜想下进行论证:这两个假设是等价的,反驳其中任何一个假设都会为大量具有挑战性的问题带来 o ( log N ) 轮 MPC 算法,包括列表排序、最小切割和平面性检验。事实上,我们证明了这些问题和许多其他问题所需的回合数,与区分一个图是一个循环还是两个循环这个看似简单得多的问题所需的回合数渐近相同。以前根据一个循环与两个循环猜想提出的许多下界,可以根据一个更稳健(因此更难反驳)的猜想提出,即 NL ⊈ MPC ( o ( log N ) ) 。反驳这一猜想将为更多问题带来 o ( log N ) 轮 MPC 算法,包括全对最短路径、间度中心性以及上述所有问题。这一猜想下的下界在完全匹配和网络流等问题上也是成立的。
Equivalence classes and conditional hardness in massively parallel computations.
The Massively Parallel Computation (MPC) model serves as a common abstraction of many modern large-scale data processing frameworks, and has been receiving increasingly more attention over the past few years, especially in the context of classical graph problems. So far, the only way to argue lower bounds for this model is to condition on conjectures about the hardness of some specific problems, such as graph connectivity on promise graphs that are either one cycle or two cycles, usually called the one cycle versus two cycles problem. This is unlike the traditional arguments based on conjectures about complexity classes (e.g., ), which are often more robust in the sense that refuting them would lead to groundbreaking algorithms for a whole bunch of problems. In this paper we present connections between problems and classes of problems that allow the latter type of arguments. These connections concern the class of problems solvable in a sublogarithmic amount of rounds in the MPC model, denoted by , and the standard space complexity classes and , and suggest conjectures that are robust in the sense that refuting them would lead to many surprisingly fast new algorithms in the MPC model. We also obtain new conditional lower bounds, and prove new reductions and equivalences between problems in the MPC model. Specifically, our main results are as follows.Lower bounds conditioned on the one cycle versus two cycles conjecture can be instead argued under the conjecture: these two assumptions are equivalent, and refuting either of them would lead to -round MPC algorithms for a large number of challenging problems, including list ranking, minimum cut, and planarity testing. In fact, we show that these problems and many others require asymptotically the same number of rounds as the seemingly much easier problem of distinguishing between a graph being one cycle or two cycles.Many lower bounds previously argued under the one cycle versus two cycles conjecture can be argued under an even more robust (thus harder to refute) conjecture, namely . Refuting this conjecture would lead to -round MPC algorithms for an even larger set of problems, including all-pairs shortest paths, betweenness centrality, and all aforementioned ones. Lower bounds under this conjecture hold for problems such as perfect matching and network flow.
期刊介绍:
The international journal Distributed Computing provides a forum for original and significant contributions to the theory, design, specification and implementation of distributed systems.
Topics covered by the journal include but are not limited to:
design and analysis of distributed algorithms;
multiprocessor and multi-core architectures and algorithms;
synchronization protocols and concurrent programming;
distributed operating systems and middleware;
fault-tolerance, reliability and availability;
architectures and protocols for communication networks and peer-to-peer systems;
security in distributed computing, cryptographic protocols;
mobile, sensor, and ad hoc networks;
internet applications;
concurrency theory;
specification, semantics, verification, and testing of distributed systems.
In general, only original papers will be considered. By virtue of submitting a manuscript to the journal, the authors attest that it has not been published or submitted simultaneously for publication elsewhere. However, papers previously presented in conference proceedings may be submitted in enhanced form. If a paper has appeared previously, in any form, the authors must clearly indicate this and provide an account of the differences between the previously appeared form and the submission.