首页 > 最新文献

2015 IEEE 35th International Conference on Distributed Computing Systems最新文献

英文 中文
Towards Understanding the Advertiser's Perspective of Smartphone User Privacy 解读广告主对智能手机用户隐私的看法
Pub Date : 2015-06-01 DOI: 10.1109/ICDCS.2015.37
Yan Wang, Yingying Chen, Fan Ye, J. Yang, Hongbo Liu
Many smartphone apps routinely gather various private user data and send them to advertisers. Despite recent study on protection mechanisms and analysis on apps' behavior, the understanding about the consequences of such privacy losses remains limited. In this paper we investigate how much an advertiser can infer about users' social and community relationships by combining data from multiple applications and across many users. After one month's user study involving about 200 most popular Android apps, we find that an advertiser can infer 90% of the social relationships. We further propose a privacy leakage inference framework and use real mobility traces and Foursquare data to quantify the consequences of privacy leakage. We find that achieving 90% inference accuracy of the social and community relationships requires merely 3 weeks' user data. The discoveries underscore the importance of early adoption of privacy protection mechanisms.
许多智能手机应用程序定期收集各种私人用户数据,并将其发送给广告商。尽管最近对保护机制和应用程序行为的分析进行了研究,但对这种隐私损失的后果的理解仍然有限。在本文中,我们研究了广告商通过结合来自多个应用程序和多个用户的数据可以推断出多少用户的社交和社区关系。在对200个最受欢迎的Android应用进行了一个月的用户研究后,我们发现广告商可以推断出90%的社交关系。我们进一步提出了一个隐私泄露推理框架,并使用真实的移动轨迹和Foursquare数据来量化隐私泄露的后果。我们发现,达到90%的社交和社区关系的推理准确率只需要3周的用户数据。这些发现强调了尽早采用隐私保护机制的重要性。
{"title":"Towards Understanding the Advertiser's Perspective of Smartphone User Privacy","authors":"Yan Wang, Yingying Chen, Fan Ye, J. Yang, Hongbo Liu","doi":"10.1109/ICDCS.2015.37","DOIUrl":"https://doi.org/10.1109/ICDCS.2015.37","url":null,"abstract":"Many smartphone apps routinely gather various private user data and send them to advertisers. Despite recent study on protection mechanisms and analysis on apps' behavior, the understanding about the consequences of such privacy losses remains limited. In this paper we investigate how much an advertiser can infer about users' social and community relationships by combining data from multiple applications and across many users. After one month's user study involving about 200 most popular Android apps, we find that an advertiser can infer 90% of the social relationships. We further propose a privacy leakage inference framework and use real mobility traces and Foursquare data to quantify the consequences of privacy leakage. We find that achieving 90% inference accuracy of the social and community relationships requires merely 3 weeks' user data. The discoveries underscore the importance of early adoption of privacy protection mechanisms.","PeriodicalId":129182,"journal":{"name":"2015 IEEE 35th International Conference on Distributed Computing Systems","volume":"57 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126262095","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
Low Radiation Efficient Wireless Energy Transfer in Wireless Distributed Systems 无线分布式系统中的低辐射高效无线能量传输
Pub Date : 2015-06-01 DOI: 10.1109/ICDCS.2015.28
S. Nikoletseas, Theofanis P. Raptis, C. Raptopoulos
Rapid technological advances in the domain of Wireless Energy Transfer (WET) pave the way for novel methods for energy management in Wireless Distributed Systems and recent research efforts have already started considering network models that take into account these new technologies. In this paper, we follow a new approach in studying the problem of efficiently charging a set of rechargeable nodes using a set of wireless energy chargers, under safety constraints on the electromagnetic radiation incurred. In particular, we define a new charging model that greatly differs from existing models in that it takes into account real technology restrictions of the chargers and nodes of the system, mainly regarding energy limitations. Our model also introduces non-linear constraints (in the time domain), that radically change the nature of the computational problems we consider. In this charging model, we present and study the Low Radiation Efficient Charging Problem (LREC), in which we wish to optimize the amount of "useful" energy transferred from chargers to nodes (under constraints on the maximum level of imposed radiation). We present several fundamental properties of this problem and provide indications of its hardness. Finally, we propose an iterative local improvement heuristic for LREC, which runs in polynomial time and we evaluate its performance via simulation. Our algorithm decouples the computation of the objective function from the computation of the maximum radiation and also does not depend on the exact formula used for the computation of the electromagnetic radiation in each point of the network, achieving good trade-offs between charging efficiency and radiation control, it also exhibits good energy balance properties. We provide extensive simulation results supporting our claims and theoretical results.
无线能量传输(WET)领域的快速技术进步为无线分布式系统中能量管理的新方法铺平了道路,最近的研究工作已经开始考虑考虑这些新技术的网络模型。本文采用一种新的方法研究了在电磁辐射安全约束下,使用一组无线能量充电器对一组可充电节点进行高效充电的问题。特别是,我们定义了一个新的充电模型,它与现有模型有很大的不同,因为它考虑了系统中充电器和节点的实际技术限制,主要是能量限制。我们的模型还引入了非线性约束(在时域),这从根本上改变了我们所考虑的计算问题的性质。在这个充电模型中,我们提出并研究了低辐射效率充电问题(LREC),在这个问题中,我们希望优化从充电器转移到节点的“有用”能量的数量(在最大施加辐射水平的约束下)。我们提出了这个问题的几个基本性质,并指出了它的硬度。最后,我们提出了一种迭代局部改进启发式LREC算法,该算法在多项式时间内运行,并通过仿真对其性能进行了评估。该算法将目标函数的计算与最大辐射的计算解耦,并且不依赖于网络各点电磁辐射计算的精确公式,在充电效率和辐射控制之间实现了良好的权衡,并表现出良好的能量平衡特性。我们提供了大量的模拟结果来支持我们的主张和理论结果。
{"title":"Low Radiation Efficient Wireless Energy Transfer in Wireless Distributed Systems","authors":"S. Nikoletseas, Theofanis P. Raptis, C. Raptopoulos","doi":"10.1109/ICDCS.2015.28","DOIUrl":"https://doi.org/10.1109/ICDCS.2015.28","url":null,"abstract":"Rapid technological advances in the domain of Wireless Energy Transfer (WET) pave the way for novel methods for energy management in Wireless Distributed Systems and recent research efforts have already started considering network models that take into account these new technologies. In this paper, we follow a new approach in studying the problem of efficiently charging a set of rechargeable nodes using a set of wireless energy chargers, under safety constraints on the electromagnetic radiation incurred. In particular, we define a new charging model that greatly differs from existing models in that it takes into account real technology restrictions of the chargers and nodes of the system, mainly regarding energy limitations. Our model also introduces non-linear constraints (in the time domain), that radically change the nature of the computational problems we consider. In this charging model, we present and study the Low Radiation Efficient Charging Problem (LREC), in which we wish to optimize the amount of \"useful\" energy transferred from chargers to nodes (under constraints on the maximum level of imposed radiation). We present several fundamental properties of this problem and provide indications of its hardness. Finally, we propose an iterative local improvement heuristic for LREC, which runs in polynomial time and we evaluate its performance via simulation. Our algorithm decouples the computation of the objective function from the computation of the maximum radiation and also does not depend on the exact formula used for the computation of the electromagnetic radiation in each point of the network, achieving good trade-offs between charging efficiency and radiation control, it also exhibits good energy balance properties. We provide extensive simulation results supporting our claims and theoretical results.","PeriodicalId":129182,"journal":{"name":"2015 IEEE 35th International Conference on Distributed Computing Systems","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131281892","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 47
Multi-tenant Latency Optimization in Erasure-Coded Storage with Differentiated Services erasu - coded存储差异化服务下的多租户时延优化
Pub Date : 2015-06-01 DOI: 10.1109/ICDCS.2015.111
Yu Xiang, Tian Lan, V. Aggarwal, Y. Chen
The effect of coding on content retrieval latency in data center storage system is drawing more and more significant attention these days, and customizing elastic service latency for the tenants is undoubtedly appealing to cloud storage, but it also comes with great technical challenges: due to the lack of analytic latency models for erasure-coded storage, most of the literature is limited to the analysis of average service latency, e.g., [1], [2], having assumptions like homogeneous files, exponential service time distribution [3], fixed erasure codes [4], which is unsuitable for a multi-tenant cloud environment where each tenant has a different latency requirement for accessing files in an erasure-coded, online cloud storage. Optimizing differentiated service delay in an erasure-coded storage system is an open problem. This work considers an erasure-coded storage with multiple tenants and differentiated delay demands, studies two types of service policies, non-preemptive priority queue and weighted queue, quantifying service latency of these policies, propose a novel optimization framework that provides differentiated service latency to meet heterogeneous application requirements in cloud storage.
编码对数据中心存储系统中内容检索延迟的影响越来越受到人们的关注,而为租户定制弹性服务延迟无疑是云存储的一大吸引力,但这也带来了巨大的技术挑战:由于缺乏对擦除编码存储的分析延迟模型,大多数文献仅限于分析平均服务延迟,例如[1],[2],具有同质文件,指数服务时间分布[3],固定擦除码[4]等假设,这不适用于多租户云环境,其中每个租户对访问擦除编码的在线云存储中的文件有不同的延迟需求。在擦除编码存储系统中优化差异化业务延迟是一个有待解决的问题。本文考虑了一种具有多租户和差异化延迟需求的擦除编码存储,研究了非抢占优先队列和加权队列两种服务策略,量化了两种策略的服务延迟,提出了一种新的优化框架,提供差异化的服务延迟,以满足云存储的异构应用需求。
{"title":"Multi-tenant Latency Optimization in Erasure-Coded Storage with Differentiated Services","authors":"Yu Xiang, Tian Lan, V. Aggarwal, Y. Chen","doi":"10.1109/ICDCS.2015.111","DOIUrl":"https://doi.org/10.1109/ICDCS.2015.111","url":null,"abstract":"The effect of coding on content retrieval latency in data center storage system is drawing more and more significant attention these days, and customizing elastic service latency for the tenants is undoubtedly appealing to cloud storage, but it also comes with great technical challenges: due to the lack of analytic latency models for erasure-coded storage, most of the literature is limited to the analysis of average service latency, e.g., [1], [2], having assumptions like homogeneous files, exponential service time distribution [3], fixed erasure codes [4], which is unsuitable for a multi-tenant cloud environment where each tenant has a different latency requirement for accessing files in an erasure-coded, online cloud storage. Optimizing differentiated service delay in an erasure-coded storage system is an open problem. This work considers an erasure-coded storage with multiple tenants and differentiated delay demands, studies two types of service policies, non-preemptive priority queue and weighted queue, quantifying service latency of these policies, propose a novel optimization framework that provides differentiated service latency to meet heterogeneous application requirements in cloud storage.","PeriodicalId":129182,"journal":{"name":"2015 IEEE 35th International Conference on Distributed Computing Systems","volume":"111 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122055720","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
Privacy-Preserving Machine Learning Algorithms for Big Data Systems 大数据系统中保护隐私的机器学习算法
Pub Date : 2015-06-01 DOI: 10.1109/ICDCS.2015.40
Kaihe Xu, Hao Yue, Linke Guo, Yuanxiong Guo, Yuguang Fang
Machine learning has played an increasing important role in big data systems due to its capability of efficiently discovering valuable knowledge and hidden information. Often times big data such as healthcare systems or financial systems may involve with multiple organizations who may have different privacy policy, and may not explicitly share their data publicly while joint data processing may be a must. Thus, how to share big data among distributed data processing entities while mitigating privacy concerns becomes a challenging problem. Traditional methods rely on cryptographic tools and/or randomization to preserve privacy. Unfortunately, this alone may be inadequate for the emerging big data systems because they are mainly designed for traditional small-scale data sets. In this paper, we propose a novel framework to achieve privacy-preserving machine learning where the training data are distributed and each shared data portion is of large volume. Specifically, we utilize the data locality property of Apache Hadoop architecture and only a limited number of cryptographic operations at the Reduce() procedures to achieve privacy-preservation. We show that the proposed scheme is secure in the semi-honest model and use extensive simulations to demonstrate its scalability and correctness.
机器学习在大数据系统中发挥着越来越重要的作用,因为它能够有效地发现有价值的知识和隐藏的信息。通常情况下,医疗保健系统或金融系统等大数据可能涉及多个组织,这些组织可能具有不同的隐私政策,并且可能不会明确地公开共享其数据,而联合数据处理可能是必须的。因此,如何在分布式数据处理实体之间共享大数据,同时减轻隐私问题成为一个具有挑战性的问题。传统的方法依赖于加密工具和/或随机化来保护隐私。不幸的是,对于新兴的大数据系统来说,仅靠这一点可能是不够的,因为它们主要是为传统的小规模数据集设计的。在本文中,我们提出了一个新的框架来实现保护隐私的机器学习,其中训练数据是分布式的,每个共享数据部分都是大容量的。具体来说,我们利用了Apache Hadoop架构的数据局域性属性,并且在Reduce()过程中只进行了有限数量的加密操作来实现隐私保护。我们证明了该方案在半诚实模型下是安全的,并通过大量的仿真来证明其可扩展性和正确性。
{"title":"Privacy-Preserving Machine Learning Algorithms for Big Data Systems","authors":"Kaihe Xu, Hao Yue, Linke Guo, Yuanxiong Guo, Yuguang Fang","doi":"10.1109/ICDCS.2015.40","DOIUrl":"https://doi.org/10.1109/ICDCS.2015.40","url":null,"abstract":"Machine learning has played an increasing important role in big data systems due to its capability of efficiently discovering valuable knowledge and hidden information. Often times big data such as healthcare systems or financial systems may involve with multiple organizations who may have different privacy policy, and may not explicitly share their data publicly while joint data processing may be a must. Thus, how to share big data among distributed data processing entities while mitigating privacy concerns becomes a challenging problem. Traditional methods rely on cryptographic tools and/or randomization to preserve privacy. Unfortunately, this alone may be inadequate for the emerging big data systems because they are mainly designed for traditional small-scale data sets. In this paper, we propose a novel framework to achieve privacy-preserving machine learning where the training data are distributed and each shared data portion is of large volume. Specifically, we utilize the data locality property of Apache Hadoop architecture and only a limited number of cryptographic operations at the Reduce() procedures to achieve privacy-preservation. We show that the proposed scheme is secure in the semi-honest model and use extensive simulations to demonstrate its scalability and correctness.","PeriodicalId":129182,"journal":{"name":"2015 IEEE 35th International Conference on Distributed Computing Systems","volume":"60 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114952381","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 76
Fast Compaction Algorithms for NoSQL Databases NoSQL数据库的快速压缩算法
Pub Date : 2015-06-01 DOI: 10.1109/ICDCS.2015.53
Mainak Ghosh, Indranil Gupta, Shalmoli Gupta, Nirman Kumar
Compaction plays a crucial role in NoSQL systems to ensure a high overall read throughput. In this work, we formally define compaction as an optimization problem that attempts to minimize disk I/O. We prove this problem to be NP-Hard. We then propose a set of algorithms and mathematically analyze upper bounds on worst-case cost. We evaluate the proposed algorithms on real-life workloads. Our results show that our algorithms incur low I/O costs and that a compaction approach using a balanced tree is most preferable.
压缩在NoSQL系统中起着至关重要的作用,以确保较高的总体读吞吐量。在这项工作中,我们正式将压缩定义为试图最小化磁盘I/O的优化问题。我们证明这个问题是np困难的。然后,我们提出了一套算法,并从数学上分析了最坏情况代价的上界。我们在实际工作负载上评估了所提出的算法。我们的结果表明,我们的算法产生较低的I/O成本,并且使用平衡树的压缩方法是最可取的。
{"title":"Fast Compaction Algorithms for NoSQL Databases","authors":"Mainak Ghosh, Indranil Gupta, Shalmoli Gupta, Nirman Kumar","doi":"10.1109/ICDCS.2015.53","DOIUrl":"https://doi.org/10.1109/ICDCS.2015.53","url":null,"abstract":"Compaction plays a crucial role in NoSQL systems to ensure a high overall read throughput. In this work, we formally define compaction as an optimization problem that attempts to minimize disk I/O. We prove this problem to be NP-Hard. We then propose a set of algorithms and mathematically analyze upper bounds on worst-case cost. We evaluate the proposed algorithms on real-life workloads. Our results show that our algorithms incur low I/O costs and that a compaction approach using a balanced tree is most preferable.","PeriodicalId":129182,"journal":{"name":"2015 IEEE 35th International Conference on Distributed Computing Systems","volume":"45 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128223176","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
Towards Energy Efficiency in Heterogeneous Hadoop Clusters by Adaptive Task Assignment 基于自适应任务分配的异构Hadoop集群能效研究
Pub Date : 2015-06-01 DOI: 10.1109/ICDCS.2015.44
Dazhao Cheng, P. Lama, Changjun Jiang, Xiaobo Zhou
The cost of powering servers, storage platforms and related cooling systems has become a major component of the operational costs in big data deployments. Hence, the design of energy-efficient Hadoop clusters has attracted significant research attentions in recent years. However, existing studies do not consider the impact of the complex interplay between workload and hardware heterogeneity on energy efficiency. In this paper, we find that heterogeneity-oblivious task assignment approaches are detrimental to both performance and energy efficiency of Hadoop clusters. Importantly, we make a counterintuitive observation that even heterogeneity-aware techniques that focus on reducing job completion time do not necessarily guarantee energy efficiency. We propose a heterogeneity-aware task assignment approach, E-Ant, that aims to minimize the overall energy consumption in a heterogeneous Hadoop cluster without sacrificing job performance. It adaptively schedules heterogeneous workloads on energy-efficient machines, without a priori knowledge of the workload properties. Furthermore, it provides the flexibility to trade off energy efficiency and job fairness in a Hadoop cluster. E-Ant employs an ant colony optimization approach that generates task assignment solutions based on the feedback of each task's energy consumption reported by Hadoop Task Trackers in an agile way. Experimental results on a heterogeneous cluster with varying hardware capabilities show that E-Ant improves the overall energy savings for a synthetic workload from Microsoft by 17% and 12% compared to Fair Scheduler and Tarazu, respectively.
为服务器、存储平台和相关冷却系统供电的成本已经成为大数据部署中运营成本的主要组成部分。因此,高效节能Hadoop集群的设计在近年来受到了广泛的关注。然而,现有的研究并没有考虑工作负载和硬件异质性之间复杂的相互作用对能源效率的影响。在本文中,我们发现异构无关的任务分配方法对Hadoop集群的性能和能源效率都是有害的。重要的是,我们做了一个反直觉的观察,即使是专注于减少作业完成时间的异构感知技术也不一定能保证能源效率。我们提出了一种异构感知任务分配方法,E-Ant,其目的是在不牺牲任务性能的情况下最小化异构Hadoop集群的总体能耗。它自适应地调度节能机器上的异构工作负载,而无需先验地了解工作负载属性。此外,它还提供了在Hadoop集群中权衡能源效率和工作公平性的灵活性。E-Ant采用蚁群优化方法,根据Hadoop task tracker上报的每个任务能耗反馈,以敏捷的方式生成任务分配方案。在具有不同硬件功能的异构集群上的实验结果表明,与Fair Scheduler和Tarazu相比,E-Ant为来自Microsoft的合成工作负载节省了17%和12%的总能源。
{"title":"Towards Energy Efficiency in Heterogeneous Hadoop Clusters by Adaptive Task Assignment","authors":"Dazhao Cheng, P. Lama, Changjun Jiang, Xiaobo Zhou","doi":"10.1109/ICDCS.2015.44","DOIUrl":"https://doi.org/10.1109/ICDCS.2015.44","url":null,"abstract":"The cost of powering servers, storage platforms and related cooling systems has become a major component of the operational costs in big data deployments. Hence, the design of energy-efficient Hadoop clusters has attracted significant research attentions in recent years. However, existing studies do not consider the impact of the complex interplay between workload and hardware heterogeneity on energy efficiency. In this paper, we find that heterogeneity-oblivious task assignment approaches are detrimental to both performance and energy efficiency of Hadoop clusters. Importantly, we make a counterintuitive observation that even heterogeneity-aware techniques that focus on reducing job completion time do not necessarily guarantee energy efficiency. We propose a heterogeneity-aware task assignment approach, E-Ant, that aims to minimize the overall energy consumption in a heterogeneous Hadoop cluster without sacrificing job performance. It adaptively schedules heterogeneous workloads on energy-efficient machines, without a priori knowledge of the workload properties. Furthermore, it provides the flexibility to trade off energy efficiency and job fairness in a Hadoop cluster. E-Ant employs an ant colony optimization approach that generates task assignment solutions based on the feedback of each task's energy consumption reported by Hadoop Task Trackers in an agile way. Experimental results on a heterogeneous cluster with varying hardware capabilities show that E-Ant improves the overall energy savings for a synthetic workload from Microsoft by 17% and 12% compared to Fair Scheduler and Tarazu, respectively.","PeriodicalId":129182,"journal":{"name":"2015 IEEE 35th International Conference on Distributed Computing Systems","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114676429","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 32
Dynamoth: A Scalable Pub/Sub Middleware for Latency-Constrained Applications in the Cloud Dynamoth:一个可扩展的发布/订阅中间件,用于云中延迟受限的应用程序
Pub Date : 2015-06-01 DOI: 10.1109/ICDCS.2015.56
Julien Gascon-Samson, F. Garcia, Bettina Kemme, J. Kienzle
This paper presents Dynamoth, a dynamic, scalable, channel-based pub/sub middleware targeted at large scale, distributed and latency constrained systems. Our approach provides a software layer that balances the load generated by a high number of publishers, subscribers and messages across multiple, standard pub/sub servers that can be deployed in the Cloud. In order to optimize Cloud infrastructure usage, pub/sub servers can be added or removed as needed. Balancing takes into account the live characteristics of each channel and is done in an hierarchical manner across channels (macro) as well as within individual channels (micro) to maintain acceptable performance and low latencies despite highly varying conditions. Load monitoring is performed in an unintrusive way, and rebalancing employs a lazy approach in order to minimize its temporal impact on performance while ensuring successful and timely delivery of all messages. Extensive real-world experiments that illustrate the practicality of the approach within a massively multiplayer game setting are presented. Results indicate that with a given number of servers, Dynamoth was able to handle 60% more simultaneous clients than the consistent hashing approach, and that it was properly able to deal with highly varying conditions in the context of large workloads.
Dynamoth是一种动态的、可扩展的、基于信道的发布/订阅中间件,针对大规模、分布式和延迟受限的系统。我们的方法提供了一个软件层,它可以平衡多个标准发布/订阅服务器(可以部署在云中)上大量发布者、订阅者和消息所产生的负载。为了优化云基础设施的使用,可以根据需要添加或删除发布/订阅服务器。平衡考虑到每个通道的实时特性,并以跨通道(宏观)和单个通道(微观)的分层方式进行,以便在高度变化的条件下保持可接受的性能和低延迟。负载监视以一种非侵入性的方式执行,而重新平衡采用一种惰性方法,以便在确保成功和及时地传递所有消息的同时,最大限度地减少其对性能的临时影响。大量的现实世界实验说明了该方法在大型多人游戏设置中的实用性。结果表明,对于给定数量的服务器,Dynamoth能够比一致散列方法多处理60%的同时客户机,并且能够在大工作负载上下文中正确地处理高度变化的条件。
{"title":"Dynamoth: A Scalable Pub/Sub Middleware for Latency-Constrained Applications in the Cloud","authors":"Julien Gascon-Samson, F. Garcia, Bettina Kemme, J. Kienzle","doi":"10.1109/ICDCS.2015.56","DOIUrl":"https://doi.org/10.1109/ICDCS.2015.56","url":null,"abstract":"This paper presents Dynamoth, a dynamic, scalable, channel-based pub/sub middleware targeted at large scale, distributed and latency constrained systems. Our approach provides a software layer that balances the load generated by a high number of publishers, subscribers and messages across multiple, standard pub/sub servers that can be deployed in the Cloud. In order to optimize Cloud infrastructure usage, pub/sub servers can be added or removed as needed. Balancing takes into account the live characteristics of each channel and is done in an hierarchical manner across channels (macro) as well as within individual channels (micro) to maintain acceptable performance and low latencies despite highly varying conditions. Load monitoring is performed in an unintrusive way, and rebalancing employs a lazy approach in order to minimize its temporal impact on performance while ensuring successful and timely delivery of all messages. Extensive real-world experiments that illustrate the practicality of the approach within a massively multiplayer game setting are presented. Results indicate that with a given number of servers, Dynamoth was able to handle 60% more simultaneous clients than the consistent hashing approach, and that it was properly able to deal with highly varying conditions in the context of large workloads.","PeriodicalId":129182,"journal":{"name":"2015 IEEE 35th International Conference on Distributed Computing Systems","volume":"57 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116225743","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 46
Improve Quality of Experience for Mobile Instant Video Clip Sharing 提高移动即时视频剪辑分享的体验质量
Pub Date : 2015-06-01 DOI: 10.1109/ICDCS.2015.106
Lei Zhang, Feng Wang, Jiangchuan Liu
With the rapid development of mobile networking and end-terminals, anytime and anywhere data access becomes readily available nowadays. Given the crowd sourced content capturing and sharing, the preferred length becomes shorter and shorter, even for such multimedia content as video. A representative is Twitter's Vine service, which, mainly targeting mobile users, enables them to create ultra-short video clips, and instantly post and share them with their followers. In this paper, we present an initial study on this new generation of instant video clip sharing service enabled by mobile platforms and explore the potentials for its further enhancement. Taking Vine as a case study, we closely investigate its unique user behaviors, revealing how such Vine-enabled anytime anywhere data access patterns differentiate mobile instant video clip sharing from its traditional counterparts. We then formulate a generic scheduling problem to maximize the user watching experience as well as the efficiency on the monetary and energy costs. To better solve it, we divide the problem into two sub problems, specifically, the pre-fetching scheduling problem and the watch-time download scheduling problem, and conquer them separately. We further demonstrate the preliminary evaluation result to show the superiority of our solution. To the best of our knowledge, this is the first work on modeling and optimizing the instant video clip sharing on mobile devices.
随着移动网络和终端的快速发展,随时随地的数据访问变得唾手可得。考虑到众包内容的获取和分享,即使是视频这样的多媒体内容,首选长度也会越来越短。Twitter的Vine服务就是一个代表,该服务主要针对移动用户,使他们能够制作超短视频片段,并立即发布并与关注者分享。在本文中,我们对移动平台支持的新一代即时视频剪辑共享服务进行了初步研究,并探讨了其进一步增强的潜力。以Vine为例,我们仔细研究了其独特的用户行为,揭示了Vine支持的随时随地数据访问模式如何将移动即时视频剪辑共享与传统同行区分开来。然后,我们制定了一个通用的调度问题,以最大限度地提高用户的观看体验以及金钱和能源成本的效率。为了更好地解决这一问题,我们将该问题分为两个子问题,即预取调度问题和观看时间下载调度问题,并分别进行解决。进一步论证了初步评价结果,证明了该方案的优越性。据我们所知,这是第一个在移动设备上建模和优化即时视频剪辑分享的工作。
{"title":"Improve Quality of Experience for Mobile Instant Video Clip Sharing","authors":"Lei Zhang, Feng Wang, Jiangchuan Liu","doi":"10.1109/ICDCS.2015.106","DOIUrl":"https://doi.org/10.1109/ICDCS.2015.106","url":null,"abstract":"With the rapid development of mobile networking and end-terminals, anytime and anywhere data access becomes readily available nowadays. Given the crowd sourced content capturing and sharing, the preferred length becomes shorter and shorter, even for such multimedia content as video. A representative is Twitter's Vine service, which, mainly targeting mobile users, enables them to create ultra-short video clips, and instantly post and share them with their followers. In this paper, we present an initial study on this new generation of instant video clip sharing service enabled by mobile platforms and explore the potentials for its further enhancement. Taking Vine as a case study, we closely investigate its unique user behaviors, revealing how such Vine-enabled anytime anywhere data access patterns differentiate mobile instant video clip sharing from its traditional counterparts. We then formulate a generic scheduling problem to maximize the user watching experience as well as the efficiency on the monetary and energy costs. To better solve it, we divide the problem into two sub problems, specifically, the pre-fetching scheduling problem and the watch-time download scheduling problem, and conquer them separately. We further demonstrate the preliminary evaluation result to show the superiority of our solution. To the best of our knowledge, this is the first work on modeling and optimizing the instant video clip sharing on mobile devices.","PeriodicalId":129182,"journal":{"name":"2015 IEEE 35th International Conference on Distributed Computing Systems","volume":"97 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116322806","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Planning Battery Swapping Stations for Urban Electrical Taxis 城市电动出租车电池更换站规划
Pub Date : 2015-06-01 DOI: 10.1109/ICDCS.2015.87
Yang Wang, Liusheng Huang, Hao Wei, Wei Zheng, Tianbo Gu, Hengchang Liu
Despite the clear benefits of electric vehicles (EVs) in terms of reducing greenhouse gas emissions and traditional energy consumptions, the popularization of EVs remains a challenge in the short run. When considering electric taxis, urban planners must face the additional issue of providing battery swapping services. While previous studies focused on planning battery swapping stations for private EVs, we investigate ways of supporting the upgrade of an entire urban taxi system, with demands differing both in scale and nature. With this insight, we analyze the historical sensing data of taxi routes, and evaluate the battery swapping demand profile, as well as the driving time between positions in the road network. Based on these inputs, we propose a method to calculate an optimized battery swapping station scheme. Our strategies are then evaluated via a real world 366-day, 3,976-taxi dataset. The results show that compared to uniform deployment, our planning scheme reduces the average time-cost by 67.2%.
尽管电动汽车在减少温室气体排放和传统能源消耗方面具有明显的优势,但短期内电动汽车的普及仍然是一个挑战。在考虑电动出租车时,城市规划者必须面对提供电池更换服务的附加问题。以往的研究主要集中在规划私人电动汽车的电池交换站,而我们研究了支持整个城市出租车系统升级的方法,需求在规模和性质上都有所不同。在此基础上,我们分析了出租车路线的历史感知数据,并评估了电池交换需求概况,以及道路网络中不同位置之间的行驶时间。基于这些输入,我们提出了一种计算电池交换站优化方案的方法。然后,我们的策略通过一个真实世界366天、3976辆出租车的数据集进行评估。结果表明,与统一部署相比,我们的规划方案平均时间成本降低了67.2%。
{"title":"Planning Battery Swapping Stations for Urban Electrical Taxis","authors":"Yang Wang, Liusheng Huang, Hao Wei, Wei Zheng, Tianbo Gu, Hengchang Liu","doi":"10.1109/ICDCS.2015.87","DOIUrl":"https://doi.org/10.1109/ICDCS.2015.87","url":null,"abstract":"Despite the clear benefits of electric vehicles (EVs) in terms of reducing greenhouse gas emissions and traditional energy consumptions, the popularization of EVs remains a challenge in the short run. When considering electric taxis, urban planners must face the additional issue of providing battery swapping services. While previous studies focused on planning battery swapping stations for private EVs, we investigate ways of supporting the upgrade of an entire urban taxi system, with demands differing both in scale and nature. With this insight, we analyze the historical sensing data of taxi routes, and evaluate the battery swapping demand profile, as well as the driving time between positions in the road network. Based on these inputs, we propose a method to calculate an optimized battery swapping station scheme. Our strategies are then evaluated via a real world 366-day, 3,976-taxi dataset. The results show that compared to uniform deployment, our planning scheme reduces the average time-cost by 67.2%.","PeriodicalId":129182,"journal":{"name":"2015 IEEE 35th International Conference on Distributed Computing Systems","volume":"102 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124136138","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
The Reachability Query over Distributed Uncertain Graphs 分布不确定图的可达性查询
Pub Date : 2015-06-01 DOI: 10.1109/ICDCS.2015.109
Yurong Cheng, Ye Yuan, Lei Chen, Guoren Wang
Reachability, one of the most fundamental queries over uncertain graphs, which asks the probability that two given query vertices are reachable over an uncertain graph. Although this problem has been widely studied, the existing works are all processed in a single server. However, as graph data becomes larger, it usually cannot be stored in a single server. Moreover, processing probabilistic reachability queries is #P-complete, so the calculation is very expensive even on small graphs. Thus, in this paper, our purpose is to develop efficient distributed strategies to firstly pick out all the maximal subgraphs whose reachability probabilities can be calculated in polynomial time efficiently. After this step, only a small graph remains, and we provide an approximate method. Extensive experimental studies show that our distributed algorithms are efficient and have a low communication cost.
可达性是不确定图上最基本的查询之一,它询问在不确定图上两个给定查询顶点可达的概率。虽然这个问题已经得到了广泛的研究,但现有的工作都是在一个服务器上处理的。然而,随着图形数据变得越来越大,它通常不能存储在单个服务器中。此外,处理概率可达性查询是#P-complete的,因此即使在小图上计算也是非常昂贵的。因此,在本文中,我们的目的是开发有效的分布式策略,首先挑选出所有最大的子图,这些子图的可达概率可以在多项式时间内有效地计算出来。在这一步之后,只剩下一个小图,我们提供了一个近似方法。大量的实验研究表明,我们的分布式算法效率高,通信成本低。
{"title":"The Reachability Query over Distributed Uncertain Graphs","authors":"Yurong Cheng, Ye Yuan, Lei Chen, Guoren Wang","doi":"10.1109/ICDCS.2015.109","DOIUrl":"https://doi.org/10.1109/ICDCS.2015.109","url":null,"abstract":"Reachability, one of the most fundamental queries over uncertain graphs, which asks the probability that two given query vertices are reachable over an uncertain graph. Although this problem has been widely studied, the existing works are all processed in a single server. However, as graph data becomes larger, it usually cannot be stored in a single server. Moreover, processing probabilistic reachability queries is #P-complete, so the calculation is very expensive even on small graphs. Thus, in this paper, our purpose is to develop efficient distributed strategies to firstly pick out all the maximal subgraphs whose reachability probabilities can be calculated in polynomial time efficiently. After this step, only a small graph remains, and we provide an approximate method. Extensive experimental studies show that our distributed algorithms are efficient and have a low communication cost.","PeriodicalId":129182,"journal":{"name":"2015 IEEE 35th International Conference on Distributed Computing Systems","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122435378","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
期刊
2015 IEEE 35th International Conference on Distributed Computing Systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1