首页 > 最新文献

Proceedings 22nd International Conference on Distributed Computing Systems最新文献

英文 中文
Query optimization to meet performance targets for wide area applications 查询优化,以满足广域应用的性能目标
Pub Date : 2002-07-02 DOI: 10.1109/ICDCS.2002.1022264
V. Zadorozhny, L. Raschid
Recent technology advances have enabled mediated query processing with Internet accessible WebSources. A characteristic of WebSources is that their access costs exhibit transient behavior These costs depend on the network and server workloads, which are often affected by, the time of day,, day, etc. Given transient behavior, an appropriate performance target (PT) for a noisy, environment will correspond to "at least X percentage of queries will have a latency of less than T units of time". In this paper we propose an optimizer strategy that is sensitive to the objective of meeting such performance targets (PT). For each query plan, a PT sensitive optimizer uses both the expected value of the cost distribution of the plan, as well as the expected delay, of the plan. We validate our strategy using a simulation based study of the optimizers behavior. We also experimentally validate the optimizer using traces of access costs for real WebSources.
最近的技术进步使得通过Internet可访问的websource进行中介查询处理成为可能。WebSources的一个特点是它们的访问成本表现为瞬态行为,这些成本取决于网络和服务器的工作负载,而这些工作负载通常受时间、时间等因素的影响。给定瞬态行为,对于嘈杂的环境,适当的性能目标(PT)将对应于“至少X百分比的查询将具有小于T个单位时间的延迟”。在本文中,我们提出了一种对满足这些性能目标(PT)的目标敏感的优化器策略。对于每个查询计划,PT敏感优化器既使用计划的成本分布的期望值,也使用计划的预期延迟。我们使用基于优化器行为的模拟研究来验证我们的策略。我们还使用实际WebSources的访问成本跟踪实验验证了优化器。
{"title":"Query optimization to meet performance targets for wide area applications","authors":"V. Zadorozhny, L. Raschid","doi":"10.1109/ICDCS.2002.1022264","DOIUrl":"https://doi.org/10.1109/ICDCS.2002.1022264","url":null,"abstract":"Recent technology advances have enabled mediated query processing with Internet accessible WebSources. A characteristic of WebSources is that their access costs exhibit transient behavior These costs depend on the network and server workloads, which are often affected by, the time of day,, day, etc. Given transient behavior, an appropriate performance target (PT) for a noisy, environment will correspond to \"at least X percentage of queries will have a latency of less than T units of time\". In this paper we propose an optimizer strategy that is sensitive to the objective of meeting such performance targets (PT). For each query plan, a PT sensitive optimizer uses both the expected value of the cost distribution of the plan, as well as the expected delay, of the plan. We validate our strategy using a simulation based study of the optimizers behavior. We also experimentally validate the optimizer using traces of access costs for real WebSources.","PeriodicalId":186210,"journal":{"name":"Proceedings 22nd International Conference on Distributed Computing Systems","volume":"292 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2002-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123744563","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Group-based management of distributed file caches 基于组的分布式文件缓存管理
Pub Date : 2002-07-02 DOI: 10.1109/ICDCS.2002.1022302
A. Amer, D. Long, R. Burns
We describe a way to manage distributed file system caches based upon groups of files that are accessed together. We use file access patterns to automatically construct dynamic groupings of files and then manage our cache by fetching groups, rather than single files. We present experimental results, based on trace-driven workloads, demonstrating that grouping improves cache performance. At the file system client, grouping can reduce LRU demand fetches by 50 to 60%. At the server cache hit rate improvements are much more pronounced, but vary widely (20 to over 1200%) depending upon the capacity of intervening caches. Our treatment includes information theoretic results that justify our approach to file grouping.
我们描述了一种基于一起访问的文件组来管理分布式文件系统缓存的方法。我们使用文件访问模式自动构建文件的动态分组,然后通过获取组(而不是单个文件)来管理缓存。我们给出了基于跟踪驱动的工作负载的实验结果,证明分组可以提高缓存性能。在文件系统客户机上,分组可以将LRU需求读取减少50%到60%。在服务器上,缓存命中率的改进要明显得多,但差异很大(20%到超过1200%),这取决于中间缓存的容量。我们的处理包括证明我们的文件分组方法的信息理论结果。
{"title":"Group-based management of distributed file caches","authors":"A. Amer, D. Long, R. Burns","doi":"10.1109/ICDCS.2002.1022302","DOIUrl":"https://doi.org/10.1109/ICDCS.2002.1022302","url":null,"abstract":"We describe a way to manage distributed file system caches based upon groups of files that are accessed together. We use file access patterns to automatically construct dynamic groupings of files and then manage our cache by fetching groups, rather than single files. We present experimental results, based on trace-driven workloads, demonstrating that grouping improves cache performance. At the file system client, grouping can reduce LRU demand fetches by 50 to 60%. At the server cache hit rate improvements are much more pronounced, but vary widely (20 to over 1200%) depending upon the capacity of intervening caches. Our treatment includes information theoretic results that justify our approach to file grouping.","PeriodicalId":186210,"journal":{"name":"Proceedings 22nd International Conference on Distributed Computing Systems","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2002-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126991620","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 55
Partial database replication using epidemic communication 使用流行通信的部分数据库复制
Pub Date : 2002-07-02 DOI: 10.1109/ICDCS.2002.1022298
J. Holliday, D. Agrawal, A. E. Abbadi
Data replication in distributed databases has been investigated extensively with the hope that it will improve performance, reliability, and availability. However the growth of the Internet has shown us that current replica management do not work well when the replicas are connected by an unreliable network, subject to congestion and dynamic topology changes. In this paper we present a replica update protocol that handles an adaptive partial replication scheme on such a network.
人们对分布式数据库中的数据复制进行了广泛的研究,希望它能提高性能、可靠性和可用性。然而,Internet的发展向我们表明,当副本由不可靠的网络连接时,受拥塞和动态拓扑变化的影响,当前的副本管理不能很好地工作。在本文中,我们提出了一种副本更新协议,用于处理这种网络上的自适应部分复制方案。
{"title":"Partial database replication using epidemic communication","authors":"J. Holliday, D. Agrawal, A. E. Abbadi","doi":"10.1109/ICDCS.2002.1022298","DOIUrl":"https://doi.org/10.1109/ICDCS.2002.1022298","url":null,"abstract":"Data replication in distributed databases has been investigated extensively with the hope that it will improve performance, reliability, and availability. However the growth of the Internet has shown us that current replica management do not work well when the replicas are connected by an unreliable network, subject to congestion and dynamic topology changes. In this paper we present a replica update protocol that handles an adaptive partial replication scheme on such a network.","PeriodicalId":186210,"journal":{"name":"Proceedings 22nd International Conference on Distributed Computing Systems","volume":"222 5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2002-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116016220","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 49
Extending RMI to support dynamic reconfiguration of distributed systems 扩展RMI以支持分布式系统的动态重新配置
Pub Date : 2002-07-02 DOI: 10.1109/ICDCS.2002.1022278
Xuejun Chen
By using dynamic reconfiguration, the flexibility, adaptability, and extensibility of distributed systems are enhanced. Treating interactions among components during dynamic reconfiguration is still one of the most crucial problems in this research area. This challenge should be met by middleware design and development. However, current standard middleware offers little support for dynamic reconfiguration of distributed systems. In this paper, we describe an extended Java RMI that supports efficiently dynamic reconfiguration of distributed systems. This extended Java RMI can automatically monitor and manipulate invocations between components during dynamic reconfiguration. Moreover, the extended Java RMI can automatically switch invocations from remote to local and vice versa.
通过动态重构,增强了分布式系统的灵活性、适应性和可扩展性。如何处理动态重构过程中组件之间的相互作用仍然是该研究领域的关键问题之一。中间件设计和开发应该应对这一挑战。然而,目前的标准中间件很少支持分布式系统的动态重新配置。在本文中,我们描述了一个扩展的Java RMI,它支持分布式系统的有效动态重新配置。这个扩展的Java RMI可以在动态重新配置期间自动监视和操作组件之间的调用。此外,扩展的Java RMI可以自动地将调用从远程切换到本地,反之亦然。
{"title":"Extending RMI to support dynamic reconfiguration of distributed systems","authors":"Xuejun Chen","doi":"10.1109/ICDCS.2002.1022278","DOIUrl":"https://doi.org/10.1109/ICDCS.2002.1022278","url":null,"abstract":"By using dynamic reconfiguration, the flexibility, adaptability, and extensibility of distributed systems are enhanced. Treating interactions among components during dynamic reconfiguration is still one of the most crucial problems in this research area. This challenge should be met by middleware design and development. However, current standard middleware offers little support for dynamic reconfiguration of distributed systems. In this paper, we describe an extended Java RMI that supports efficiently dynamic reconfiguration of distributed systems. This extended Java RMI can automatically monitor and manipulate invocations between components during dynamic reconfiguration. Moreover, the extended Java RMI can automatically switch invocations from remote to local and vice versa.","PeriodicalId":186210,"journal":{"name":"Proceedings 22nd International Conference on Distributed Computing Systems","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2002-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116567775","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 35
Dynamic replica control based on fairly assigned variation of data with weak consistency for loosely coupled distributed systems 松散耦合分布式系统中基于弱一致性数据公平分配的动态副本控制
Pub Date : 2002-07-02 DOI: 10.1109/ICDCS.2002.1022265
T. Yamashita
This paper proposes a replica control method based on a fairly assigned variation of numerical data that has weak consistency for loosely coupled systems managed or used by different organizations. This method dynamically distributes the variation of numerical data to replicas according to their demands while achieving fairness among them. By assigning the variation, a replica can determine the possibility that processed update transactions will be aborted and can notify a client of the possibility even when network partitioning happens. In addition, fairly, assigning the variation of data to replicas enables the disadvantage among replicas caused by asynchronous update to be balanced among replicas. Fairness control for assigning the variation of data is performed by averaging the demands in the variation that are requested by the replicas. Simulation showed that our system can achieve extremely high fairness while processing update transactions at the maximum rate.
本文针对由不同组织管理或使用的松散耦合系统,提出了一种基于具有弱一致性的数值数据的公平分配变量的副本控制方法。该方法将数值数据的变化根据副本的需求动态分配给副本,同时实现了副本之间的公平性。通过分配变量,副本可以确定已处理的更新事务被中止的可能性,并且即使在发生网络分区时也可以通知客户机这种可能性。此外,公平地说,将数据的变化分配给副本,可以在副本之间平衡异步更新导致的副本之间的缺点。分配数据变化的公平性控制是通过对副本请求的变化中的需求进行平均来执行的。仿真结果表明,该系统在以最大速率处理更新事务的同时,可以达到极高的公平性。
{"title":"Dynamic replica control based on fairly assigned variation of data with weak consistency for loosely coupled distributed systems","authors":"T. Yamashita","doi":"10.1109/ICDCS.2002.1022265","DOIUrl":"https://doi.org/10.1109/ICDCS.2002.1022265","url":null,"abstract":"This paper proposes a replica control method based on a fairly assigned variation of numerical data that has weak consistency for loosely coupled systems managed or used by different organizations. This method dynamically distributes the variation of numerical data to replicas according to their demands while achieving fairness among them. By assigning the variation, a replica can determine the possibility that processed update transactions will be aborted and can notify a client of the possibility even when network partitioning happens. In addition, fairly, assigning the variation of data to replicas enables the disadvantage among replicas caused by asynchronous update to be balanced among replicas. Fairness control for assigning the variation of data is performed by averaging the demands in the variation that are requested by the replicas. Simulation showed that our system can achieve extremely high fairness while processing update transactions at the maximum rate.","PeriodicalId":186210,"journal":{"name":"Proceedings 22nd International Conference on Distributed Computing Systems","volume":"45 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2002-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114468030","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Dynamic QoS-aware multimedia service configuration in ubiquitous computing environments 泛在计算环境下的动态qos感知多媒体业务配置
Pub Date : 2002-07-02 DOI: 10.1109/ICDCS.2002.1022268
Xiaohui Gu, K. Nahrstedt
Ubiquitous computing promotes the proliferation of various stationary, embedded and mobile devices interconnected by heterogeneous networks. It leads to a highly dynamic distributed system with many devices and services coming and going frequently. Many emerging distributed multimedia applications are being deployed in such a computing environment. In order to make the experience for a user truly seamless and to provide soft performance guarantees, we must meet the following challenges: (1) users should be able to perform tasks continuously, despite changes of resources, devices and locations; (2) users should be able to efficiently utilize all accessible resources within runtime environments to receive the best possible Quality-of-Service (QoS). In this paper, we propose an integrated QoS-aware service configuration model to address the above problems. The configuration model includes two tiers: (1) service composition tier, which is responsible for choosing and composing current available service components appropriately and coordinating arbitrary interactions between them to achieve the user's objectives; and (2) service distribution tier which is responsible for dividing an application into several partitions and distributing them to different available devices appropriately. Our initial experimental results based on both prototype and simulations show the soundness of our model and algorithms.
无处不在的计算促进了由异构网络相互连接的各种固定、嵌入式和移动设备的扩散。它导致了一个高度动态的分布式系统,其中有许多设备和服务频繁进出。许多新兴的分布式多媒体应用程序都部署在这样的计算环境中。为了让用户的体验真正做到无缝,并提供软性能保证,我们必须面对以下挑战:(1)无论资源、设备和位置如何变化,用户都能够连续地执行任务;(2)用户应该能够有效地利用运行时环境中所有可访问的资源,以获得最佳的服务质量(QoS)。在本文中,我们提出了一个集成的qos感知服务配置模型来解决上述问题。配置模型包括两个层:(1)服务组合层,负责对当前可用的服务组件进行适当的选择和组合,并协调它们之间的任意交互以实现用户的目标;(2)服务分发层,负责将应用程序划分为几个分区,并将它们适当地分发到不同的可用设备上。基于原型和仿真的初步实验结果表明了模型和算法的合理性。
{"title":"Dynamic QoS-aware multimedia service configuration in ubiquitous computing environments","authors":"Xiaohui Gu, K. Nahrstedt","doi":"10.1109/ICDCS.2002.1022268","DOIUrl":"https://doi.org/10.1109/ICDCS.2002.1022268","url":null,"abstract":"Ubiquitous computing promotes the proliferation of various stationary, embedded and mobile devices interconnected by heterogeneous networks. It leads to a highly dynamic distributed system with many devices and services coming and going frequently. Many emerging distributed multimedia applications are being deployed in such a computing environment. In order to make the experience for a user truly seamless and to provide soft performance guarantees, we must meet the following challenges: (1) users should be able to perform tasks continuously, despite changes of resources, devices and locations; (2) users should be able to efficiently utilize all accessible resources within runtime environments to receive the best possible Quality-of-Service (QoS). In this paper, we propose an integrated QoS-aware service configuration model to address the above problems. The configuration model includes two tiers: (1) service composition tier, which is responsible for choosing and composing current available service components appropriately and coordinating arbitrary interactions between them to achieve the user's objectives; and (2) service distribution tier which is responsible for dividing an application into several partitions and distributing them to different available devices appropriately. Our initial experimental results based on both prototype and simulations show the soundness of our model and algorithms.","PeriodicalId":186210,"journal":{"name":"Proceedings 22nd International Conference on Distributed Computing Systems","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2002-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121930630","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 47
A fully distributed framework for cost-sensitive data mining 用于成本敏感数据挖掘的完全分布式框架
Pub Date : 2002-07-02 DOI: 10.1109/ICDCS.2002.1022284
Wei Fan, Haixun Wang, Philip S. Yu, S. Stolfo
We propose a fully distributed system (as compared to centralized and partially distributed systems) for cost-sensitive data mining. Experimental results have shown that this approach achieves higher accuracy than both the centralized and partially distributed learning methods, however, it incurs much less training time, neither communication nor computation overhead.
我们提出了一个完全分布式的系统(与集中式和部分分布式系统相比),用于成本敏感的数据挖掘。实验结果表明,该方法比集中式学习方法和部分分布式学习方法都具有更高的学习精度,而且训练时间少,既不需要通信开销,也不需要计算开销。
{"title":"A fully distributed framework for cost-sensitive data mining","authors":"Wei Fan, Haixun Wang, Philip S. Yu, S. Stolfo","doi":"10.1109/ICDCS.2002.1022284","DOIUrl":"https://doi.org/10.1109/ICDCS.2002.1022284","url":null,"abstract":"We propose a fully distributed system (as compared to centralized and partially distributed systems) for cost-sensitive data mining. Experimental results have shown that this approach achieves higher accuracy than both the centralized and partially distributed learning methods, however, it incurs much less training time, neither communication nor computation overhead.","PeriodicalId":186210,"journal":{"name":"Proceedings 22nd International Conference on Distributed Computing Systems","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2002-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124554405","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
Formally verified Byzantine agreement in presence of link faults 在链路故障的情况下正式验证拜占庭协议
Pub Date : 2002-07-02 DOI: 10.1109/ICDCS.2002.1022311
U. Schmid, Bettina Weiss, J. Rushby
This paper shows that deterministic consensus in synchronous distributed systems with link faults is possible, despite the impossibility result of Gray (1978). Instead of using randomization, we overcome this impossibility by moderately restricting the inconsistency that link faults may cause system-wide. Relying upon a novel hybrid fault model that provides different classes of faults for both nodes and links, we provide a formally verified proof that the m+1-round Byzantine agreement algorithm OMH (Lincoln and Rushby (1993)) requires n > 2f/sub l//sup s/ + f/sub l//sup r/ + f/sub l//sup ra/ + 2(f/sub a/ + f/sub s/) + f/sub o/ + f/sub m/ + m nodes for transparently masking at most f/sub l//sup s/ broadcast and f/sub l//sup r/ receive link faults (including at most f/sub l//sup ra/ arbitrary ones) per node in each round, in addition to at most f/sub a/, f/sub s/, f/sub o/, f/sub m/ arbitrary, symmetric, omission, and manifest node faults, provided that m /spl ges/ f/sub a/ + f/sub o/ + 1. Our approach to modeling link faults is justified by a number of theoretical results, which include tight lower bounds for the required number of nodes and an analysis of the assumption coverage in systems where links fail independently with some probability p.
本文表明,尽管Gray(1978)给出了不可能的结果,但在链路故障的同步分布式系统中,确定性共识是可能的。我们没有使用随机化,而是通过适度限制链路故障可能导致系统范围内的不一致性来克服这种不可能性。基于一种新型的混合故障模型,该模型为节点和链路提供了不同类型的故障,我们提供一个正式验证证明了m + 1轮拜占庭协议算法OMH(林肯和Rushby(1993))需要n > 2 f /子l / /一口s / + f /子l / /一口r / + f /子l / /呷拉/ + 2 (f /子/ + f /子s /) + f /子o / m + f / m / +节点最多透明屏蔽f /子l / l /一口s /广播和f /子/ /一口r /接收链路故障(包括最多f /子l / /呷拉/任意的)每个节点在每一轮中,除了最多f /子/ f / sub s / f /下标o /, f / m /武断,对称、遗漏和明显节点故障,前提是m /spl为/ f/sub a/ + f/sub o/ + 1。我们对链路故障建模的方法得到了许多理论结果的证明,其中包括所需节点数量的严格下界,以及对链路以一定概率p独立故障的系统中的假设覆盖范围的分析。
{"title":"Formally verified Byzantine agreement in presence of link faults","authors":"U. Schmid, Bettina Weiss, J. Rushby","doi":"10.1109/ICDCS.2002.1022311","DOIUrl":"https://doi.org/10.1109/ICDCS.2002.1022311","url":null,"abstract":"This paper shows that deterministic consensus in synchronous distributed systems with link faults is possible, despite the impossibility result of Gray (1978). Instead of using randomization, we overcome this impossibility by moderately restricting the inconsistency that link faults may cause system-wide. Relying upon a novel hybrid fault model that provides different classes of faults for both nodes and links, we provide a formally verified proof that the m+1-round Byzantine agreement algorithm OMH (Lincoln and Rushby (1993)) requires n > 2f/sub l//sup s/ + f/sub l//sup r/ + f/sub l//sup ra/ + 2(f/sub a/ + f/sub s/) + f/sub o/ + f/sub m/ + m nodes for transparently masking at most f/sub l//sup s/ broadcast and f/sub l//sup r/ receive link faults (including at most f/sub l//sup ra/ arbitrary ones) per node in each round, in addition to at most f/sub a/, f/sub s/, f/sub o/, f/sub m/ arbitrary, symmetric, omission, and manifest node faults, provided that m /spl ges/ f/sub a/ + f/sub o/ + 1. Our approach to modeling link faults is justified by a number of theoretical results, which include tight lower bounds for the required number of nodes and an analysis of the assumption coverage in systems where links fail independently with some probability p.","PeriodicalId":186210,"journal":{"name":"Proceedings 22nd International Conference on Distributed Computing Systems","volume":"124 3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2002-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126272225","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 49
Adaptive and virtual reconfigurations for effective dynamic job scheduling in cluster systems 集群系统中有效动态作业调度的自适应和虚拟重构
Pub Date : 2002-07-02 DOI: 10.1109/ICDCS.2002.1022240
Songqing Chen, Li Xiao, Xiaodong Zhang
In a cluster system with dynamic load sharing support, a job submission or migration to a workstation is determined by the availability of CPU and memory resources of the workstation at the time. In such a system, a small number of running jobs with unexpectedly large memory allocation requirements may significantly increase the queuing delay times of the rest of jobs with normal memory requirements, slowing down executions of individual jobs and decreasing the system throughput. We call this phenomenon as the job blocking problem because the big jobs block the execution pace of majority jobs in the cluster. We propose a software method incorporating with dynamic load sharing, which adaptively reserves a small set of workstations through virtual cluster reconfiguration to provide special services to the jobs demanding large memory allocations. This policy implies the principle of shortest-remaining-processing-time policy. As soon as the blocking problem is resolved by the reconfiguration, the system will adaptively switch back to the normal load sharing state. We present three contributions in this study. (1) the conditions to cause the job blocking problem; (2) the adaptive software method in a dynamic load sharing system; and (3) trace-driven simulations. We show that our method can effectively improve the cluster computing performance by quickly resolving the job blocking problem. The effectiveness and performance insights are also analytically verified.
在具有动态负载共享支持的集群系统中,作业提交或迁移到工作站是由工作站当时的CPU和内存资源的可用性决定的。在这样的系统中,少量运行的作业具有出乎意料的大内存分配需求,可能会显著增加其他具有正常内存需求的作业的排队延迟时间,从而减慢单个作业的执行速度并降低系统吞吐量。我们将这种现象称为作业阻塞问题,因为大作业阻塞了集群中大多数作业的执行速度。本文提出了一种结合动态负载共享的软件方法,通过虚拟集群重构自适应地保留少量工作站,为需要大量内存分配的作业提供特殊服务。该策略隐含了剩余处理时间最短策略的原则。一旦重新配置解决了阻塞问题,系统将自适应切换回正常的负载共享状态。在这项研究中,我们提出了三个贡献。(一)造成作业阻塞问题的条件;(2)动态负荷分担系统的自适应软件方法;(3)轨迹驱动仿真。结果表明,该方法能够快速解决作业阻塞问题,有效提高集群计算性能。对有效性和性能的见解也进行了分析验证。
{"title":"Adaptive and virtual reconfigurations for effective dynamic job scheduling in cluster systems","authors":"Songqing Chen, Li Xiao, Xiaodong Zhang","doi":"10.1109/ICDCS.2002.1022240","DOIUrl":"https://doi.org/10.1109/ICDCS.2002.1022240","url":null,"abstract":"In a cluster system with dynamic load sharing support, a job submission or migration to a workstation is determined by the availability of CPU and memory resources of the workstation at the time. In such a system, a small number of running jobs with unexpectedly large memory allocation requirements may significantly increase the queuing delay times of the rest of jobs with normal memory requirements, slowing down executions of individual jobs and decreasing the system throughput. We call this phenomenon as the job blocking problem because the big jobs block the execution pace of majority jobs in the cluster. We propose a software method incorporating with dynamic load sharing, which adaptively reserves a small set of workstations through virtual cluster reconfiguration to provide special services to the jobs demanding large memory allocations. This policy implies the principle of shortest-remaining-processing-time policy. As soon as the blocking problem is resolved by the reconfiguration, the system will adaptively switch back to the normal load sharing state. We present three contributions in this study. (1) the conditions to cause the job blocking problem; (2) the adaptive software method in a dynamic load sharing system; and (3) trace-driven simulations. We show that our method can effectively improve the cluster computing performance by quickly resolving the job blocking problem. The effectiveness and performance insights are also analytically verified.","PeriodicalId":186210,"journal":{"name":"Proceedings 22nd International Conference on Distributed Computing Systems","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2002-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129220319","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 17
Using predeclaration for efficient read-only transaction processing in wireless data broadcast 利用预声明实现无线数据广播中高效的只读事务处理
Pub Date : 2002-07-02 DOI: 10.1109/ICDCS.2002.1022282
SangKeun Lee, C. Hwang, M. Kitsuregawa
Wireless data broadcast allows a large number of users to retrieve data simultaneously in mobile databases, resulting in an efficient way of using the scarce wireless bandwidth. The efficiency of data access methods, however, is limited by an inherent property that data can only be accessed strictly sequentially by users. The paper addresses the issue of ensuring consistency and currency of data items requested in a certain order by wireless read-only transactions. To properly cope with the inherent property of data broadcast, we explore a predeclaration-based query optimization and devise three predeclaration-based transaction processing methods.
无线数据广播允许大量用户同时检索移动数据库中的数据,从而有效地利用稀缺的无线带宽。然而,数据访问方法的效率受到数据只能由用户严格按顺序访问的固有属性的限制。本文解决了无线只读事务中按一定顺序请求的数据项的一致性和流通性问题。为了正确处理数据广播的固有特性,我们探索了一种基于预声明的查询优化方法,并设计了三种基于预声明的事务处理方法。
{"title":"Using predeclaration for efficient read-only transaction processing in wireless data broadcast","authors":"SangKeun Lee, C. Hwang, M. Kitsuregawa","doi":"10.1109/ICDCS.2002.1022282","DOIUrl":"https://doi.org/10.1109/ICDCS.2002.1022282","url":null,"abstract":"Wireless data broadcast allows a large number of users to retrieve data simultaneously in mobile databases, resulting in an efficient way of using the scarce wireless bandwidth. The efficiency of data access methods, however, is limited by an inherent property that data can only be accessed strictly sequentially by users. The paper addresses the issue of ensuring consistency and currency of data items requested in a certain order by wireless read-only transactions. To properly cope with the inherent property of data broadcast, we explore a predeclaration-based query optimization and devise three predeclaration-based transaction processing methods.","PeriodicalId":186210,"journal":{"name":"Proceedings 22nd International Conference on Distributed Computing Systems","volume":"64 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2002-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124807921","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 16
期刊
Proceedings 22nd International Conference on Distributed Computing Systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1