首页 > 最新文献

10th International Conference on Network and Service Management (CNSM) and Workshop最新文献

英文 中文
Proactive multi-tenant cache management for virtualized ISP networks 针对虚拟化ISP网络的主动多租户缓存管理
Maxim Claeys, D. Tuncer, J. Famaey, M. Charalambides, Steven Latré, G. Pavlou, F. Turck
The content delivery market has mainly been dominated by large Content Delivery Networks (CDNs) such as Akamai and Limelight. However, CDN traffic exerts a lot of pressure on Internet Service Provider (ISP) networks. Recently, ISPs have begun deploying so-called Telco CDNs, which have many advantages, such as reduced ISP network bandwidth utilization and improved Quality of Service (QoS) by bringing content closer to the end-user. Virtualization of storage and networking resources can enable the ISP to simultaneously lease its Telco CDN infrastructure to multiple third parties, opening up new business models and revenue streams. In this paper, we propose a proactive cache management system for ISP-operated multitenant Telco CDNs. The associated algorithm optimizes content placement and server selection across tenants and users, based on predicted content popularity and the geographical distribution of requests. Based on a Video-on-Demand (VoD) request trace of a leading European telecom operator, the presented algorithm is shown to reduce bandwidth usage by 17% compared to the traditional Least Recently Used (LRU) caching strategy, both inside the network and on the ingress links, while at the same time offering enhanced load balancing capabilities. Increasing the prediction accuracy is shown to have the potential to further improve bandwidth efficiency by up to 79%.
内容交付市场主要由Akamai和Limelight等大型内容交付网络(cdn)主导。然而,CDN流量给ISP (Internet Service Provider)网络带来了很大的压力。最近,互联网服务提供商已经开始部署所谓的电信cdn,它有很多优点,比如降低了互联网服务提供商的网络带宽利用率,并通过拉近最终用户的距离提高了服务质量(QoS)。存储和网络资源的虚拟化可以使ISP同时将其电信CDN基础设施租赁给多个第三方,从而开辟新的业务模式和收入来源。在本文中,我们提出了一种针对isp运营的多租户电信cdn的主动缓存管理系统。相关的算法基于预测的内容流行度和请求的地理分布,优化跨租户和用户的内容放置和服务器选择。基于一家领先的欧洲电信运营商的视频点播(VoD)请求跟踪,所提出的算法与传统的最近最少使用(LRU)缓存策略相比,在网络内部和入口链路上减少了17%的带宽使用,同时提供了增强的负载平衡能力。研究表明,提高预测精度有可能进一步提高带宽效率,最高可达79%。
{"title":"Proactive multi-tenant cache management for virtualized ISP networks","authors":"Maxim Claeys, D. Tuncer, J. Famaey, M. Charalambides, Steven Latré, G. Pavlou, F. Turck","doi":"10.1109/CNSM.2014.7014144","DOIUrl":"https://doi.org/10.1109/CNSM.2014.7014144","url":null,"abstract":"The content delivery market has mainly been dominated by large Content Delivery Networks (CDNs) such as Akamai and Limelight. However, CDN traffic exerts a lot of pressure on Internet Service Provider (ISP) networks. Recently, ISPs have begun deploying so-called Telco CDNs, which have many advantages, such as reduced ISP network bandwidth utilization and improved Quality of Service (QoS) by bringing content closer to the end-user. Virtualization of storage and networking resources can enable the ISP to simultaneously lease its Telco CDN infrastructure to multiple third parties, opening up new business models and revenue streams. In this paper, we propose a proactive cache management system for ISP-operated multitenant Telco CDNs. The associated algorithm optimizes content placement and server selection across tenants and users, based on predicted content popularity and the geographical distribution of requests. Based on a Video-on-Demand (VoD) request trace of a leading European telecom operator, the presented algorithm is shown to reduce bandwidth usage by 17% compared to the traditional Least Recently Used (LRU) caching strategy, both inside the network and on the ingress links, while at the same time offering enhanced load balancing capabilities. Increasing the prediction accuracy is shown to have the potential to further improve bandwidth efficiency by up to 79%.","PeriodicalId":268334,"journal":{"name":"10th International Conference on Network and Service Management (CNSM) and Workshop","volume":"28 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122671792","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 16
HTTP rate adaptive algorithm with high bandwidth utilization HTTP速率自适应算法,带宽利用率高
M. Mushtaq, B. Augustin, A. Mellouk
Video streaming over Hypertext Transfer Protocol (HTTP) is highly dominant due to the availability of Internet support on many devices. The multimedia applications that generate IP traffic should be conducive with efficient utilization of network resources. Adaptive video streaming over HTTP becomes attractive for content service providers, as it not only uses the existing infrastructure of Web downloading (thus saving an extra cost), but it also provides the ability to change the video quality (bitrate) according to dynamic network conditions for increasing the user's perceived Quality of Experience (QoE). Video streaming over HTTP is easier and cheaper to move data closer to network users, and the video file is just like a normal Web object. In this paper, we have proposed a novel rate adaptive streaming algorithm that enhances the user's perceived quality with high bandwidth utilization for on-demand video. The proposed algorithm considers the following metrics in order to adapt the video quality, which are; player buffer, dropped of excess video frames per second (fps), and availability of network bandwidth. The algorithm is evaluated in dynamic real time Internet environment by using the wired and wireless network at the client side.
基于超文本传输协议(HTTP)的视频流在许多设备上具有Internet支持的可用性,因此占据高度主导地位。产生IP流量的多媒体应用应该有利于网络资源的有效利用。HTTP上的自适应视频流对内容服务提供商很有吸引力,因为它不仅使用了现有的Web下载基础设施(从而节省了额外的成本),而且还提供了根据动态网络条件改变视频质量(比特率)的能力,以提高用户感知的体验质量(QoE)。通过HTTP的视频流更容易、更便宜地向网络用户移动数据,并且视频文件就像普通的Web对象一样。在本文中,我们提出了一种新的速率自适应流媒体算法,以提高用户的感知质量和高带宽利用率为点播视频。该算法考虑了以下指标来适应视频质量,它们是;播放器缓冲区,每秒多余视频帧(fps)的丢弃,以及网络带宽的可用性。通过客户端有线和无线网络,在动态实时的Internet环境下对该算法进行了评估。
{"title":"HTTP rate adaptive algorithm with high bandwidth utilization","authors":"M. Mushtaq, B. Augustin, A. Mellouk","doi":"10.1109/CNSM.2014.7014197","DOIUrl":"https://doi.org/10.1109/CNSM.2014.7014197","url":null,"abstract":"Video streaming over Hypertext Transfer Protocol (HTTP) is highly dominant due to the availability of Internet support on many devices. The multimedia applications that generate IP traffic should be conducive with efficient utilization of network resources. Adaptive video streaming over HTTP becomes attractive for content service providers, as it not only uses the existing infrastructure of Web downloading (thus saving an extra cost), but it also provides the ability to change the video quality (bitrate) according to dynamic network conditions for increasing the user's perceived Quality of Experience (QoE). Video streaming over HTTP is easier and cheaper to move data closer to network users, and the video file is just like a normal Web object. In this paper, we have proposed a novel rate adaptive streaming algorithm that enhances the user's perceived quality with high bandwidth utilization for on-demand video. The proposed algorithm considers the following metrics in order to adapt the video quality, which are; player buffer, dropped of excess video frames per second (fps), and availability of network bandwidth. The algorithm is evaluated in dynamic real time Internet environment by using the wired and wireless network at the client side.","PeriodicalId":268334,"journal":{"name":"10th International Conference on Network and Service Management (CNSM) and Workshop","volume":"600 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122905136","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
SAL: Scaling data centers using Smart Address Learning SAL:使用智能地址学习扩展数据中心
Alexander Shpiner, I. Keslassy, Carmi Arad, Tal Mizrahi, Yoram Revah
Multi-tenant data centers provide a cost-effective many-server infrastructure for hosting large-scale applications. These data centers can run multiple virtual machines (VMs) for each tenant, and potentially place any of these VMs on any of the servers. Therefore, for inter-VM communication, they also need to provide a VM resolution method that can quickly determine the server location of any VM. Unfortunately, existing methods suffer from a scalability bottleneck in the network load of the address resolution messages and/or in the size of the resolution tables. In this paper, we propose Smart Address Learning (SAL), a novel approach that expands the scalability of both the network load and the resolution table sizes, making it implementable on faster memory devices. The key property of the approach is to selectively learn the addresses in the resolution tables, by using the fact that the VMs of different tenants do not communicate. We further compare the various resolution methods and analyze the tradeoff between network load and table sizes. We also evaluate our results using real-life trace simulations. Our analysis shows that SAL can reduce both the network load and the resolution table sizes by several orders of magnitude.
多租户数据中心为托管大型应用程序提供了经济高效的多服务器基础设施。这些数据中心可以为每个租户运行多个虚拟机(vm),并可能将这些虚拟机中的任何一个放置在任何服务器上。因此,对于虚拟机之间的通信,还需要提供一种能够快速确定任意虚拟机所在服务器位置的虚拟机解析方法。不幸的是,现有方法在地址解析消息的网络负载和/或解析表的大小方面存在可伸缩性瓶颈。在本文中,我们提出了智能地址学习(SAL),这是一种扩展网络负载和分辨率表大小的可扩展性的新方法,使其可以在更快的内存设备上实现。该方法的关键特性是,利用不同租户的vm不通信这一事实,有选择地学习解析表中的地址。我们进一步比较了各种解析方法,并分析了网络负载和表大小之间的权衡。我们还使用现实生活中的轨迹模拟来评估我们的结果。我们的分析表明,SAL可以将网络负载和分辨率表大小降低几个数量级。
{"title":"SAL: Scaling data centers using Smart Address Learning","authors":"Alexander Shpiner, I. Keslassy, Carmi Arad, Tal Mizrahi, Yoram Revah","doi":"10.1109/CNSM.2014.7014167","DOIUrl":"https://doi.org/10.1109/CNSM.2014.7014167","url":null,"abstract":"Multi-tenant data centers provide a cost-effective many-server infrastructure for hosting large-scale applications. These data centers can run multiple virtual machines (VMs) for each tenant, and potentially place any of these VMs on any of the servers. Therefore, for inter-VM communication, they also need to provide a VM resolution method that can quickly determine the server location of any VM. Unfortunately, existing methods suffer from a scalability bottleneck in the network load of the address resolution messages and/or in the size of the resolution tables. In this paper, we propose Smart Address Learning (SAL), a novel approach that expands the scalability of both the network load and the resolution table sizes, making it implementable on faster memory devices. The key property of the approach is to selectively learn the addresses in the resolution tables, by using the fact that the VMs of different tenants do not communicate. We further compare the various resolution methods and analyze the tradeoff between network load and table sizes. We also evaluate our results using real-life trace simulations. Our analysis shows that SAL can reduce both the network load and the resolution table sizes by several orders of magnitude.","PeriodicalId":268334,"journal":{"name":"10th International Conference on Network and Service Management (CNSM) and Workshop","volume":"71 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126049307","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Network management through graphs in Software Defined Networks 在软件定义网络中通过图进行网络管理
Gustavo Pantuza, Frederico Sampaio, L. Vieira, D. Guedes, M. Vieira
Software Defined Networks (SDN) is an emergent architecture that is dynamic, flexible, manageable, low cost, consistent with the dynamics of the modern applications. This paper shows a network representation model using a graph as the control plane of an SDN controller. The graph approach provides a globally consistent view of the network in real time. Our experiments show that graphs are a reliable representation of the real network, simplifying management in Software Defined Networking.
软件定义网络(SDN)是一种动态、灵活、可管理、低成本、符合现代应用动态的新兴体系结构。本文提出了一种用图形作为SDN控制器控制平面的网络表示模型。图的方法提供了一个全局一致的视图,实时的网络。我们的实验表明,图是真实网络的可靠表示,简化了软件定义网络的管理。
{"title":"Network management through graphs in Software Defined Networks","authors":"Gustavo Pantuza, Frederico Sampaio, L. Vieira, D. Guedes, M. Vieira","doi":"10.1109/CNSM.2014.7014202","DOIUrl":"https://doi.org/10.1109/CNSM.2014.7014202","url":null,"abstract":"Software Defined Networks (SDN) is an emergent architecture that is dynamic, flexible, manageable, low cost, consistent with the dynamics of the modern applications. This paper shows a network representation model using a graph as the control plane of an SDN controller. The graph approach provides a globally consistent view of the network in real time. Our experiments show that graphs are a reliable representation of the real network, simplifying management in Software Defined Networking.","PeriodicalId":268334,"journal":{"name":"10th International Conference on Network and Service Management (CNSM) and Workshop","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122257152","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 17
An analytics approach to traffic analysis in network virtualization 网络虚拟化中流量分析的分析方法
Hui Zhang, J. Rhee, Nipun Arora, Qiang Xu, C. Lumezanu, Guofei Jiang
Network virtualization has been propounded as a diversifying attribute of the future inter-networking paradigm. However, monitoring and troubleshooting operational virtual networks can be a daunting task, due to their size, distributed state, and additional complexity introduced by network virtualization. We propose an analytics approach for the analysis of network traces collected across hypervisors and switches. To re-organize individual trace events into path-wise slices that represent the life-cycle of individual packets, we first present a trace slicing scheme. Then, we develop a path characterization scheme to extract feature matrices from those trace slices. Using those feature metrics, we develop a set of trace analysis algorithms to cluster, rank, query, and verify packet traces. We have developed the analytics approach in a SDN network management tool, and presented evaluation results to show how it can enable visibility and effective problem diagnosis in a SDN network.
网络虚拟化已经被认为是未来互联网络范式的一种多样化属性。然而,由于操作虚拟网络的规模、分布式状态和网络虚拟化带来的额外复杂性,监视和故障排除可能是一项艰巨的任务。我们提出了一种分析方法,用于分析跨管理程序和交换机收集的网络轨迹。为了将单个跟踪事件重新组织成表示单个数据包生命周期的逐路径切片,我们首先提出了一个跟踪切片方案。然后,我们开发了一种路径表征方案,从这些轨迹切片中提取特征矩阵。利用这些特征度量,我们开发了一套跟踪分析算法来聚类、排序、查询和验证数据包跟踪。我们在SDN网络管理工具中开发了分析方法,并给出了评估结果,以显示它如何在SDN网络中实现可见性和有效的问题诊断。
{"title":"An analytics approach to traffic analysis in network virtualization","authors":"Hui Zhang, J. Rhee, Nipun Arora, Qiang Xu, C. Lumezanu, Guofei Jiang","doi":"10.1109/CNSM.2014.7014183","DOIUrl":"https://doi.org/10.1109/CNSM.2014.7014183","url":null,"abstract":"Network virtualization has been propounded as a diversifying attribute of the future inter-networking paradigm. However, monitoring and troubleshooting operational virtual networks can be a daunting task, due to their size, distributed state, and additional complexity introduced by network virtualization. We propose an analytics approach for the analysis of network traces collected across hypervisors and switches. To re-organize individual trace events into path-wise slices that represent the life-cycle of individual packets, we first present a trace slicing scheme. Then, we develop a path characterization scheme to extract feature matrices from those trace slices. Using those feature metrics, we develop a set of trace analysis algorithms to cluster, rank, query, and verify packet traces. We have developed the analytics approach in a SDN network management tool, and presented evaluation results to show how it can enable visibility and effective problem diagnosis in a SDN network.","PeriodicalId":268334,"journal":{"name":"10th International Conference on Network and Service Management (CNSM) and Workshop","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125303721","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Unwanted traffic characterization on IP networks by low interactive honeypot 基于低交互蜜罐的IP网络无用流量表征
Alisson Puska, M. N. Lima, A. Santos
The increasing amount of unwanted traffic on the Internet consumes the available bandwidth on any network connected to it. Despite efforts to address this issue, it is still a challenge to differentiate unwanted traffic. Due to lack of knowledge or investment, organizations fail to implement security policies, such as BCP 38, which helps blocking the flow of unwanted data. This paper presents a method based on lowinteraction honeypots and network telescopes for identification and classification of unwanted traffic on IP networks. Our method aims to be simple and support low cost of deployment. An evaluation employed traces of real environments to show the method effectiveness. Results offer useful information about unwanted traffic, reaching a private network in a simple manner and with the reduced cost to block it.
Internet上不需要的通信量的增加消耗了连接到它的任何网络上的可用带宽。尽管努力解决这个问题,区分不需要的流量仍然是一个挑战。由于缺乏知识或投资,组织无法实现安全策略,例如BCP 38,它有助于阻止不需要的数据流。提出了一种基于低交互蜜罐和网络望远镜的IP网络无用流量识别与分类方法。我们的方法旨在简单和支持低成本的部署。通过对实际环境的跟踪评价,验证了该方法的有效性。结果提供了有关无用流量的有用信息,以简单的方式到达专用网络,并降低了阻止它的成本。
{"title":"Unwanted traffic characterization on IP networks by low interactive honeypot","authors":"Alisson Puska, M. N. Lima, A. Santos","doi":"10.1109/CNSM.2014.7014175","DOIUrl":"https://doi.org/10.1109/CNSM.2014.7014175","url":null,"abstract":"The increasing amount of unwanted traffic on the Internet consumes the available bandwidth on any network connected to it. Despite efforts to address this issue, it is still a challenge to differentiate unwanted traffic. Due to lack of knowledge or investment, organizations fail to implement security policies, such as BCP 38, which helps blocking the flow of unwanted data. This paper presents a method based on lowinteraction honeypots and network telescopes for identification and classification of unwanted traffic on IP networks. Our method aims to be simple and support low cost of deployment. An evaluation employed traces of real environments to show the method effectiveness. Results offer useful information about unwanted traffic, reaching a private network in a simple manner and with the reduced cost to block it.","PeriodicalId":268334,"journal":{"name":"10th International Conference on Network and Service Management (CNSM) and Workshop","volume":"36 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127496408","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Network performance assessment with Quality of experience benchmarks 基于体验质量基准的网络性能评估
D. Mocanu, G. Santandrea, W. Cerroni, F. Callegati, A. Liotta
Today the performance of network services and devices is mainly assessed using Quality of Services (QoS) factors. These provide statistics about the quality of the network behavior but cannot accurately reflect how the unpredictable impairments which might occur in the network end up affecting the perception of the final beneficiary of these services, i.e. the user. This situation arises because QoS-based performance analysis does not capture the combined end-to-end properties of networks and applications. In this paper, we introduce a new network performance methodology based on Quality of Experience benchmarks, whereby we estimate the quality of the service as it is perceived by the user. We illustrate this approach in the context of video streaming services, showing how to evaluate quality degradation in Software Defined Networks. Our approach is better suited to the evaluation of dynamic networks and helps better pinpointing the critical factors that affect the applications the most.
今天,网络服务和设备的性能主要是使用服务质量(QoS)因素来评估的。这些提供了有关网络行为质量的统计数据,但不能准确反映网络中可能发生的不可预测的损害最终如何影响这些服务的最终受益者,即用户的感知。出现这种情况是因为基于qos的性能分析不能捕获网络和应用程序的端到端组合属性。在本文中,我们介绍了一种基于体验质量基准的新的网络性能方法,通过这种方法,我们可以估计用户感知到的服务质量。我们在视频流服务的背景下说明了这种方法,展示了如何评估软件定义网络中的质量退化。我们的方法更适合于动态网络的评估,并有助于更好地确定对应用程序影响最大的关键因素。
{"title":"Network performance assessment with Quality of experience benchmarks","authors":"D. Mocanu, G. Santandrea, W. Cerroni, F. Callegati, A. Liotta","doi":"10.1109/CNSM.2014.7014187","DOIUrl":"https://doi.org/10.1109/CNSM.2014.7014187","url":null,"abstract":"Today the performance of network services and devices is mainly assessed using Quality of Services (QoS) factors. These provide statistics about the quality of the network behavior but cannot accurately reflect how the unpredictable impairments which might occur in the network end up affecting the perception of the final beneficiary of these services, i.e. the user. This situation arises because QoS-based performance analysis does not capture the combined end-to-end properties of networks and applications. In this paper, we introduce a new network performance methodology based on Quality of Experience benchmarks, whereby we estimate the quality of the service as it is perceived by the user. We illustrate this approach in the context of video streaming services, showing how to evaluate quality degradation in Software Defined Networks. Our approach is better suited to the evaluation of dynamic networks and helps better pinpointing the critical factors that affect the applications the most.","PeriodicalId":268334,"journal":{"name":"10th International Conference on Network and Service Management (CNSM) and Workshop","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130509238","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 13
A runtime sharing mechanism for Big Data platforms 大数据平台运行时共享机制
Mark Shtern, Marin Litoiu
In order to extract value from Big Data, a data source provider has to share data among many consumers. As such, data sharing becomes an important feature of Big Data platforms. However, privacy concerns are the key obstacles that prevent organizations from implementing data sharing solutions. Moreover, currently, the data owner is responsible for preparing the data before releasing it to a 3rd party. The preparation of data for release is a complex task and can become an obstacle. In this paper, we propose an ecosystem which enables data sharing responsibilities among producers and consumers and mitigates some of the obstacles.
为了从大数据中提取价值,数据源提供者必须在许多消费者之间共享数据。因此,数据共享成为大数据平台的一个重要特征。然而,隐私问题是阻碍组织实施数据共享解决方案的主要障碍。此外,目前,数据所有者负责在将数据发布给第三方之前准备数据。准备发布数据是一项复杂的任务,可能成为一个障碍。在本文中,我们提出了一个生态系统,使生产者和消费者之间的数据共享责任,并减轻了一些障碍。
{"title":"A runtime sharing mechanism for Big Data platforms","authors":"Mark Shtern, Marin Litoiu","doi":"10.1109/CNSM.2014.7014180","DOIUrl":"https://doi.org/10.1109/CNSM.2014.7014180","url":null,"abstract":"In order to extract value from Big Data, a data source provider has to share data among many consumers. As such, data sharing becomes an important feature of Big Data platforms. However, privacy concerns are the key obstacles that prevent organizations from implementing data sharing solutions. Moreover, currently, the data owner is responsible for preparing the data before releasing it to a 3rd party. The preparation of data for release is a complex task and can become an obstacle. In this paper, we propose an ecosystem which enables data sharing responsibilities among producers and consumers and mitigates some of the obstacles.","PeriodicalId":268334,"journal":{"name":"10th International Conference on Network and Service Management (CNSM) and Workshop","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122996903","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Efficient multi-objective optimization of wireless network problems on wireless testbeds 无线试验台无线网络问题的高效多目标优化
M. Mehari, E. D. Poorter, I. Couckuyt, D. Deschrijver, Jono Vanhie-Van Gerwen, T. Dhaene, I. Moerman
A large amount of research focuses on experimentally optimizing performance of wireless solutions. Finding the optimal performance settings typically requires investigating all possible combinations of design parameters, while the number of required experiments increases exponentially for each considered design parameter. The aim of this paper is to analyze the applicability of global optimization techniques to reduce the optimization time of wireless experimentation. In particular, the paper applies the Efficient Global Optimization (EGO) algorithm implemented in the SUrrogate MOdeling (SUMO) toolbox inside a wireless testbed. The proposed techniques are implemented and evaluated in a wireless testbed using a realistic wireless conference network problem. The performance accuracy and experimentation time of an exhaustively searched experiment is compared against a SUMO optimized experiment. In our proof of concept, the proposed SUMO optimizer reaches 99.51% of the global optimum performance while requiring 10 times less experiments compared to the exhaustive search experiment.
大量的研究集中在实验优化无线解决方案的性能。寻找最佳性能设置通常需要调查所有可能的设计参数组合,而每个考虑的设计参数所需的实验数量呈指数增长。本文的目的是分析全局优化技术在减少无线实验优化时间方面的适用性。特别地,本文应用了代理建模工具箱中实现的高效全局优化算法(EGO)。在一个实际的无线会议网络问题的无线测试平台上,对所提出的技术进行了实现和评估。将穷举搜索实验的性能精度和实验时间与SUMO优化实验进行了比较。在我们的概念验证中,所提出的SUMO优化器达到了99.51%的全局最优性能,而与穷举搜索实验相比,所需的实验次数减少了10倍。
{"title":"Efficient multi-objective optimization of wireless network problems on wireless testbeds","authors":"M. Mehari, E. D. Poorter, I. Couckuyt, D. Deschrijver, Jono Vanhie-Van Gerwen, T. Dhaene, I. Moerman","doi":"10.1109/CNSM.2014.7014161","DOIUrl":"https://doi.org/10.1109/CNSM.2014.7014161","url":null,"abstract":"A large amount of research focuses on experimentally optimizing performance of wireless solutions. Finding the optimal performance settings typically requires investigating all possible combinations of design parameters, while the number of required experiments increases exponentially for each considered design parameter. The aim of this paper is to analyze the applicability of global optimization techniques to reduce the optimization time of wireless experimentation. In particular, the paper applies the Efficient Global Optimization (EGO) algorithm implemented in the SUrrogate MOdeling (SUMO) toolbox inside a wireless testbed. The proposed techniques are implemented and evaluated in a wireless testbed using a realistic wireless conference network problem. The performance accuracy and experimentation time of an exhaustively searched experiment is compared against a SUMO optimized experiment. In our proof of concept, the proposed SUMO optimizer reaches 99.51% of the global optimum performance while requiring 10 times less experiments compared to the exhaustive search experiment.","PeriodicalId":268334,"journal":{"name":"10th International Conference on Network and Service Management (CNSM) and Workshop","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127748688","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
NTCS: A real time flow-based network traffic classification system NTCS:基于实时流的网络流分类系统
S. S. L. Pereira, J. L. C. Silva, J. Maia
This work presents the design and implementation of a real time flow-based network traffic classification system. The classifier monitor acts as a pipeline consisting of three modules: packet capture and preprocessing, flow reassembly, and classification with Machine Learning (ML). The modules are built as concurrent processes with well defined data interfaces between them so that any module can be improved and updated independently. In this pipeline, the flow reassembly function becomes the bottleneck of the performance. In this implementation, was used a efficient method of reassembly which results in a average delivery delay of 0.49 seconds, aproximately. For the classification module, the performances of the K-Nearest Neighbor (KNN), C4.5 Decision Tree, Naive Bayes (NB), Flexible Naive Bayes (FNB) and AdaBoost Ensemble Learning Algorithm are compared in order to validate our approach.
本文提出了一个基于实时流的网络流分类系统的设计与实现。分类器监视器充当由三个模块组成的管道:数据包捕获和预处理,流重组和机器学习(ML)分类。这些模块是作为并发进程构建的,它们之间具有定义良好的数据接口,因此任何模块都可以独立地改进和更新。在该管道中,流重组功能成为性能的瓶颈。在此实现中,采用了一种有效的重组方法,其结果是平均交货延迟约0.49秒。对于分类模块,比较了k -近邻(KNN)、C4.5决策树、朴素贝叶斯(NB)、灵活朴素贝叶斯(FNB)和AdaBoost集成学习算法的性能,以验证我们的方法。
{"title":"NTCS: A real time flow-based network traffic classification system","authors":"S. S. L. Pereira, J. L. C. Silva, J. Maia","doi":"10.1109/CNSM.2014.7014196","DOIUrl":"https://doi.org/10.1109/CNSM.2014.7014196","url":null,"abstract":"This work presents the design and implementation of a real time flow-based network traffic classification system. The classifier monitor acts as a pipeline consisting of three modules: packet capture and preprocessing, flow reassembly, and classification with Machine Learning (ML). The modules are built as concurrent processes with well defined data interfaces between them so that any module can be improved and updated independently. In this pipeline, the flow reassembly function becomes the bottleneck of the performance. In this implementation, was used a efficient method of reassembly which results in a average delivery delay of 0.49 seconds, aproximately. For the classification module, the performances of the K-Nearest Neighbor (KNN), C4.5 Decision Tree, Naive Bayes (NB), Flexible Naive Bayes (FNB) and AdaBoost Ensemble Learning Algorithm are compared in order to validate our approach.","PeriodicalId":268334,"journal":{"name":"10th International Conference on Network and Service Management (CNSM) and Workshop","volume":"199 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115716481","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
期刊
10th International Conference on Network and Service Management (CNSM) and Workshop
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1