首页 > 最新文献

2021 IEEE/ACM Symposium on Edge Computing (SEC)最新文献

英文 中文
Federated Learning with Infrastructure Resource Limitations in Vehicular Object Detection 基于基础设施资源限制的车辆目标检测中的联邦学习
Pub Date : 2021-12-01 DOI: 10.1145/3453142.3491412
Yiyue Chen, Chianing Johnny Wang, Baekgyu Kim
Object detection plays an essential role in many vehicular applications such as Advanced Driver Assistance System(ADAS), Dynamic Map, and Obstacle Detection. However, object detection under the traditional centralized machine learning framework, where images transmission utilization of infrastructure resources and privacy concerns about sensitive image content leakage. We introduce Federated Learning, a practical framework that enables machine learning to be conducted in a distributed manner and potentially addresses the traditional centralized machine learning issues by avoiding raw data transmission. However, Federated Learning distributes the pieces of training to the client, which relies on client communication in Vehicular Networks heavily, and not all the clients have the same resources in the real world. Therefore, we study communication and client resource limitation issues where clients have different amounts of local images and compute resources in the Vehicular Federated Learning framework, propose an algorithm to deal with these issues, and design the experiments to prove it. The experimental results show the efficacy of the proposed algorithm, which maintains the object detection precision while improving the 66% training time and reducing 35% communication cost.
物体检测在高级驾驶辅助系统(ADAS)、动态地图和障碍物检测等许多车辆应用中起着至关重要的作用。然而,在传统的集中式机器学习框架下的对象检测中,图像传输中对基础设施资源的利用和隐私的担忧会导致敏感图像内容的泄露。我们介绍了联邦学习,这是一个实用的框架,它使机器学习能够以分布式的方式进行,并通过避免原始数据传输来解决传统的集中式机器学习问题。然而,联邦学习将训练片段分发给客户端,这在很大程度上依赖于车辆网络中的客户端通信,并且在现实世界中并非所有客户端都拥有相同的资源。因此,我们研究了车辆联邦学习框架中客户端具有不同数量的本地图像和计算资源的通信和客户端资源限制问题,提出了一种处理这些问题的算法,并设计了实验来证明它。实验结果表明,该算法在保持目标检测精度的同时,提高了66%的训练时间,减少了35%的通信成本。
{"title":"Federated Learning with Infrastructure Resource Limitations in Vehicular Object Detection","authors":"Yiyue Chen, Chianing Johnny Wang, Baekgyu Kim","doi":"10.1145/3453142.3491412","DOIUrl":"https://doi.org/10.1145/3453142.3491412","url":null,"abstract":"Object detection plays an essential role in many vehicular applications such as Advanced Driver Assistance System(ADAS), Dynamic Map, and Obstacle Detection. However, object detection under the traditional centralized machine learning framework, where images transmission utilization of infrastructure resources and privacy concerns about sensitive image content leakage. We introduce Federated Learning, a practical framework that enables machine learning to be conducted in a distributed manner and potentially addresses the traditional centralized machine learning issues by avoiding raw data transmission. However, Federated Learning distributes the pieces of training to the client, which relies on client communication in Vehicular Networks heavily, and not all the clients have the same resources in the real world. Therefore, we study communication and client resource limitation issues where clients have different amounts of local images and compute resources in the Vehicular Federated Learning framework, propose an algorithm to deal with these issues, and design the experiments to prove it. The experimental results show the efficacy of the proposed algorithm, which maintains the object detection precision while improving the 66% training time and reducing 35% communication cost.","PeriodicalId":6779,"journal":{"name":"2021 IEEE/ACM Symposium on Edge Computing (SEC)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88728561","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
iBranchy: An Accelerated Edge Inference Platform for loT Devices◊ ibranch:用于loT设备的加速边缘推断平台
Pub Date : 2021-12-01 DOI: 10.1145/3453142.3493517
S. Nukavarapu, Mohammed Ayyat, T. Nadeem
With the phenomenal growth of IoT devices at the network edge, many new applications have emerged, including remote health monitoring, augmented reality, and video analytics. However, se-curing these devices from different network attacks has remained a major challenge. To enable more secure services for IoT devices, threats must be discovered quickly in the network edge and effi-ciently dealt with within device resource constraints. Deep Neural Networks (DNN) have emerged as solution to provide both security and high performance. However, existing edge-based IoT DNN clas-sifiers are neither lightweight nor flexible to perform conditional computation based on device types to save edge resources. Dynamic deep neural networks have recently emerged as a technique that can accelerate inference by performing conditional computation and, therefore, save computational resources. In this work, we de-sign and develop an accelerated IoT classifier iBranchy based on a dynamic neural network that can perform quick inference with fewer edge resources while also providing flexibility to adapt to different hardware and network conditions. CCS CONCEPTS • Security and privacy → Mobile and wireless security; • Com-puting methodologies → Neural networks.
随着物联网设备在网络边缘的显著增长,出现了许多新的应用,包括远程健康监控、增强现实和视频分析。然而,保护这些设备免受不同的网络攻击仍然是一个主要的挑战。为了为物联网设备提供更安全的服务,必须在网络边缘快速发现威胁,并在设备资源限制下有效地处理威胁。深度神经网络(Deep Neural Networks, DNN)已成为兼具安全性和高性能的解决方案。然而,现有的基于边缘的物联网DNN分类器既不轻量级也不灵活,无法根据设备类型执行条件计算以节省边缘资源。动态深度神经网络最近作为一种技术出现,它可以通过执行条件计算来加速推理,从而节省计算资源。在这项工作中,我们设计和开发了一个基于动态神经网络的加速物联网分类器iBranchy,它可以用更少的边缘资源执行快速推理,同时还提供了适应不同硬件和网络条件的灵活性。•安全和隐私→移动和无线安全;•计算方法→神经网络。
{"title":"iBranchy: An Accelerated Edge Inference Platform for loT Devices◊","authors":"S. Nukavarapu, Mohammed Ayyat, T. Nadeem","doi":"10.1145/3453142.3493517","DOIUrl":"https://doi.org/10.1145/3453142.3493517","url":null,"abstract":"With the phenomenal growth of IoT devices at the network edge, many new applications have emerged, including remote health monitoring, augmented reality, and video analytics. However, se-curing these devices from different network attacks has remained a major challenge. To enable more secure services for IoT devices, threats must be discovered quickly in the network edge and effi-ciently dealt with within device resource constraints. Deep Neural Networks (DNN) have emerged as solution to provide both security and high performance. However, existing edge-based IoT DNN clas-sifiers are neither lightweight nor flexible to perform conditional computation based on device types to save edge resources. Dynamic deep neural networks have recently emerged as a technique that can accelerate inference by performing conditional computation and, therefore, save computational resources. In this work, we de-sign and develop an accelerated IoT classifier iBranchy based on a dynamic neural network that can perform quick inference with fewer edge resources while also providing flexibility to adapt to different hardware and network conditions. CCS CONCEPTS • Security and privacy → Mobile and wireless security; • Com-puting methodologies → Neural networks.","PeriodicalId":6779,"journal":{"name":"2021 IEEE/ACM Symposium on Edge Computing (SEC)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82701895","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
AggNet: Cost-Aware Aggregation Networks for Geo-distributed Streaming Analytics AggNet:用于地理分布流分析的成本感知聚合网络
Pub Date : 2021-12-01 DOI: 10.1145/3453142.3491276
Dhruv Kumar, Sohaib Ahmad, A. Chandra
Large-scale real-time analytics services continuously collect and analyze data from end-user applications and devices distributed around the globe. Such analytics requires data to be transferred over the wide-area network (WAN) to data centers (DCs) capable of processing the data. Since WAN bandwidth is expensive and scarce, it is beneficial to reduce WAN traffic by partially aggregating the data closer to end-users. We propose aggregation networks for performing aggregation on a geo-distributed edge-cloud infrastructure consisting of edge servers, transit and destination DCs. We identify a rich set of research questions aimed at reducing the traffic costs in an aggregation network. We present an optimization formulation for solving these questions in a principled manner, and use insights from the optimization solutions to propose an efficient, near-optimal practical heuristic. We implement the heuristic in AggNet, built on top of Apache Flink. We evaluate our approach using a geo-distributed deployment on Amazon EC2 as well as a WAN-emulated local testbed. Our evaluation using real-world traces from Twitter and Akamai shows that our approach is able to achieve 47% to 83% reduction in traffic cost over existing baselines without any compromise in timeliness.
大规模实时分析服务持续收集和分析分布在全球各地的终端用户应用程序和设备的数据。这种分析需要将数据通过广域网(WAN)传输到能够处理数据的数据中心(dc)。由于广域网带宽昂贵且稀缺,因此通过在靠近最终用户的地方部分聚合数据来减少广域网流量是有益的。我们提出聚合网络,用于在由边缘服务器、传输数据中心和目标数据中心组成的地理分布式边缘云基础设施上执行聚合。我们确定了一套丰富的研究问题,旨在降低聚合网络中的流量成本。我们提出了一个优化公式,以原则性的方式解决这些问题,并利用优化解决方案的见解来提出一个有效的、接近最优的实用启发式方法。我们在AggNet中实现了启发式算法,AggNet建立在Apache Flink之上。我们使用Amazon EC2上的地理分布式部署以及wan模拟的本地测试平台来评估我们的方法。我们使用来自Twitter和Akamai的真实世界痕迹进行评估,结果表明,我们的方法能够在不影响及时性的情况下,将现有基线的流量成本降低47%至83%。
{"title":"AggNet: Cost-Aware Aggregation Networks for Geo-distributed Streaming Analytics","authors":"Dhruv Kumar, Sohaib Ahmad, A. Chandra","doi":"10.1145/3453142.3491276","DOIUrl":"https://doi.org/10.1145/3453142.3491276","url":null,"abstract":"Large-scale real-time analytics services continuously collect and analyze data from end-user applications and devices distributed around the globe. Such analytics requires data to be transferred over the wide-area network (WAN) to data centers (DCs) capable of processing the data. Since WAN bandwidth is expensive and scarce, it is beneficial to reduce WAN traffic by partially aggregating the data closer to end-users. We propose aggregation networks for performing aggregation on a geo-distributed edge-cloud infrastructure consisting of edge servers, transit and destination DCs. We identify a rich set of research questions aimed at reducing the traffic costs in an aggregation network. We present an optimization formulation for solving these questions in a principled manner, and use insights from the optimization solutions to propose an efficient, near-optimal practical heuristic. We implement the heuristic in AggNet, built on top of Apache Flink. We evaluate our approach using a geo-distributed deployment on Amazon EC2 as well as a WAN-emulated local testbed. Our evaluation using real-world traces from Twitter and Akamai shows that our approach is able to achieve 47% to 83% reduction in traffic cost over existing baselines without any compromise in timeliness.","PeriodicalId":6779,"journal":{"name":"2021 IEEE/ACM Symposium on Edge Computing (SEC)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88513480","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Data-Driven End-to-End Delay Violation Probability Prediction with Extreme Value Mixture Models 基于极值混合模型的数据驱动端到端延迟违反概率预测
Pub Date : 2021-12-01 DOI: 10.1145/3453142.3493506
S. Mostafavi, G. Dán, James Gross
With the advent of edge computing, there is increasing interest in wireless latency-critical services. Such applications require the end-to-end delay of the network infrastructure (communication and computation) to be less than a target delay with a certain probability, e.g., 10-2-10-5. To deal with this guarantee level, the first step is to predict the transient delay violation probability (DVP) of the packets traversing the network. The guarantee level puts a threshold on the tail of the end-to-end delay distribution; thus, it makes data-driven DVP prediction a challenging task. We propose to use the extreme value mixture model in the mixture density network (MDN) method for this task. We implemented it in a multi-hop queuing-theoretic system to predict the DVP of each packet from the network state variables. This work is a first step toward utilizing the DVP predictions, possibly in the resource allocation scheme or queuing discipline. Numerically, we show that our proposed approach outperforms state-of-the-art Gaussian mixture model-based predictors by orders of magnitude, in particular for scenarios with guarantee levels above 10−2.
随着边缘计算的出现,人们对无线延迟关键服务的兴趣越来越大。此类应用要求网络基础设施(通信和计算)的端到端延迟以一定的概率小于目标延迟,例如10-2-10-5。为了处理这一保证级别,首先要预测经过网络的数据包的瞬态延迟违反概率(DVP)。保证级别在端到端延迟分布的尾部设置一个阈值;因此,它使数据驱动的DVP预测成为一项具有挑战性的任务。我们建议使用混合密度网络(MDN)方法中的极值混合模型来完成这项任务。我们在一个多跳队列理论系统中实现它,从网络状态变量中预测每个数据包的DVP。这项工作是利用DVP预测的第一步,可能在资源分配方案或排队规则中。在数值上,我们表明我们提出的方法在数量级上优于最先进的基于高斯混合模型的预测器,特别是对于保证水平高于10−2的场景。
{"title":"Data-Driven End-to-End Delay Violation Probability Prediction with Extreme Value Mixture Models","authors":"S. Mostafavi, G. Dán, James Gross","doi":"10.1145/3453142.3493506","DOIUrl":"https://doi.org/10.1145/3453142.3493506","url":null,"abstract":"With the advent of edge computing, there is increasing interest in wireless latency-critical services. Such applications require the end-to-end delay of the network infrastructure (communication and computation) to be less than a target delay with a certain probability, e.g., 10-2-10-5. To deal with this guarantee level, the first step is to predict the transient delay violation probability (DVP) of the packets traversing the network. The guarantee level puts a threshold on the tail of the end-to-end delay distribution; thus, it makes data-driven DVP prediction a challenging task. We propose to use the extreme value mixture model in the mixture density network (MDN) method for this task. We implemented it in a multi-hop queuing-theoretic system to predict the DVP of each packet from the network state variables. This work is a first step toward utilizing the DVP predictions, possibly in the resource allocation scheme or queuing discipline. Numerically, we show that our proposed approach outperforms state-of-the-art Gaussian mixture model-based predictors by orders of magnitude, in particular for scenarios with guarantee levels above 10−2.","PeriodicalId":6779,"journal":{"name":"2021 IEEE/ACM Symposium on Edge Computing (SEC)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88117577","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Edge-Assisted Collaborative Perception in Autonomous Driving: A Reflection on Communication Design 自动驾驶中的边缘辅助协同感知:对通信设计的思考
Pub Date : 2021-12-01 DOI: 10.1145/3453142.3491413
Ruozhou Yu, Dejun Yang, Hao Zhang
Collaborative perception enables autonomous driving vehicles to share sensing or perception data via broadcast-based vehicle-to-everything (V2X) communication technologies such as Cellular-V2X (C-V2X), hoping to enable accurate perception in face of inaccurate perception results by each individual vehicle. Nevertheless, the V2X communication channel remains a significant bottleneck to the performance and usefulness of collaborative perception due to limited bandwidth and ad hoc communication scheduling. In this paper, we explore challenges and design choices for V2X-based collaborative perception, and propose an architecture that lever-ages the power of edge computing such as road-side units for central communication scheduling. Using NS-3 simulations, we show the performance gap between distributed and centralized C-V2X scheduling in terms of achievable throughput and communication efficiency, and explore scenarios where edge assistance is beneficial or even necessary for collaborative perception.
协同感知使自动驾驶车辆能够通过蜂窝V2X (C-V2X)等基于广播的车联网(V2X)通信技术共享感知或感知数据,希望在每辆车的感知结果不准确的情况下实现准确的感知。然而,由于有限的带宽和自组织通信调度,V2X通信通道仍然是协作感知性能和有用性的重要瓶颈。在本文中,我们探讨了基于v2x的协同感知的挑战和设计选择,并提出了一种利用边缘计算(如路边单元)进行中央通信调度的架构。通过NS-3模拟,我们展示了分布式和集中式C-V2X调度在可实现吞吐量和通信效率方面的性能差距,并探索了边缘辅助对协作感知有益甚至必要的场景。
{"title":"Edge-Assisted Collaborative Perception in Autonomous Driving: A Reflection on Communication Design","authors":"Ruozhou Yu, Dejun Yang, Hao Zhang","doi":"10.1145/3453142.3491413","DOIUrl":"https://doi.org/10.1145/3453142.3491413","url":null,"abstract":"Collaborative perception enables autonomous driving vehicles to share sensing or perception data via broadcast-based vehicle-to-everything (V2X) communication technologies such as Cellular-V2X (C-V2X), hoping to enable accurate perception in face of inaccurate perception results by each individual vehicle. Nevertheless, the V2X communication channel remains a significant bottleneck to the performance and usefulness of collaborative perception due to limited bandwidth and ad hoc communication scheduling. In this paper, we explore challenges and design choices for V2X-based collaborative perception, and propose an architecture that lever-ages the power of edge computing such as road-side units for central communication scheduling. Using NS-3 simulations, we show the performance gap between distributed and centralized C-V2X scheduling in terms of achievable throughput and communication efficiency, and explore scenarios where edge assistance is beneficial or even necessary for collaborative perception.","PeriodicalId":6779,"journal":{"name":"2021 IEEE/ACM Symposium on Edge Computing (SEC)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83206344","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
Scheduling Real-Time Applications on Edge Computing Platforms with Remote Attestation for Security 基于远程安全认证的边缘计算平台实时应用调度
Pub Date : 2021-12-01 DOI: 10.1145/3453142.3493510
Niklas Reusch, P. Pop
Edge Computing Platforms (ECP) increasingly integrate applications with mixed-criticality requirements. In this paper, we consider that critical applications and Edge applications share an ECP. Critical applications are implemented as periodic hard real-time tasks and messages and have stringent timing and security requirements. Edge applications are implemented as aperiodic tasks and messages, and are not critical. We assume that the critical tasks are scheduled using static cyclic scheduling, Time-Sensitive Networking (TSN) is used for dependable communication, and Remote Attestation (RA) is employed to check that the platform components are secure. We formulate an optimization problem for the joint scheduling of critical and Edge applications, such that (i) the deadlines of the critical applications are guaranteed at design-time, (ii) the platform has resources to perform RA, and (iii) we can successfully accommodate multiple dynamic responsive Edge applications at runtime. We evaluate our approach on a realistic use case. The results show that our approach generates dependable schedules that can meet the timing constraints of the critical applications, have enough periodic slack to perform RA for security, and can accommodate Edge applications with a shorter response time.
边缘计算平台(ECP)越来越多地集成具有混合临界要求的应用程序。在本文中,我们认为关键应用程序和边缘应用程序共享一个ECP。关键应用程序实现为周期性的硬实时任务和消息,具有严格的定时和安全要求。边缘应用程序是作为非周期性任务和消息实现的,并不重要。我们假设使用静态循环调度调度关键任务,使用时间敏感网络(TSN)进行可靠通信,并使用远程认证(RA)来检查平台组件是否安全。我们为关键应用程序和边缘应用程序的联合调度制定了一个优化问题,以便(i)在设计时保证关键应用程序的截止日期,(ii)平台拥有执行RA的资源,以及(iii)我们可以在运行时成功地容纳多个动态响应的边缘应用程序。我们在一个现实的用例上评估我们的方法。结果表明,我们的方法生成可靠的调度,可以满足关键应用程序的时间约束,有足够的周期松弛来执行RA以保证安全性,并且可以适应响应时间较短的边缘应用程序。
{"title":"Scheduling Real-Time Applications on Edge Computing Platforms with Remote Attestation for Security","authors":"Niklas Reusch, P. Pop","doi":"10.1145/3453142.3493510","DOIUrl":"https://doi.org/10.1145/3453142.3493510","url":null,"abstract":"Edge Computing Platforms (ECP) increasingly integrate applications with mixed-criticality requirements. In this paper, we consider that critical applications and Edge applications share an ECP. Critical applications are implemented as periodic hard real-time tasks and messages and have stringent timing and security requirements. Edge applications are implemented as aperiodic tasks and messages, and are not critical. We assume that the critical tasks are scheduled using static cyclic scheduling, Time-Sensitive Networking (TSN) is used for dependable communication, and Remote Attestation (RA) is employed to check that the platform components are secure. We formulate an optimization problem for the joint scheduling of critical and Edge applications, such that (i) the deadlines of the critical applications are guaranteed at design-time, (ii) the platform has resources to perform RA, and (iii) we can successfully accommodate multiple dynamic responsive Edge applications at runtime. We evaluate our approach on a realistic use case. The results show that our approach generates dependable schedules that can meet the timing constraints of the critical applications, have enough periodic slack to perform RA for security, and can accommodate Edge applications with a shorter response time.","PeriodicalId":6779,"journal":{"name":"2021 IEEE/ACM Symposium on Edge Computing (SEC)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88261367","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
EDDL: A Distributed Deep Learning System for Resource-limited Edge Computing Environment EDDL:资源有限边缘计算环境下的分布式深度学习系统
Pub Date : 2021-12-01 DOI: 10.1145/3453142.3491286
Pengzhan Hao, Yifan Zhang
This paper investigates the problem of performing distributed deep learning (DDL) to train machine learning (ML) models at the edge with resource-constrained embedded devices. Existing solutions mostly focus on data center environments, where powerful serverclass machines are interconnected with ultra-high-speed Ethernet, and are not suitable for edge environments where much less powerful computing devices and networks are used. Due to the resource constraint on computing devices and the network connecting them, there are three main challenges for performing edge-based DDL: (1) susceptibility to struggling workers, (2) difficulty of scaling up to a large training cluster, and (3) frequent changes in training device availability and capability. To address these challenges, we design and implement EDDL, an edge-based DDL system, with ARM-based ODROID-XU4 and Raspberry Pi 3 Model B boards. We evaluate the prototype EDDL system by performing edge-based mobile malware detection and classification on a large Android APK dataset. The evaluation results show that EDDL can efficiently train deep learning models with consumer-grade embedded devices and wireless networks while incurring small overhead.
本文研究了在资源受限的嵌入式设备上执行分布式深度学习(DDL)来训练边缘机器学习(ML)模型的问题。现有的解决方案主要侧重于数据中心环境,其中功能强大的服务器级机器与超高速以太网相互连接,并且不适合使用功能弱得多的计算设备和网络的边缘环境。由于计算设备和连接它们的网络的资源约束,执行基于边缘的DDL存在三个主要挑战:(1)对挣扎的工作人员的敏感性,(2)扩展到大型训练集群的难度,以及(3)训练设备可用性和能力的频繁变化。为了应对这些挑战,我们设计并实现了EDDL,一个基于边缘的DDL系统,基于arm的ODROID-XU4和树莓派3模型B板。我们通过在大型Android APK数据集上执行基于边缘的移动恶意软件检测和分类来评估原型EDDL系统。评估结果表明,EDDL可以有效地在消费级嵌入式设备和无线网络上训练深度学习模型,同时产生较小的开销。
{"title":"EDDL: A Distributed Deep Learning System for Resource-limited Edge Computing Environment","authors":"Pengzhan Hao, Yifan Zhang","doi":"10.1145/3453142.3491286","DOIUrl":"https://doi.org/10.1145/3453142.3491286","url":null,"abstract":"This paper investigates the problem of performing distributed deep learning (DDL) to train machine learning (ML) models at the edge with resource-constrained embedded devices. Existing solutions mostly focus on data center environments, where powerful serverclass machines are interconnected with ultra-high-speed Ethernet, and are not suitable for edge environments where much less powerful computing devices and networks are used. Due to the resource constraint on computing devices and the network connecting them, there are three main challenges for performing edge-based DDL: (1) susceptibility to struggling workers, (2) difficulty of scaling up to a large training cluster, and (3) frequent changes in training device availability and capability. To address these challenges, we design and implement EDDL, an edge-based DDL system, with ARM-based ODROID-XU4 and Raspberry Pi 3 Model B boards. We evaluate the prototype EDDL system by performing edge-based mobile malware detection and classification on a large Android APK dataset. The evaluation results show that EDDL can efficiently train deep learning models with consumer-grade embedded devices and wireless networks while incurring small overhead.","PeriodicalId":6779,"journal":{"name":"2021 IEEE/ACM Symposium on Edge Computing (SEC)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76675008","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Edge Intelligence for Beyond-5G through Federated Learning 通过联邦学习实现超越5g的边缘智能
Pub Date : 2021-12-01 DOI: 10.1145/3453142.3493519
Shashank Jere, Y. Yi
The computational capabilities of mobile devices have been advancing at a rapid pace in recent times, leading to a growing interest in deploying machine learning applications on such devices. In parallel, Mobile Edge Computing (MEC) has gained traction as a potential enabler for many applications in 5G and Beyond-5G networks, paving the path for making edge devices more intelligent through distributed learning strategies. In this article, we overview the application of federated learning (FL), a novel privacy-preserving distributed learning strategy, within the context of MEC. Minimizing communications latency involved in FL tasks as well as optimizing FL tasks for resource-constrained Internet of Things (IoT) devices are investigated.
近年来,移动设备的计算能力一直在快速发展,导致人们对在此类设备上部署机器学习应用程序的兴趣日益浓厚。与此同时,移动边缘计算(MEC)作为5G和超5G网络中许多应用的潜在推动者,已经获得了牵引力,为通过分布式学习策略使边缘设备更加智能铺平了道路。在本文中,我们概述了联邦学习(FL)在MEC背景下的应用,这是一种新颖的保护隐私的分布式学习策略。研究了最小化FL任务中涉及的通信延迟以及优化资源受限的物联网(IoT)设备的FL任务。
{"title":"Edge Intelligence for Beyond-5G through Federated Learning","authors":"Shashank Jere, Y. Yi","doi":"10.1145/3453142.3493519","DOIUrl":"https://doi.org/10.1145/3453142.3493519","url":null,"abstract":"The computational capabilities of mobile devices have been advancing at a rapid pace in recent times, leading to a growing interest in deploying machine learning applications on such devices. In parallel, Mobile Edge Computing (MEC) has gained traction as a potential enabler for many applications in 5G and Beyond-5G networks, paving the path for making edge devices more intelligent through distributed learning strategies. In this article, we overview the application of federated learning (FL), a novel privacy-preserving distributed learning strategy, within the context of MEC. Minimizing communications latency involved in FL tasks as well as optimizing FL tasks for resource-constrained Internet of Things (IoT) devices are investigated.","PeriodicalId":6779,"journal":{"name":"2021 IEEE/ACM Symposium on Edge Computing (SEC)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80427989","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
LotteryFL: Empower Edge Intelligence with Personalized and Communication-Efficient Federated Learning LotteryFL:通过个性化和高效沟通的联邦学习增强边缘智能
Pub Date : 2021-12-01 DOI: 10.1145/3453142.3492909
Ang Li, Jingwei Sun, Binghui Wang, Lin Duan, Sicheng Li, Yiran Chen, H. Li
With the proliferation of mobile computing and Internet of Things (IoT), massive mobile and IoT devices are connected to the Internet. These devices are generating a huge amount of data every second at the network edge. Many artificial intelligence applications and ser-vices have been proposed for edge devices based on the distributed data. Federated learning (FL) proves to be an extremely viable option for distributed machine learning with enhanced privacy, which can help artificial intelligence applications unleash the potential of data residing at the network edge. Its primary goal is learning a global model that offers good performance for the participants as many as possible. However, the data residing across devices is intrinsically statistically heterogeneous (i.e., non-IID data distribution) and edge devices usually have limited communication resources to transfer data. Such statistical heterogeneity (i.e., non-IID) and communication efficiency are two critical bottlenecks that hinder the development of FL. In this work, we propose LotteryFL - a personalized and communication-efficient FL framework via exploiting the Lottery Ticket hypothesis. In LotteryFL, each client learns a lottery ticket network (i.e., a subnetwork of the base model) by applying the Lottery Ticket hypothesis, and only these lottery networks will be communicated between the server and clients. Rather than learning a shared global model in classic FL, each client learns a personalized model via LotteryFL; the communication cost can be significantly reduced due to the compact size of lottery networks. To support the training and evaluation of our framework, we construct non-IID) datasets based on MNIST, CIFAR-10 and EMNIST by taking feature distribution skew, label distribution skew and quantity skew into consideration. Experiments on these non-IID datasets demonstrate that compared with the state-of-the-art approaches, LotteryFL can achieve as much as 17.24% increase in inference accuracy and 2.94x reduction on communication cost. We also demonstrate the via-bility of LotteryFL, showcasing the real-time performance of the deployed models on edge devices.
随着移动计算和物联网(IoT)的普及,大量移动和物联网设备连接到互联网。这些设备每秒在网络边缘产生大量的数据。基于分布式数据的边缘设备已经提出了许多人工智能应用和服务。联邦学习(FL)被证明是分布式机器学习的一个非常可行的选择,具有增强的隐私性,可以帮助人工智能应用程序释放驻留在网络边缘的数据的潜力。它的主要目标是学习一种为尽可能多的参与者提供良好表现的全球模式。然而,跨设备驻留的数据本质上是统计异构的(即,非iid数据分布),边缘设备通常具有有限的通信资源来传输数据。这种统计异质性(即非iid)和通信效率是阻碍FL发展的两个关键瓶颈。在这项工作中,我们通过利用彩票假设提出了LotteryFL -一个个性化和通信高效的FL框架。在LotteryFL中,每个客户端通过应用彩票假设学习一个彩票网络(即基本模型的一个子网),并且只有这些彩票网络将在服务器和客户端之间通信。而不是学习一个共享的全局模型在经典FL,每个客户端学习一个个性化的模型通过LotteryFL;由于彩票网络的紧凑,通信成本可以大大降低。为了支持我们的框架的训练和评估,我们基于MNIST、CIFAR-10和EMNIST构建了非iid数据集,并考虑了特征分布倾斜、标签分布倾斜和数量倾斜。在这些非iid数据集上的实验表明,与目前最先进的方法相比,LotteryFL的推理准确率提高了17.24%,通信成本降低了2.94倍。我们还演示了LotteryFL的可行性,展示了部署模型在边缘设备上的实时性能。
{"title":"LotteryFL: Empower Edge Intelligence with Personalized and Communication-Efficient Federated Learning","authors":"Ang Li, Jingwei Sun, Binghui Wang, Lin Duan, Sicheng Li, Yiran Chen, H. Li","doi":"10.1145/3453142.3492909","DOIUrl":"https://doi.org/10.1145/3453142.3492909","url":null,"abstract":"With the proliferation of mobile computing and Internet of Things (IoT), massive mobile and IoT devices are connected to the Internet. These devices are generating a huge amount of data every second at the network edge. Many artificial intelligence applications and ser-vices have been proposed for edge devices based on the distributed data. Federated learning (FL) proves to be an extremely viable option for distributed machine learning with enhanced privacy, which can help artificial intelligence applications unleash the potential of data residing at the network edge. Its primary goal is learning a global model that offers good performance for the participants as many as possible. However, the data residing across devices is intrinsically statistically heterogeneous (i.e., non-IID data distribution) and edge devices usually have limited communication resources to transfer data. Such statistical heterogeneity (i.e., non-IID) and communication efficiency are two critical bottlenecks that hinder the development of FL. In this work, we propose LotteryFL - a personalized and communication-efficient FL framework via exploiting the Lottery Ticket hypothesis. In LotteryFL, each client learns a lottery ticket network (i.e., a subnetwork of the base model) by applying the Lottery Ticket hypothesis, and only these lottery networks will be communicated between the server and clients. Rather than learning a shared global model in classic FL, each client learns a personalized model via LotteryFL; the communication cost can be significantly reduced due to the compact size of lottery networks. To support the training and evaluation of our framework, we construct non-IID) datasets based on MNIST, CIFAR-10 and EMNIST by taking feature distribution skew, label distribution skew and quantity skew into consideration. Experiments on these non-IID datasets demonstrate that compared with the state-of-the-art approaches, LotteryFL can achieve as much as 17.24% increase in inference accuracy and 2.94x reduction on communication cost. We also demonstrate the via-bility of LotteryFL, showcasing the real-time performance of the deployed models on edge devices.","PeriodicalId":6779,"journal":{"name":"2021 IEEE/ACM Symposium on Edge Computing (SEC)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73303484","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 19
A Data-Driven Optimal Control Decision-Making System for Multiple Autonomous Vehicles 多辆自动驾驶汽车数据驱动的最优控制决策系统
Pub Date : 2021-12-01 DOI: 10.1145/3453142.3493686
Liuwang Kang, Haiying Shen
With the fast development and rising popularity of autonomous vehicle (AV) technology, multiple AVs may soon be driving on the same road simultaneously. Such multi-AV coexistence driving situations will lead to new and persistent challenges. Therefore, improvements on making control decisions for multiple AVs becomes necessary for continued driving safety. In this paper, we propose a multi-AV decision making system (MADM), which considers multi-AV coexistence driving situations during the decision-making process. In MADM, we first build a policy formation method to generate policies that learn the driving behaviors of an expert based on the expert's driving trajectory data. We then develop a multi-AV decision-making method, which adjusts the formed policies through multi-agent reinforcement learning. The adjusted policies make control decisions for multiple AVs with safety guarantee. We used a real-world traffic dataset to evaluate the decision making performance of MADM in comparison with several state-of-the-art methods. Experimental results show that MADM reduces emergency rate by as high as 51% when compared with existing methods.
随着自动驾驶汽车(AV)技术的快速发展和普及,多辆自动驾驶汽车可能很快就会在同一条道路上同时行驶。这种多av共存的驾驶情况将带来新的和持续的挑战。因此,提高多辆自动驾驶汽车的控制决策能力对持续的驾驶安全至关重要。在本文中,我们提出了一个多av决策系统(MADM),该系统在决策过程中考虑了多av共存驾驶情况。在MADM中,我们首先建立了一种策略形成方法,基于专家的驾驶轨迹数据,生成学习专家驾驶行为的策略。然后,我们开发了一种多av决策方法,该方法通过多智能体强化学习来调整形成的策略。调整后的策略在保证安全的前提下,对多辆自动驾驶汽车进行控制决策。我们使用真实世界的交通数据集来评估MADM的决策性能,并与几种最先进的方法进行比较。实验结果表明,与现有方法相比,MADM可将应急率降低51%。
{"title":"A Data-Driven Optimal Control Decision-Making System for Multiple Autonomous Vehicles","authors":"Liuwang Kang, Haiying Shen","doi":"10.1145/3453142.3493686","DOIUrl":"https://doi.org/10.1145/3453142.3493686","url":null,"abstract":"With the fast development and rising popularity of autonomous vehicle (AV) technology, multiple AVs may soon be driving on the same road simultaneously. Such multi-AV coexistence driving situations will lead to new and persistent challenges. Therefore, improvements on making control decisions for multiple AVs becomes necessary for continued driving safety. In this paper, we propose a multi-AV decision making system (MADM), which considers multi-AV coexistence driving situations during the decision-making process. In MADM, we first build a policy formation method to generate policies that learn the driving behaviors of an expert based on the expert's driving trajectory data. We then develop a multi-AV decision-making method, which adjusts the formed policies through multi-agent reinforcement learning. The adjusted policies make control decisions for multiple AVs with safety guarantee. We used a real-world traffic dataset to evaluate the decision making performance of MADM in comparison with several state-of-the-art methods. Experimental results show that MADM reduces emergency rate by as high as 51% when compared with existing methods.","PeriodicalId":6779,"journal":{"name":"2021 IEEE/ACM Symposium on Edge Computing (SEC)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72829051","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2021 IEEE/ACM Symposium on Edge Computing (SEC)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1