首页 > 最新文献

ACM Transactions on Cyber-Physical Systems (TCPS)最新文献

英文 中文
Testing Deep Learning-based Visual Perception for Automated Driving 测试基于深度学习的自动驾驶视觉感知
Pub Date : 2021-09-22 DOI: 10.1145/3450356
Stephanie Abrecht, Lydia Gauerhof, C. Gladisch, K. Groh, Christian Heinzemann, M. Woehrle
Due to the impressive performance of deep neural networks (DNNs) for visual perception, there is an increased demand for their use in automated systems. However, to use deep neural networks in practice, novel approaches are needed, e.g., for testing. In this work, we focus on the question of how to test deep learning-based visual perception functions for automated driving. Classical approaches for testing are not sufficient: A purely statistical approach based on a dataset split is not enough, as testing needs to address various purposes and not only average case performance. Additionally, a complete specification is elusive due to the complexity of the perception task in the open context of automated driving. In this article, we review and discuss existing work on testing DNNs for visual perception with a special focus on automated driving for test input and test oracle generation as well as test adequacy. We conclude that testing of DNNs in this domain requires several diverse test sets. We show how such tests sets can be constructed based on the presented approaches addressing different purposes based on the presented methods and identify open research questions.
由于深度神经网络(dnn)在视觉感知方面令人印象深刻的性能,在自动化系统中对其使用的需求不断增加。然而,要在实践中使用深度神经网络,需要新的方法,例如用于测试。在这项工作中,我们关注的问题是如何测试基于深度学习的自动驾驶视觉感知功能。用于测试的经典方法是不够的:基于数据集分割的纯统计方法是不够的,因为测试需要解决各种目的,而不仅仅是平均情况性能。此外,由于自动驾驶开放环境下感知任务的复杂性,一个完整的规范是难以捉摸的。在本文中,我们回顾和讨论了现有的dnn视觉感知测试工作,特别关注自动驾驶的测试输入和测试oracle生成以及测试充分性。我们得出结论,该领域的dnn测试需要几个不同的测试集。我们展示了如何基于所提出的方法构建这样的测试集,解决基于所提出的方法的不同目的,并确定开放的研究问题。
{"title":"Testing Deep Learning-based Visual Perception for Automated Driving","authors":"Stephanie Abrecht, Lydia Gauerhof, C. Gladisch, K. Groh, Christian Heinzemann, M. Woehrle","doi":"10.1145/3450356","DOIUrl":"https://doi.org/10.1145/3450356","url":null,"abstract":"Due to the impressive performance of deep neural networks (DNNs) for visual perception, there is an increased demand for their use in automated systems. However, to use deep neural networks in practice, novel approaches are needed, e.g., for testing. In this work, we focus on the question of how to test deep learning-based visual perception functions for automated driving. Classical approaches for testing are not sufficient: A purely statistical approach based on a dataset split is not enough, as testing needs to address various purposes and not only average case performance. Additionally, a complete specification is elusive due to the complexity of the perception task in the open context of automated driving. In this article, we review and discuss existing work on testing DNNs for visual perception with a special focus on automated driving for test input and test oracle generation as well as test adequacy. We conclude that testing of DNNs in this domain requires several diverse test sets. We show how such tests sets can be constructed based on the presented approaches addressing different purposes based on the presented methods and identify open research questions.","PeriodicalId":380257,"journal":{"name":"ACM Transactions on Cyber-Physical Systems (TCPS)","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130372527","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Model-driven Per-panel Solar Anomaly Detection for Residential Arrays 住宅阵列模型驱动的面板太阳异常检测
Pub Date : 2021-09-22 DOI: 10.1145/3460236
Menghong Feng, Noman Bashir, P. Shenoy, David E. Irwin, B. Kosanovic
There has been significant growth in both utility-scale and residential-scale solar installations in recent years, driven by rapid technology improvements and falling prices. Unlike utility-scale solar farms that are professionally managed and maintained, smaller residential-scale installations often lack sensing and instrumentation for performance monitoring and fault detection. As a result, faults may go undetected for long periods of time, resulting in generation and revenue losses for the homeowner. In this article, we present SunDown, a sensorless approach designed to detect per-panel faults in residential solar arrays. SunDown does not require any new sensors for its fault detection and instead uses a model-driven approach that leverages correlations between the power produced by adjacent panels to detect deviations from expected behavior. SunDown can handle concurrent faults in multiple panels and perform anomaly classification to determine probable causes. Using two years of solar generation data from a real home and a manually generated dataset of multiple solar faults, we show that SunDown has a Mean Absolute Percentage Error of 2.98% when predicting per-panel output. Our results show that SunDown is able to detect and classify faults, including from snow cover, leaves and debris, and electrical failures with 99.13% accuracy, and can detect multiple concurrent faults with 97.2% accuracy.
近年来,在技术快速进步和价格下降的推动下,公用事业规模和住宅规模的太阳能装置都有了显著增长。与专业管理和维护的公用事业规模的太阳能发电场不同,较小的住宅规模的装置通常缺乏用于性能监测和故障检测的传感和仪器。因此,故障可能在很长一段时间内未被发现,从而导致房主的发电和收入损失。在这篇文章中,我们介绍了SunDown,一种无传感器的方法,用于检测住宅太阳能电池阵列的每块板故障。SunDown不需要任何新的传感器来进行故障检测,而是使用模型驱动的方法,利用相邻面板产生的功率之间的相关性来检测与预期行为的偏差。SunDown可以处理多个面板的并发故障,并进行异常分类,确定可能的原因。使用来自真实家庭的两年太阳能发电数据和手动生成的多个太阳能故障数据集,我们表明,在预测每面板输出时,SunDown的平均绝对百分比误差为2.98%。结果表明,SunDown能够以99.13%的准确率检测和分类积雪、树叶和碎片以及电气故障,并以97.2%的准确率检测多个并发故障。
{"title":"Model-driven Per-panel Solar Anomaly Detection for Residential Arrays","authors":"Menghong Feng, Noman Bashir, P. Shenoy, David E. Irwin, B. Kosanovic","doi":"10.1145/3460236","DOIUrl":"https://doi.org/10.1145/3460236","url":null,"abstract":"There has been significant growth in both utility-scale and residential-scale solar installations in recent years, driven by rapid technology improvements and falling prices. Unlike utility-scale solar farms that are professionally managed and maintained, smaller residential-scale installations often lack sensing and instrumentation for performance monitoring and fault detection. As a result, faults may go undetected for long periods of time, resulting in generation and revenue losses for the homeowner. In this article, we present SunDown, a sensorless approach designed to detect per-panel faults in residential solar arrays. SunDown does not require any new sensors for its fault detection and instead uses a model-driven approach that leverages correlations between the power produced by adjacent panels to detect deviations from expected behavior. SunDown can handle concurrent faults in multiple panels and perform anomaly classification to determine probable causes. Using two years of solar generation data from a real home and a manually generated dataset of multiple solar faults, we show that SunDown has a Mean Absolute Percentage Error of 2.98% when predicting per-panel output. Our results show that SunDown is able to detect and classify faults, including from snow cover, leaves and debris, and electrical failures with 99.13% accuracy, and can detect multiple concurrent faults with 97.2% accuracy.","PeriodicalId":380257,"journal":{"name":"ACM Transactions on Cyber-Physical Systems (TCPS)","volume":"72 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132182095","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
RAP: A Software Framework of Developing Convolutional Neural Networks for Resource-constrained Devices Using Environmental Monitoring as a Case Study RAP:基于环境监测的资源受限设备卷积神经网络开发软件框架
Pub Date : 2021-09-22 DOI: 10.1145/3472612
Chia-Heng Tu, Qihui Sun, Hsiao-Hsuan Chang
Monitoring environmental conditions is an important application of cyber-physical systems. Typically, the monitoring is to perceive surrounding environments with battery-powered, tiny devices deployed in the field. While deep learning-based methods, especially the convolutional neural networks (CNNs), are promising approaches to enriching the functionalities offered by the tiny devices, they demand more computation and memory resources, which makes these methods difficult to be adopted on such devices. In this article, we develop a software framework, RAP, that permits the construction of the CNN designs by aggregating the existing, lightweight CNN layers, which are able to fit in the limited memory (e.g., several KBs of SRAM) on the resource-constrained devices satisfying application-specific timing constrains. RAP leverages the Python-based neural network framework Chainer to build the CNNs by mounting the C/C++ implementations of the lightweight layers, trains the built CNN models as the ordinary model-training procedure in Chainer, and generates the C version codes of the trained models. The generated programs are compiled into target machine executables for the on-device inferences. With the vigorous development of lightweight CNNs, such as binarized neural networks with binary weights and activations, RAP facilitates the model building process for the resource-constrained devices by allowing them to alter, debug, and evaluate the CNN designs over the C/C++ implementation of the lightweight CNN layers. We have prototyped the RAP framework and built two environmental monitoring applications for protecting endangered species using image- and acoustic-based monitoring methods. Our results show that the built model consumes less than 0.5 KB of SRAM for buffering the runtime data required by the model inference while achieving up to 93% of accuracy for the acoustic monitoring with less than one second of inference time on the TI 16-bit microcontroller platform.
环境监测是信息物理系统的重要应用。通常,监测是通过部署在现场的电池供电的微型设备来感知周围环境。虽然基于深度学习的方法,特别是卷积神经网络(cnn),是丰富微型设备提供的功能的有前途的方法,但它们需要更多的计算和内存资源,这使得这些方法难以在此类设备上采用。在本文中,我们开发了一个软件框架RAP,它允许通过聚合现有的轻量级CNN层来构建CNN设计,这些层能够适应资源受限设备上有限的内存(例如,几个KBs的SRAM),满足特定于应用程序的时间约束。RAP利用基于python的神经网络框架Chainer通过安装轻量级层的C/ c++实现来构建CNN,将构建的CNN模型作为Chainer中的普通模型训练过程进行训练,并生成训练模型的C版本代码。生成的程序被编译成目标机器的可执行文件,用于设备上的推断。随着轻量级CNN(如具有二进制权重和激活的二值化神经网络)的蓬勃发展,RAP通过允许资源受限设备在轻量级CNN层的C/ c++实现上更改、调试和评估CNN设计,从而简化了模型构建过程。我们制作了RAP框架的原型,并建立了两个环境监测应用程序,使用基于图像和声学的监测方法来保护濒危物种。我们的研究结果表明,所建立的模型消耗不到0.5 KB的SRAM来缓冲模型推理所需的运行时数据,同时在TI 16位微控制器平台上以不到一秒的推理时间实现高达93%的声学监测精度。
{"title":"RAP: A Software Framework of Developing Convolutional Neural Networks for Resource-constrained Devices Using Environmental Monitoring as a Case Study","authors":"Chia-Heng Tu, Qihui Sun, Hsiao-Hsuan Chang","doi":"10.1145/3472612","DOIUrl":"https://doi.org/10.1145/3472612","url":null,"abstract":"Monitoring environmental conditions is an important application of cyber-physical systems. Typically, the monitoring is to perceive surrounding environments with battery-powered, tiny devices deployed in the field. While deep learning-based methods, especially the convolutional neural networks (CNNs), are promising approaches to enriching the functionalities offered by the tiny devices, they demand more computation and memory resources, which makes these methods difficult to be adopted on such devices. In this article, we develop a software framework, RAP, that permits the construction of the CNN designs by aggregating the existing, lightweight CNN layers, which are able to fit in the limited memory (e.g., several KBs of SRAM) on the resource-constrained devices satisfying application-specific timing constrains. RAP leverages the Python-based neural network framework Chainer to build the CNNs by mounting the C/C++ implementations of the lightweight layers, trains the built CNN models as the ordinary model-training procedure in Chainer, and generates the C version codes of the trained models. The generated programs are compiled into target machine executables for the on-device inferences. With the vigorous development of lightweight CNNs, such as binarized neural networks with binary weights and activations, RAP facilitates the model building process for the resource-constrained devices by allowing them to alter, debug, and evaluate the CNN designs over the C/C++ implementation of the lightweight CNN layers. We have prototyped the RAP framework and built two environmental monitoring applications for protecting endangered species using image- and acoustic-based monitoring methods. Our results show that the built model consumes less than 0.5 KB of SRAM for buffering the runtime data required by the model inference while achieving up to 93% of accuracy for the acoustic monitoring with less than one second of inference time on the TI 16-bit microcontroller platform.","PeriodicalId":380257,"journal":{"name":"ACM Transactions on Cyber-Physical Systems (TCPS)","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114897449","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Introduction to the Special Issue on Artificial Intelligence and Cyber-Physical Systems: Part 1 人工智能和网络物理系统特刊简介:第一部分
Pub Date : 2021-09-22 DOI: 10.1145/3471164
Jingtong Hu, Qi Zhu, Susmit Jha
By using a combination of machines, sensors, embedded computational intelligence, and various communication mechanisms, Cyber-Physical Systems (CPSs) monitor and control physical elements with computer-based algorithms, capable of autonomously reacting to and affecting their physical surroundings. Advances in CPS should enable capability, adaptability, scalability, resilience, safety, security, and usability far beyond what is available in the embedded systems of today. In light of the rapid advancements in artificial intelligence (AI) and communications, there is an increasing demand for these intelligent CPSs, such as connected and autonomous vehicles that monitor and communicate with their surroundings and smart appliances that optimize energy consumption based on environment and occupant behavior. To realize the vision of AI-enabled CPS, there are several research areas we can expect to come to the fore. For example, new methods to combine data-driven machine leaning and model-based learning for decision making and real-time control of cyber-physical systems are very promising. Meanwhile, traditional ideas in CPS research are being challenged by new concepts emerging from AI and machine learning. For example, what do high confidence and assurance mean in the context of autonomous systems that learn from their experiences? How does one address the trinity of challenges of trustworthiness, resilience, and interpretability of artificial intelligence in its integration with high-assurance cyber-physical systems? How does one reconcile the concepts of machine learning and data-driven modeling with approaches used in model-based design and formal methods? To explore these new directions and address new challenges, this special issue features 12 articles on the topics of AI and CPS.
通过使用机器、传感器、嵌入式计算智能和各种通信机制的组合,网络物理系统(cps)通过基于计算机的算法监测和控制物理元素,能够自主地对其物理环境做出反应并影响其物理环境。CPS的进步应该使能力、适应性、可伸缩性、弹性、安全性、安全性和可用性远远超出当今嵌入式系统的可用性。鉴于人工智能(AI)和通信的快速发展,对这些智能cps的需求越来越大,例如可以监控周围环境并与之通信的联网和自动驾驶汽车,以及根据环境和乘员行为优化能耗的智能设备。为了实现人工智能CPS的愿景,我们可以期待几个研究领域的出现。例如,将数据驱动的机器学习和基于模型的学习结合起来,用于网络物理系统的决策和实时控制的新方法是非常有前途的。与此同时,人工智能和机器学习的新概念正在挑战CPS研究的传统观念。例如,在从经验中学习的自主系统中,高信心和保证意味着什么?如何解决人工智能与高保证网络物理系统集成时的可信度、弹性和可解释性这三位一体的挑战?如何将机器学习和数据驱动建模的概念与基于模型的设计和形式化方法中使用的方法相协调?为了探索这些新方向和应对新挑战,本期特刊刊登了12篇关于人工智能和CPS主题的文章。
{"title":"Introduction to the Special Issue on Artificial Intelligence and Cyber-Physical Systems: Part 1","authors":"Jingtong Hu, Qi Zhu, Susmit Jha","doi":"10.1145/3471164","DOIUrl":"https://doi.org/10.1145/3471164","url":null,"abstract":"By using a combination of machines, sensors, embedded computational intelligence, and various communication mechanisms, Cyber-Physical Systems (CPSs) monitor and control physical elements with computer-based algorithms, capable of autonomously reacting to and affecting their physical surroundings. Advances in CPS should enable capability, adaptability, scalability, resilience, safety, security, and usability far beyond what is available in the embedded systems of today. In light of the rapid advancements in artificial intelligence (AI) and communications, there is an increasing demand for these intelligent CPSs, such as connected and autonomous vehicles that monitor and communicate with their surroundings and smart appliances that optimize energy consumption based on environment and occupant behavior. To realize the vision of AI-enabled CPS, there are several research areas we can expect to come to the fore. For example, new methods to combine data-driven machine leaning and model-based learning for decision making and real-time control of cyber-physical systems are very promising. Meanwhile, traditional ideas in CPS research are being challenged by new concepts emerging from AI and machine learning. For example, what do high confidence and assurance mean in the context of autonomous systems that learn from their experiences? How does one address the trinity of challenges of trustworthiness, resilience, and interpretability of artificial intelligence in its integration with high-assurance cyber-physical systems? How does one reconcile the concepts of machine learning and data-driven modeling with approaches used in model-based design and formal methods? To explore these new directions and address new challenges, this special issue features 12 articles on the topics of AI and CPS.","PeriodicalId":380257,"journal":{"name":"ACM Transactions on Cyber-Physical Systems (TCPS)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114210131","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Efficient Out-of-Distribution Detection Using Latent Space of β-VAE for Cyber-Physical Systems 基于β-VAE潜空间的网络物理系统有效的分布外检测
Pub Date : 2021-08-26 DOI: 10.1145/3491243
Shreyas Ramakrishna, Zahra Rahiminasab, G. Karsai, A. Easwaran, Abhishek Dubey
Deep Neural Networks are actively being used in the design of autonomous Cyber-Physical Systems (CPSs). The advantage of these models is their ability to handle high-dimensional state-space and learn compact surrogate representations of the operational state spaces. However, the problem is that the sampled observations used for training the model may never cover the entire state space of the physical environment, and as a result, the system will likely operate in conditions that do not belong to the training distribution. These conditions that do not belong to training distribution are referred to as Out-of-Distribution (OOD). Detecting OOD conditions at runtime is critical for the safety of CPS. In addition, it is also desirable to identify the context or the feature(s) that are the source of OOD to select an appropriate control action to mitigate the consequences that may arise because of the OOD condition. In this article, we study this problem as a multi-labeled time series OOD detection problem over images, where the OOD is defined both sequentially across short time windows (change points) as well as across the training data distribution. A common approach to solving this problem is the use of multi-chained one-class classifiers. However, this approach is expensive for CPSs that have limited computational resources and require short inference times. Our contribution is an approach to design and train a single β-Variational Autoencoder detector with a partially disentangled latent space sensitive to variations in image features. We use the feature sensitive latent variables in the latent space to detect OOD images and identify the most likely feature(s) responsible for the OOD. We demonstrate our approach using an Autonomous Vehicle in the CARLA simulator and a real-world automotive dataset called nuImages.
深度神经网络在自主信息物理系统(cps)的设计中得到了积极的应用。这些模型的优点是它们能够处理高维状态空间,并学习操作状态空间的紧凑代理表示。然而,问题是用于训练模型的采样观测可能永远不会覆盖物理环境的整个状态空间,因此,系统可能会在不属于训练分布的条件下运行。这些不属于培训分布的情况被称为分布外(OOD)。在运行时检测OOD状况对CPS的安全性至关重要。此外,还需要确定作为OOD来源的环境或特征,以选择适当的控制措施来减轻由于OOD条件可能产生的后果。在本文中,我们将此问题作为图像上的多标记时间序列OOD检测问题进行研究,其中OOD是在短时间窗口(变化点)和整个训练数据分布上顺序定义的。解决这个问题的一个常用方法是使用多链单类分类器。然而,对于计算资源有限且需要较短推理时间的cps来说,这种方法是昂贵的。我们的贡献是设计和训练单个β-变分自编码器检测器的方法,该检测器具有对图像特征变化敏感的部分解纠缠潜在空间。我们使用潜在空间中的特征敏感潜在变量来检测OOD图像,并识别最可能导致OOD的特征。我们使用CARLA模拟器中的自动驾驶汽车和一个名为nuImages的真实汽车数据集来演示我们的方法。
{"title":"Efficient Out-of-Distribution Detection Using Latent Space of β-VAE for Cyber-Physical Systems","authors":"Shreyas Ramakrishna, Zahra Rahiminasab, G. Karsai, A. Easwaran, Abhishek Dubey","doi":"10.1145/3491243","DOIUrl":"https://doi.org/10.1145/3491243","url":null,"abstract":"Deep Neural Networks are actively being used in the design of autonomous Cyber-Physical Systems (CPSs). The advantage of these models is their ability to handle high-dimensional state-space and learn compact surrogate representations of the operational state spaces. However, the problem is that the sampled observations used for training the model may never cover the entire state space of the physical environment, and as a result, the system will likely operate in conditions that do not belong to the training distribution. These conditions that do not belong to training distribution are referred to as Out-of-Distribution (OOD). Detecting OOD conditions at runtime is critical for the safety of CPS. In addition, it is also desirable to identify the context or the feature(s) that are the source of OOD to select an appropriate control action to mitigate the consequences that may arise because of the OOD condition. In this article, we study this problem as a multi-labeled time series OOD detection problem over images, where the OOD is defined both sequentially across short time windows (change points) as well as across the training data distribution. A common approach to solving this problem is the use of multi-chained one-class classifiers. However, this approach is expensive for CPSs that have limited computational resources and require short inference times. Our contribution is an approach to design and train a single β-Variational Autoencoder detector with a partially disentangled latent space sensitive to variations in image features. We use the feature sensitive latent variables in the latent space to detect OOD images and identify the most likely feature(s) responsible for the OOD. We demonstrate our approach using an Autonomous Vehicle in the CARLA simulator and a real-world automotive dataset called nuImages.","PeriodicalId":380257,"journal":{"name":"ACM Transactions on Cyber-Physical Systems (TCPS)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126758662","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 13
Collaborative Rover-copter Path Planning and Exploration with Temporal Logic Specifications Based on Bayesian Update Under Uncertain Environments 不确定环境下基于贝叶斯更新的时间逻辑规范下的协同漫游直升机路径规划与探索
Pub Date : 2021-07-20 DOI: 10.1145/3470453
Kazumune Hashimoto, Natsuko Tsumagari, T. Ushio
This article investigates a collaborative rover-copter path planning and exploration with temporal logic specifications under uncertain environments. The objective of the rover is to complete a mission expressed by a syntactically co-safe linear temporal logic (scLTL) formula, while the objective of the copter is to actively explore the environment and reduce its uncertainties, aiming at assisting the rover and enhancing the efficiency of the mission completion. To formalize our approach, we first capture the environmental uncertainties by environmental beliefs of the atomic propositions, under an assumption that it is unknown which properties (or, atomic propositions) are satisfied in each area of the environment. The environmental beliefs of the atomic propositions are updated according to the Bayes rule based on the Bernoulli-type sensor measurements provided by both the rover and the copter. Then, the optimal policy for the rover is synthesized by maximizing a belief of the satisfaction of the scLTL formula through an implementation of an automata-based model checking. An exploration policy for the copter is then synthesized by employing the notion of an entropy that is evaluated based on the environmental beliefs of the atomic propositions, and a path that the rover intends to follow according to the optimal policy. As such, the copter can actively explore regions whose uncertainties are high and that are relevant to the mission completion. Finally, some numerical examples illustrate the effectiveness of the proposed approach.
本文研究了不确定环境下具有时间逻辑规范的探测车-直升机协同路径规划与探索。探测车的目标是完成一个用句法共安全线性时间逻辑(scLTL)公式表达的任务,而直升机的目标是主动探索环境,减少其不确定性,以辅助探测车,提高任务完成效率。为了形式化我们的方法,我们首先通过原子命题的环境信念来捕捉环境的不确定性,假设在环境的每个区域中满足哪些属性(或原子命题)是未知的。原子命题的环境信念根据基于探测器和直升机提供的伯努利型传感器测量值的贝叶斯规则进行更新。然后,通过实现基于自动机的模型检查,通过最大化scLTL公式满足的信念来综合漫游车的最优策略。然后,通过使用基于原子命题的环境信念评估的熵的概念来合成直升机的探索策略,以及根据最优策略,漫游车打算遵循的路径。因此,直升机可以主动探索不确定性高且与任务完成相关的区域。最后,通过数值算例说明了所提方法的有效性。
{"title":"Collaborative Rover-copter Path Planning and Exploration with Temporal Logic Specifications Based on Bayesian Update Under Uncertain Environments","authors":"Kazumune Hashimoto, Natsuko Tsumagari, T. Ushio","doi":"10.1145/3470453","DOIUrl":"https://doi.org/10.1145/3470453","url":null,"abstract":"This article investigates a collaborative rover-copter path planning and exploration with temporal logic specifications under uncertain environments. The objective of the rover is to complete a mission expressed by a syntactically co-safe linear temporal logic (scLTL) formula, while the objective of the copter is to actively explore the environment and reduce its uncertainties, aiming at assisting the rover and enhancing the efficiency of the mission completion. To formalize our approach, we first capture the environmental uncertainties by environmental beliefs of the atomic propositions, under an assumption that it is unknown which properties (or, atomic propositions) are satisfied in each area of the environment. The environmental beliefs of the atomic propositions are updated according to the Bayes rule based on the Bernoulli-type sensor measurements provided by both the rover and the copter. Then, the optimal policy for the rover is synthesized by maximizing a belief of the satisfaction of the scLTL formula through an implementation of an automata-based model checking. An exploration policy for the copter is then synthesized by employing the notion of an entropy that is evaluated based on the environmental beliefs of the atomic propositions, and a path that the rover intends to follow according to the optimal policy. As such, the copter can actively explore regions whose uncertainties are high and that are relevant to the mission completion. Finally, some numerical examples illustrate the effectiveness of the proposed approach.","PeriodicalId":380257,"journal":{"name":"ACM Transactions on Cyber-Physical Systems (TCPS)","volume":"78 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121901406","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Algorithmic Ethics: Formalization and Verification of Autonomous Vehicle Obligations 算法伦理:自动驾驶汽车义务的形式化和验证
Pub Date : 2021-05-06 DOI: 10.1145/3460975
Colin Shea-Blymyer, Houssam Abbas
In this article, we develop a formal framework for automatic reasoning about the obligations of autonomous cyber-physical systems, including their social and ethical obligations. Obligations, permissions, and prohibitions are distinct from a system's mission, and are a necessary part of specifying advanced, adaptive AI-equipped systems. They need a dedicated deontic logic of obligations to formalize them. Most existing deontic logics lack corresponding algorithms and system models that permit automatic verification. We demonstrate how a particular deontic logic, Dominance Act Utilitarianism (DAU) [23], is a suitable starting point for formalizing the obligations of autonomous systems like self-driving cars. We demonstrate its usefulness by formalizing a subset of Responsibility-Sensitive Safety (RSS) in DAU; RSS is an industrial proposal for how self-driving cars should and should not behave in traffic. We show that certain logical consequences of RSS are undesirable, indicating a need to further refine the proposal. We also demonstrate how obligations can change over time, which is necessary for long-term autonomy. We then demonstrate a model-checking algorithm for DAU formulas on weighted transition systems and illustrate it by model-checking obligations of a self-driving car controller from the literature.
在本文中,我们开发了一个正式的框架,用于自动推理自主网络物理系统的义务,包括其社会和道德义务。义务、许可和禁止与系统的任务不同,是指定高级、自适应ai装备系统的必要组成部分。它们需要一个专门的义务道义逻辑来形式化它们。大多数现有的道义逻辑缺乏相应的允许自动验证的算法和系统模型。我们展示了一种特定的道义逻辑,即支配行为功利主义(DAU) b[23],如何成为形式化自动驾驶汽车等自动系统义务的合适起点。我们通过在DAU中形式化责任敏感安全(RSS)子集来证明其有效性;RSS是一个关于自动驾驶汽车在交通中应该和不应该如何表现的工业建议。我们表明RSS的某些逻辑结果是不可取的,这表明需要进一步改进提案。我们还演示了义务如何随时间变化,这对于长期自治是必要的。然后,我们展示了加权过渡系统上DAU公式的模型检查算法,并通过文献中自动驾驶汽车控制器的模型检查义务来说明它。
{"title":"Algorithmic Ethics: Formalization and Verification of Autonomous Vehicle Obligations","authors":"Colin Shea-Blymyer, Houssam Abbas","doi":"10.1145/3460975","DOIUrl":"https://doi.org/10.1145/3460975","url":null,"abstract":"In this article, we develop a formal framework for automatic reasoning about the obligations of autonomous cyber-physical systems, including their social and ethical obligations. Obligations, permissions, and prohibitions are distinct from a system's mission, and are a necessary part of specifying advanced, adaptive AI-equipped systems. They need a dedicated deontic logic of obligations to formalize them. Most existing deontic logics lack corresponding algorithms and system models that permit automatic verification. We demonstrate how a particular deontic logic, Dominance Act Utilitarianism (DAU) [23], is a suitable starting point for formalizing the obligations of autonomous systems like self-driving cars. We demonstrate its usefulness by formalizing a subset of Responsibility-Sensitive Safety (RSS) in DAU; RSS is an industrial proposal for how self-driving cars should and should not behave in traffic. We show that certain logical consequences of RSS are undesirable, indicating a need to further refine the proposal. We also demonstrate how obligations can change over time, which is necessary for long-term autonomy. We then demonstrate a model-checking algorithm for DAU formulas on weighted transition systems and illustrate it by model-checking obligations of a self-driving car controller from the literature.","PeriodicalId":380257,"journal":{"name":"ACM Transactions on Cyber-Physical Systems (TCPS)","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-05-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130857761","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Extending Isolation Forest for Anomaly Detection in Big Data via K-Means 基于K-Means的大数据异常检测扩展隔离林
Pub Date : 2021-04-27 DOI: 10.1145/3460976
Md Tahmid Rahman Laskar, J. Huang, Vladan Smetana, Chris Stewart, Kees Pouw, Aijun An, Steve Chan, Lei Liu
Industrial Information Technology infrastructures are often vulnerable to cyberattacks. To ensure security to the computer systems in an industrial environment, it is required to build effective intrusion detection systems to monitor the cyber-physical systems (e.g., computer networks) in the industry for malicious activities. This article aims to build such intrusion detection systems to protect the computer networks from cyberattacks. More specifically, we propose a novel unsupervised machine learning approach that combines the K-Means algorithm with the Isolation Forest for anomaly detection in industrial big data scenarios. Since our objective is to build the intrusion detection system for the big data scenario in the industrial domain, we utilize the Apache Spark framework to implement our proposed model that was trained in large network traffic data (about 123 million instances of network traffic) stored in Elasticsearch. Moreover, we evaluate our proposed model on the live streaming data and find that our proposed system can be used for real-time anomaly detection in the industrial setup. In addition, we address different challenges that we face while training our model on large datasets and explicitly describe how these issues were resolved. Based on our empirical evaluation in different use cases for anomaly detection in real-world network traffic data, we observe that our proposed system is effective to detect anomalies in big data scenarios. Finally, we evaluate our proposed model on several academic datasets to compare with other models and find that it provides comparable performance with other state-of-the-art approaches.
工业信息技术基础设施往往容易受到网络攻击。为了确保工业环境中计算机系统的安全,需要建立有效的入侵检测系统来监控工业中的网络物理系统(如计算机网络)的恶意活动。本文旨在建立这样的入侵检测系统,以保护计算机网络免受网络攻击。更具体地说,我们提出了一种新的无监督机器学习方法,该方法将K-Means算法与隔离森林相结合,用于工业大数据场景中的异常检测。由于我们的目标是为工业领域的大数据场景构建入侵检测系统,我们利用Apache Spark框架来实现我们提出的模型,该模型是在存储在Elasticsearch中的大型网络流量数据(约1.23亿网络流量实例)中训练出来的。此外,我们在实时流数据上评估了我们提出的模型,发现我们提出的系统可以用于工业设置中的实时异常检测。此外,我们解决了在大型数据集上训练模型时面临的不同挑战,并明确描述了这些问题是如何解决的。基于我们对真实网络流量数据异常检测的不同用例的经验评估,我们观察到我们提出的系统可以有效地检测大数据场景下的异常。最后,我们在几个学术数据集上评估了我们提出的模型,并与其他模型进行了比较,发现它与其他最先进的方法提供了相当的性能。
{"title":"Extending Isolation Forest for Anomaly Detection in Big Data via K-Means","authors":"Md Tahmid Rahman Laskar, J. Huang, Vladan Smetana, Chris Stewart, Kees Pouw, Aijun An, Steve Chan, Lei Liu","doi":"10.1145/3460976","DOIUrl":"https://doi.org/10.1145/3460976","url":null,"abstract":"Industrial Information Technology infrastructures are often vulnerable to cyberattacks. To ensure security to the computer systems in an industrial environment, it is required to build effective intrusion detection systems to monitor the cyber-physical systems (e.g., computer networks) in the industry for malicious activities. This article aims to build such intrusion detection systems to protect the computer networks from cyberattacks. More specifically, we propose a novel unsupervised machine learning approach that combines the K-Means algorithm with the Isolation Forest for anomaly detection in industrial big data scenarios. Since our objective is to build the intrusion detection system for the big data scenario in the industrial domain, we utilize the Apache Spark framework to implement our proposed model that was trained in large network traffic data (about 123 million instances of network traffic) stored in Elasticsearch. Moreover, we evaluate our proposed model on the live streaming data and find that our proposed system can be used for real-time anomaly detection in the industrial setup. In addition, we address different challenges that we face while training our model on large datasets and explicitly describe how these issues were resolved. Based on our empirical evaluation in different use cases for anomaly detection in real-world network traffic data, we observe that our proposed system is effective to detect anomalies in big data scenarios. Finally, we evaluate our proposed model on several academic datasets to compare with other models and find that it provides comparable performance with other state-of-the-art approaches.","PeriodicalId":380257,"journal":{"name":"ACM Transactions on Cyber-Physical Systems (TCPS)","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117128108","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 14
Scaling beyond Bandwidth Limitations: Wireless Control with Stability Guarantees under Overload 超越带宽限制的扩展:在过载下具有稳定性保证的无线控制
Pub Date : 2021-04-16 DOI: 10.1145/3502299
Fabian Mager, Dominik Baumann, Carsten Herrmann, Sebastian Trimpe, Marco Zimmerling
An important class of cyber-physical systems relies on multiple agents that jointly perform a task by coordinating their actions over a wireless network. Examples include self-driving cars in intelligent transportation and production robots in smart manufacturing. However, the scalability of existing control-over-wireless solutions is limited as they cannot resolve overload situations in which the communication demand exceeds the available bandwidth. This article presents a novel co-design of distributed control and wireless communication that overcomes this limitation by dynamically allocating the available bandwidth to agents with the greatest need to communicate. Experiments on a real cyber-physical testbed with 20 agents, each consisting of a low-power wireless embedded device and a cart-pole system, demonstrate that our solution achieves significantly better control performance under overload than the state of the art. We further prove that our co-design guarantees closed-loop stability for physical systems with stochastic linear time-invariant dynamics.
一类重要的网络物理系统依赖于多个代理,这些代理通过在无线网络上协调它们的行动来共同执行任务。例如智能交通领域的自动驾驶汽车和智能制造领域的生产机器人。然而,现有的无线控制解决方案的可扩展性是有限的,因为它们不能解决通信需求超过可用带宽的过载情况。本文提出了一种新的分布式控制和无线通信的协同设计,通过动态地将可用带宽分配给最需要通信的代理来克服这一限制。在一个真实的网络物理测试平台上进行了20个代理的实验,每个代理由一个低功耗无线嵌入式设备和一个推车杆系统组成,结果表明,我们的解决方案在过载情况下的控制性能明显优于目前的技术水平。我们进一步证明了我们的协同设计保证了具有随机线性定常动力学的物理系统的闭环稳定性。
{"title":"Scaling beyond Bandwidth Limitations: Wireless Control with Stability Guarantees under Overload","authors":"Fabian Mager, Dominik Baumann, Carsten Herrmann, Sebastian Trimpe, Marco Zimmerling","doi":"10.1145/3502299","DOIUrl":"https://doi.org/10.1145/3502299","url":null,"abstract":"An important class of cyber-physical systems relies on multiple agents that jointly perform a task by coordinating their actions over a wireless network. Examples include self-driving cars in intelligent transportation and production robots in smart manufacturing. However, the scalability of existing control-over-wireless solutions is limited as they cannot resolve overload situations in which the communication demand exceeds the available bandwidth. This article presents a novel co-design of distributed control and wireless communication that overcomes this limitation by dynamically allocating the available bandwidth to agents with the greatest need to communicate. Experiments on a real cyber-physical testbed with 20 agents, each consisting of a low-power wireless embedded device and a cart-pole system, demonstrate that our solution achieves significantly better control performance under overload than the state of the art. We further prove that our co-design guarantees closed-loop stability for physical systems with stochastic linear time-invariant dynamics.","PeriodicalId":380257,"journal":{"name":"ACM Transactions on Cyber-Physical Systems (TCPS)","volume":"102 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128896643","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
QuickLoc: Adaptive Deep-Learning for Fast Indoor Localization with Mobile Devices QuickLoc:移动设备快速室内定位的自适应深度学习
Pub Date : 2021-04-15 DOI: 10.1145/3461342
Saideep Tiku, Prathmesh Kale, S. Pasricha
Indoor localization services are a crucial aspect for the realization of smart cyber-physical systems within cities of the future. Such services are poised to reinvent the process of navigation and tracking of people and assets in a variety of indoor and subterranean environments. The growing ownership of computationally capable smartphones has laid the foundations of portable fingerprinting-based indoor localization through deep learning. However, as the demand for accurate localization increases, the computational complexity of the associated deep learning models increases as well. We present an approach for reducing the computational requirements of a deep learning-based indoor localization framework while maintaining localization accuracy targets. Our proposed methodology is deployed and validated across multiple smartphones and is shown to deliver up to 42% reduction in prediction latency and 45% reduction in prediction energy as compared to the best-known baseline deep learning-based indoor localization model.
室内定位服务是未来城市中智能网络物理系统实现的一个关键方面。这些服务将重塑各种室内和地下环境中人员和资产的导航和跟踪过程。越来越多的智能手机为通过深度学习实现基于指纹的便携式室内定位奠定了基础。然而,随着对精确定位需求的增加,相关深度学习模型的计算复杂度也随之增加。我们提出了一种方法来降低基于深度学习的室内定位框架的计算需求,同时保持定位精度目标。我们提出的方法在多个智能手机上进行了部署和验证,与最著名的基于基线深度学习的室内定位模型相比,预测延迟减少42%,预测能量减少45%。
{"title":"QuickLoc: Adaptive Deep-Learning for Fast Indoor Localization with Mobile Devices","authors":"Saideep Tiku, Prathmesh Kale, S. Pasricha","doi":"10.1145/3461342","DOIUrl":"https://doi.org/10.1145/3461342","url":null,"abstract":"Indoor localization services are a crucial aspect for the realization of smart cyber-physical systems within cities of the future. Such services are poised to reinvent the process of navigation and tracking of people and assets in a variety of indoor and subterranean environments. The growing ownership of computationally capable smartphones has laid the foundations of portable fingerprinting-based indoor localization through deep learning. However, as the demand for accurate localization increases, the computational complexity of the associated deep learning models increases as well. We present an approach for reducing the computational requirements of a deep learning-based indoor localization framework while maintaining localization accuracy targets. Our proposed methodology is deployed and validated across multiple smartphones and is shown to deliver up to 42% reduction in prediction latency and 45% reduction in prediction energy as compared to the best-known baseline deep learning-based indoor localization model.","PeriodicalId":380257,"journal":{"name":"ACM Transactions on Cyber-Physical Systems (TCPS)","volume":"214 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125395218","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
期刊
ACM Transactions on Cyber-Physical Systems (TCPS)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1