首页 > 最新文献

Proceedings of the 21st International Conference on Hybrid Systems: Computation and Control (part of CPS Week)最新文献

英文 中文
Localizing Faults in Simulink/Stateflow Models with STL 用STL定位Simulink/状态流模型中的故障
E. Bartocci, Thomas Ferrère, Niveditha Manjunath, D. Ničković
Fault-localization is considered to be a very tedious and time-consuming activity in the design of complex Cyber-Physical Systems (CPS). This laborious task essentially requires expert knowledge of the system in order to discover the cause of the fault. In this context, we propose a new procedure that aids designers in debugging Simulink/Stateflow hybrid system models, guided by Signal Temporal Logic (STL) specifications. The proposed method relies on three main ingredients: (1) a monitoring and a trace diagnostics procedure that checks whether a tested behavior satisfies or violates an STL specification, localizes time segments and interfaces variables contributing to the property violations; (2) a slicing procedure that maps these observable behavior segments to the internal states and transitions of the Simulink model; and (3) a spectrum-based fault-localization method that combines the previous analysis from multiple tests to identify the internal states and/or transitions that are the most likely to explain the fault. We demonstrate the applicability of our approach on two Simulink models from the automotive and the avionics domain.
在复杂信息物理系统(CPS)的设计中,故障定位被认为是一项非常繁琐和耗时的工作。这项艰巨的任务基本上需要系统的专家知识,以便发现故障的原因。在这种情况下,我们提出了一个新的过程,以帮助设计人员在信号时序逻辑(STL)规范的指导下调试Simulink/Stateflow混合系统模型。所提出的方法依赖于三个主要成分:(1)监测和跟踪诊断程序,检查被测试行为是否满足或违反STL规范,定位时间段和接口变量,导致属性违反;(2)将这些可观察的行为片段映射到Simulink模型的内部状态和转换的切片过程;(3)基于频谱的故障定位方法,该方法结合了之前对多个测试的分析,以识别最可能解释故障的内部状态和/或转换。我们证明了我们的方法在汽车和航空电子领域的两个Simulink模型上的适用性。
{"title":"Localizing Faults in Simulink/Stateflow Models with STL","authors":"E. Bartocci, Thomas Ferrère, Niveditha Manjunath, D. Ničković","doi":"10.1145/3178126.3178131","DOIUrl":"https://doi.org/10.1145/3178126.3178131","url":null,"abstract":"Fault-localization is considered to be a very tedious and time-consuming activity in the design of complex Cyber-Physical Systems (CPS). This laborious task essentially requires expert knowledge of the system in order to discover the cause of the fault. In this context, we propose a new procedure that aids designers in debugging Simulink/Stateflow hybrid system models, guided by Signal Temporal Logic (STL) specifications. The proposed method relies on three main ingredients: (1) a monitoring and a trace diagnostics procedure that checks whether a tested behavior satisfies or violates an STL specification, localizes time segments and interfaces variables contributing to the property violations; (2) a slicing procedure that maps these observable behavior segments to the internal states and transitions of the Simulink model; and (3) a spectrum-based fault-localization method that combines the previous analysis from multiple tests to identify the internal states and/or transitions that are the most likely to explain the fault. We demonstrate the applicability of our approach on two Simulink models from the automotive and the avionics domain.","PeriodicalId":131076,"journal":{"name":"Proceedings of the 21st International Conference on Hybrid Systems: Computation and Control (part of CPS Week)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129889844","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 31
Formal Guarantees in Data-Driven Model Identification and Control Synthesis 数据驱动模型识别与控制综合的形式化保证
Sadra Sadraddini, C. Belta
For many performance-critical control systems, an accurate (simple) model is not available in practice. Thus, designing controllers with formal performance guarantees is challenging. In this paper, we develop a framework to use input-output data from an unknown system to synthesize controllers from signal temporal logic (STL) specifications. First, by imposing mild assumptions on system continuity, we find a set-valued piecewise affine (PWA) model that contains all the possible behaviors of the concrete system. Next, we introduce a novel method for STL control of PWA systems with additive disturbances. By taking advantage of STL quantitative semantics, we provide lower-bound certificates on the degree of STL satisfaction of the closed-loop concrete system. Illustrative examples are presented.
对于许多性能关键型控制系统,在实践中没有精确(简单)的模型。因此,设计具有正式性能保证的控制器是具有挑战性的。在本文中,我们开发了一个框架来使用来自未知系统的输入输出数据来从信号时序逻辑(STL)规范合成控制器。首先,通过对系统连续性施加温和的假设,我们找到了包含具体系统所有可能行为的集值分段仿射(PWA)模型。其次,我们介绍了一种新的具有加性扰动的PWA系统的STL控制方法。利用STL定量语义,给出了闭环具体系统对STL满足程度的下界证明。给出了实例说明。
{"title":"Formal Guarantees in Data-Driven Model Identification and Control Synthesis","authors":"Sadra Sadraddini, C. Belta","doi":"10.1145/3178126.3178145","DOIUrl":"https://doi.org/10.1145/3178126.3178145","url":null,"abstract":"For many performance-critical control systems, an accurate (simple) model is not available in practice. Thus, designing controllers with formal performance guarantees is challenging. In this paper, we develop a framework to use input-output data from an unknown system to synthesize controllers from signal temporal logic (STL) specifications. First, by imposing mild assumptions on system continuity, we find a set-valued piecewise affine (PWA) model that contains all the possible behaviors of the concrete system. Next, we introduce a novel method for STL control of PWA systems with additive disturbances. By taking advantage of STL quantitative semantics, we provide lower-bound certificates on the degree of STL satisfaction of the closed-loop concrete system. Illustrative examples are presented.","PeriodicalId":131076,"journal":{"name":"Proceedings of the 21st International Conference on Hybrid Systems: Computation and Control (part of CPS Week)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129324409","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 47
CODEV: Automated Model Predictive Control Design and Formal Verification CODEV:自动模型预测控制设计和形式化验证
Nicole Chan, S. Mitra
We present CODEV, a Matlab-based tool for verifying systems employing Model Predictive Control (MPC). The MPC solution is computed offline and modeled together with the physical system as a hybrid automaton, whose continuous dynamics may be nonlinear with a control solution that remains affine. While MPC is a widely used synthesis technique for constrained and optimal control in industry, our tool provides the first automated approach of analyzing these systems for rigorous guarantees of safety. This is achieved by implementing a simulation-based verification algorithm for nonlinear hybrid models, with extensions tailored to the structure of the MPC solution. Given a physical model and parameters for desired system behavior (i.e. performance and constraints), CODEV generates a control law and verifies the resulting system will robustly maintain constraints. We have applied CODEV successfully to a set of benchmark examples, which illuminates its potential to tackle more complex problems for which MPC is used.
我们提出CODEV,一个基于matlab的工具,用于验证采用模型预测控制(MPC)的系统。MPC解是离线计算的,并与物理系统一起作为混合自动机建模,其连续动力学可能是非线性的,但控制解仍然是仿射的。虽然MPC是一种广泛应用于工业约束和最优控制的综合技术,但我们的工具提供了第一种自动化方法来分析这些系统,以严格保证安全性。这是通过对非线性混合模型实施基于仿真的验证算法来实现的,并根据MPC解决方案的结构进行了扩展。给定一个物理模型和所需系统行为(即性能和约束)的参数,CODEV生成一个控制律,并验证结果系统将健壮地保持约束。我们已经成功地将CODEV应用到一组基准示例中,这说明了它在处理MPC所使用的更复杂问题方面的潜力。
{"title":"CODEV: Automated Model Predictive Control Design and Formal Verification","authors":"Nicole Chan, S. Mitra","doi":"10.1145/3178126.3187003","DOIUrl":"https://doi.org/10.1145/3178126.3187003","url":null,"abstract":"We present CODEV, a Matlab-based tool for verifying systems employing Model Predictive Control (MPC). The MPC solution is computed offline and modeled together with the physical system as a hybrid automaton, whose continuous dynamics may be nonlinear with a control solution that remains affine. While MPC is a widely used synthesis technique for constrained and optimal control in industry, our tool provides the first automated approach of analyzing these systems for rigorous guarantees of safety. This is achieved by implementing a simulation-based verification algorithm for nonlinear hybrid models, with extensions tailored to the structure of the MPC solution. Given a physical model and parameters for desired system behavior (i.e. performance and constraints), CODEV generates a control law and verifies the resulting system will robustly maintain constraints. We have applied CODEV successfully to a set of benchmark examples, which illuminates its potential to tackle more complex problems for which MPC is used.","PeriodicalId":131076,"journal":{"name":"Proceedings of the 21st International Conference on Hybrid Systems: Computation and Control (part of CPS Week)","volume":"64 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-04-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121571657","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Modeling the Impact of Vehicle Platooning on Highway Congestion: A Fluid Queuing Approach 车辆队列对公路拥堵的影响建模:一种流体排队方法
Li Jin, Mladen Čičić, Saurabh Amin, K. Johansson
Vehicle platooning is a promising technology that can lead to significant fuel savings and emission reduction. However, the macroscopic impact of vehicle platoons on highway traffic is not yet well understood. In this article, we propose a new fluid queuing model to study the macroscopic interaction between randomly arriving vehicle platoons and the background traffic at highway bottlenecks. This model, viewed as a stochastic switched system, is analyzed for two practically relevant priority rules: proportional (or mixed) and segmented priority. We provide intuitive stability conditions, and obtain bounds on the long-run average length and variance of queues for both priority rules. We use these results to study how platoon-induced congestion varies with the fraction of platooned vehicles, and their characteristics such as intra-platoon spacing and arrival rate. Our analysis reveals a basic tradeoff between congestion induced by the randomness of platoon arrivals, and efficiency gain due to a tighter intra-platoon spacing. This naturally leads to conditions under which the proportional priority is preferred over segmented priority. Somewhat surprisingly, our analytical results are in agreement with the simulation results based on a more sophisticated two-class cell transmission model.
车辆排队是一项很有前途的技术,可以显著节省燃料和减少排放。然而,车辆排对公路交通的宏观影响尚未得到很好的理解。本文提出了一种新的流体排队模型,用于研究高速公路瓶颈处随机到达的车辆队列与背景交通之间的宏观相互作用。将该模型视为一个随机切换系统,分析了两个实际相关的优先级规则:比例(或混合)优先级和分段优先级。我们提供了直观的稳定性条件,并得到了两种优先级规则下队列的长期平均长度和方差的界。我们利用这些结果来研究队列引起的拥堵如何随队列车辆的比例变化,以及它们的特征,如队列内间距和到达率。我们的分析揭示了由随机队列到达引起的拥堵和由于更紧密的队列间隔而获得的效率之间的基本权衡。这自然会导致比例优先级优于分段优先级的情况。令人惊讶的是,我们的分析结果与基于更复杂的两类细胞传输模型的模拟结果一致。
{"title":"Modeling the Impact of Vehicle Platooning on Highway Congestion: A Fluid Queuing Approach","authors":"Li Jin, Mladen Čičić, Saurabh Amin, K. Johansson","doi":"10.1145/3178126.3178146","DOIUrl":"https://doi.org/10.1145/3178126.3178146","url":null,"abstract":"Vehicle platooning is a promising technology that can lead to significant fuel savings and emission reduction. However, the macroscopic impact of vehicle platoons on highway traffic is not yet well understood. In this article, we propose a new fluid queuing model to study the macroscopic interaction between randomly arriving vehicle platoons and the background traffic at highway bottlenecks. This model, viewed as a stochastic switched system, is analyzed for two practically relevant priority rules: proportional (or mixed) and segmented priority. We provide intuitive stability conditions, and obtain bounds on the long-run average length and variance of queues for both priority rules. We use these results to study how platoon-induced congestion varies with the fraction of platooned vehicles, and their characteristics such as intra-platoon spacing and arrival rate. Our analysis reveals a basic tradeoff between congestion induced by the randomness of platoon arrivals, and efficiency gain due to a tighter intra-platoon spacing. This naturally leads to conditions under which the proportional priority is preferred over segmented priority. Somewhat surprisingly, our analytical results are in agreement with the simulation results based on a more sophisticated two-class cell transmission model.","PeriodicalId":131076,"journal":{"name":"Proceedings of the 21st International Conference on Hybrid Systems: Computation and Control (part of CPS Week)","volume":"257 ","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"113990246","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 30
Lyapunov Design for Event-Triggered Exponential Stabilization 事件触发指数稳定的Lyapunov设计
A. Proskurnikov, M. Mazo
Control Lyapunov Functions (CLF) method gives a constructive tool for stabilization of nonlinear systems. To find a CLF, many methods have been proposed in the literature, e.g. backstepping for cascaded systems and sum of squares (SOS) programming for polynomial systems. Dealing with continuous-time systems, the CLF-based controller is also continuous-time, whereas practical implementation on a digital platform requires sampled-time control. In this paper, we show that if the continuous-time controller provides exponential stabilization, then an exponentially stabilizing event-triggered control strategy exists with the convergence rate arbitrarily close to the rate of the continuous-time system.
控制李雅普诺夫函数(CLF)方法为非线性系统的镇定提供了一种建设性的工具。为了找到CLF,文献中已经提出了许多方法,例如级联系统的反演和多项式系统的平方和(SOS)规划。处理连续时间系统时,基于clf的控制器也是连续时间的,而在数字平台上的实际实现需要采样时间控制。本文证明了如果连续时间控制器具有指数镇定性,则存在一种收敛速度任意接近连续时间系统收敛速度的指数镇定事件触发控制策略。
{"title":"Lyapunov Design for Event-Triggered Exponential Stabilization","authors":"A. Proskurnikov, M. Mazo","doi":"10.1145/3178126.3178142","DOIUrl":"https://doi.org/10.1145/3178126.3178142","url":null,"abstract":"Control Lyapunov Functions (CLF) method gives a constructive tool for stabilization of nonlinear systems. To find a CLF, many methods have been proposed in the literature, e.g. backstepping for cascaded systems and sum of squares (SOS) programming for polynomial systems. Dealing with continuous-time systems, the CLF-based controller is also continuous-time, whereas practical implementation on a digital platform requires sampled-time control. In this paper, we show that if the continuous-time controller provides exponential stabilization, then an exponentially stabilizing event-triggered control strategy exists with the convergence rate arbitrarily close to the rate of the continuous-time system.","PeriodicalId":131076,"journal":{"name":"Proceedings of the 21st International Conference on Hybrid Systems: Computation and Control (part of CPS Week)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-02-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129070226","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Reach Set Approximation through Decomposition with Low-dimensional Sets and High-dimensional Matrices 通过低维集合和高维矩阵的分解达到集合逼近
Sergiy Bogomolov, M. Forets, Goran Frehse, A. Podelski, Christian Schilling, Fr'ed'eric Viry
Approximating the set of reachable states of a dynamical system is an algorithmic yet mathematically rigorous way to reason about its safety. Although progress has been made in the development of efficient algorithms for affine dynamical systems, available algorithms still lack scalability to ensure their wide adoption in the industrial setting. While modern linear algebra packages are efficient for matrices with tens of thousands of dimensions, set-based image computations are limited to a few hundred. We propose to decompose reach set computations such that set operations are performed in low dimensions, while matrix operations like exponentiation are carried out in the full dimension. Our method is applicable both in dense- and discrete-time settings. For a set of standard benchmarks, it shows a speed-up of up to two orders of magnitude compared to the respective state-of-the-art tools, with only modest losses in accuracy. For the dense-time case, we show an experiment with more than 10,000 variables, roughly two orders of magnitude higher than possible with previous approaches.
逼近动力系统的可达状态集是一种算法上但在数学上严格的方法来推断其安全性。虽然在发展仿射动力系统的有效算法方面取得了进展,但现有的算法仍然缺乏可扩展性,以确保它们在工业环境中的广泛采用。虽然现代线性代数包对于具有数万维的矩阵是有效的,但基于集合的图像计算仅限于几百维。我们建议分解到达集计算,使集合操作在低维中执行,而像幂运算这样的矩阵操作在全维中进行。我们的方法适用于密集时间和离散时间设置。对于一组标准基准测试,与各自最先进的工具相比,它显示了高达两个数量级的加速,而精度只有轻微的损失。对于密集时间的情况,我们展示了一个有超过10,000个变量的实验,大约比以前的方法高两个数量级。
{"title":"Reach Set Approximation through Decomposition with Low-dimensional Sets and High-dimensional Matrices","authors":"Sergiy Bogomolov, M. Forets, Goran Frehse, A. Podelski, Christian Schilling, Fr'ed'eric Viry","doi":"10.1145/3178126.3178128","DOIUrl":"https://doi.org/10.1145/3178126.3178128","url":null,"abstract":"Approximating the set of reachable states of a dynamical system is an algorithmic yet mathematically rigorous way to reason about its safety. Although progress has been made in the development of efficient algorithms for affine dynamical systems, available algorithms still lack scalability to ensure their wide adoption in the industrial setting. While modern linear algebra packages are efficient for matrices with tens of thousands of dimensions, set-based image computations are limited to a few hundred. We propose to decompose reach set computations such that set operations are performed in low dimensions, while matrix operations like exponentiation are carried out in the full dimension. Our method is applicable both in dense- and discrete-time settings. For a set of standard benchmarks, it shows a speed-up of up to two orders of magnitude compared to the respective state-of-the-art tools, with only modest losses in accuracy. For the dense-time case, we show an experiment with more than 10,000 variables, roughly two orders of magnitude higher than possible with previous approaches.","PeriodicalId":131076,"journal":{"name":"Proceedings of the 21st International Conference on Hybrid Systems: Computation and Control (part of CPS Week)","volume":"79 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-01-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125004412","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 41
From Uncertainty Data to Robust Policies for Temporal Logic Planning 从不确定性数据到时间逻辑规划的鲁棒策略
Pier Giuseppe Sessa, D. Frick, Tony A. Wood, M. Kamgarpour
We consider the problem of synthesizing robust disturbance feedback policies for systems performing complex tasks. We formulate the tasks as linear temporal logic specifications and encode them into an optimization framework via mixed-integer constraints. Both the system dynamics and the specifications are known but affected by uncertainty. The distribution of the uncertainty is unknown, however realizations can be obtained. We introduce a data-driven approach where the constraints are fulfilled for a set of realizations and provide probabilistic generalization guarantees as a function of the number of considered realizations. We use separate chance constraints for the satisfaction of the specification and operational constraints. This allows us to quantify their violation probabilities independently. We compute disturbance feedback policies as solutions of mixed-integer linear or quadratic optimization problems. By using feedback we can exploit information of past realizations and provide feasibility for a wider range of situations compared to static input sequences. We demonstrate the proposed method on two robust motion-planning case studies for autonomous driving.
研究了复杂任务系统的鲁棒干扰反馈策略的合成问题。我们将任务表述为线性时间逻辑规范,并通过混合整数约束将其编码为优化框架。系统动力学和规格都是已知的,但受不确定性的影响。不确定性的分布是未知的,但是可以得到实现。我们引入了一种数据驱动的方法,其中满足了一组实现的约束,并提供了概率泛化保证,作为考虑的实现数量的函数。我们使用单独的机会约束来满足规范和操作约束。这使我们能够独立地量化它们的违反概率。我们计算扰动反馈策略作为混合整数线性或二次优化问题的解。通过使用反馈,我们可以利用过去实现的信息,与静态输入序列相比,为更广泛的情况提供可行性。我们在自动驾驶的两个鲁棒运动规划案例研究中展示了所提出的方法。
{"title":"From Uncertainty Data to Robust Policies for Temporal Logic Planning","authors":"Pier Giuseppe Sessa, D. Frick, Tony A. Wood, M. Kamgarpour","doi":"10.1145/3178126.3178136","DOIUrl":"https://doi.org/10.1145/3178126.3178136","url":null,"abstract":"We consider the problem of synthesizing robust disturbance feedback policies for systems performing complex tasks. We formulate the tasks as linear temporal logic specifications and encode them into an optimization framework via mixed-integer constraints. Both the system dynamics and the specifications are known but affected by uncertainty. The distribution of the uncertainty is unknown, however realizations can be obtained. We introduce a data-driven approach where the constraints are fulfilled for a set of realizations and provide probabilistic generalization guarantees as a function of the number of considered realizations. We use separate chance constraints for the satisfaction of the specification and operational constraints. This allows us to quantify their violation probabilities independently. We compute disturbance feedback policies as solutions of mixed-integer linear or quadratic optimization problems. By using feedback we can exploit information of past realizations and provide feasibility for a wider range of situations compared to static input sequences. We demonstrate the proposed method on two robust motion-planning case studies for autonomous driving.","PeriodicalId":131076,"journal":{"name":"Proceedings of the 21st International Conference on Hybrid Systems: Computation and Control (part of CPS Week)","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122215405","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
From Dissipativity Theory to Compositional Construction of Finite Markov Decision Processes 从耗散理论到有限马尔可夫决策过程的组合构造
Abolfazl Lavaei, S. Soudjani, Majid Zamani
This paper is concerned with a compositional approach for constructing finite Markov decision processes of interconnected discrete-time stochastic control systems. The proposed approach leverages the interconnection topology and a notion of so-called stochastic storage functions describing joint dissipativity-type properties of subsystems and their abstractions. In the first part of the paper, we derive dissipativity-type compositional conditions for quantifying the error between the interconnection of stochastic control subsystems and that of their abstractions. In the second part of the paper, we propose an approach to construct finite Markov decision processes together with their corresponding stochastic storage functions for classes of discrete-time control systems satisfying some incremental passivablity property. Under this property, one can construct finite Markov decision processes by a suitable discretization of the input and state sets. Moreover, we show that for linear stochastic control systems, the aforementioned property can be readily checked by some matrix inequality. We apply our proposed results to the temperature regulation in a circular building by constructing compositionally a finite Markov decision process of a network containing 200 rooms in which the compositionality condition does not require any constraint on the number or gains of the subsystems. We employ the constructed finite Markov decision process as a substitute to synthesize policies regulating the temperature in each room for a bounded time horizon. We also illustrate the effectiveness of our results on an example of fully connected network.
本文研究了一种构造互联离散随机控制系统有限马尔可夫决策过程的组合方法。所提出的方法利用互连拓扑和所谓的随机存储函数的概念,描述子系统及其抽象的联合耗散类型属性。在本文的第一部分中,我们导出了用于量化随机控制子系统互连与抽象子系统互连误差的耗散型组合条件。在论文的第二部分,我们提出了一类满足增量无源性的离散时间控制系统的有限马尔可夫决策过程及其相应的随机存储函数的构造方法。根据这一性质,可以通过适当的离散化输入集和状态集来构造有限马尔可夫决策过程。此外,我们还证明了对于线性随机控制系统,上述性质可以很容易地用一些矩阵不等式来检验。我们通过构造包含200个房间的网络的组合有限马尔可夫决策过程,将我们提出的结果应用于圆形建筑的温度调节,其中组合性条件不需要对子系统的数量或增益进行任何约束。我们使用构造的有限马尔可夫决策过程作为替代,在有限的时间范围内合成调节每个房间温度的策略。我们还在一个全连接网络的例子上说明了我们的结果的有效性。
{"title":"From Dissipativity Theory to Compositional Construction of Finite Markov Decision Processes","authors":"Abolfazl Lavaei, S. Soudjani, Majid Zamani","doi":"10.1145/3178126.3178135","DOIUrl":"https://doi.org/10.1145/3178126.3178135","url":null,"abstract":"This paper is concerned with a compositional approach for constructing finite Markov decision processes of interconnected discrete-time stochastic control systems. The proposed approach leverages the interconnection topology and a notion of so-called stochastic storage functions describing joint dissipativity-type properties of subsystems and their abstractions. In the first part of the paper, we derive dissipativity-type compositional conditions for quantifying the error between the interconnection of stochastic control subsystems and that of their abstractions. In the second part of the paper, we propose an approach to construct finite Markov decision processes together with their corresponding stochastic storage functions for classes of discrete-time control systems satisfying some incremental passivablity property. Under this property, one can construct finite Markov decision processes by a suitable discretization of the input and state sets. Moreover, we show that for linear stochastic control systems, the aforementioned property can be readily checked by some matrix inequality. We apply our proposed results to the temperature regulation in a circular building by constructing compositionally a finite Markov decision process of a network containing 200 rooms in which the compositionality condition does not require any constraint on the number or gains of the subsystems. We employ the constructed finite Markov decision process as a substitute to synthesize policies regulating the temperature in each room for a bounded time horizon. We also illustrate the effectiveness of our results on an example of fully connected network.","PeriodicalId":131076,"journal":{"name":"Proceedings of the 21st International Conference on Hybrid Systems: Computation and Control (part of CPS Week)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116358555","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 38
DSValidator: An Automated Counterexample Reproducibility Tool for Digital Systems DSValidator:数字系统的自动反例再现工具
Lennon C. Chaves, I. Bessa, L. Cordeiro
We present an automated counterexample reproducibility tool based on MATLAB, called DSValidator, with the goal of reproducing counterexamples that refute specific properties related to digital systems. We exploit counterexamples generated by the Digital System Verifier (DSVerifier), which is a model checking tool based on satisfiability modulo theories for digital systems. DSValidator reproduces the execution of a digital system, relating its input with the counterexample, in order to establish trust in a verification result. We show that DSValidator can validate a set of intricate counterexamples for digital controllers used in a real quadrotor attitude system within seconds and also expose incorrect verification results in DSVerifier. The resulting toolbox leverages the potential of combining different verification tools for validating digital systems via an exchangeable counterexample format.
我们提出了一个基于MATLAB的自动反例再现工具,称为DSValidator,其目标是再现反驳与数字系统相关的特定属性的反例。我们利用数字系统验证器(DSVerifier)生成的反例,DSVerifier是一种基于数字系统可满足模理论的模型检查工具。DSValidator再现数字系统的执行,将其输入与反例联系起来,以便在验证结果中建立信任。我们表明DSValidator可以在几秒钟内验证真实四旋翼姿态系统中使用的数字控制器的一组复杂反例,并且还会在DSVerifier中暴露不正确的验证结果。由此产生的工具箱利用组合不同验证工具的潜力,通过可交换的反例格式来验证数字系统。
{"title":"DSValidator: An Automated Counterexample Reproducibility Tool for Digital Systems","authors":"Lennon C. Chaves, I. Bessa, L. Cordeiro","doi":"10.1145/3178126.3178151","DOIUrl":"https://doi.org/10.1145/3178126.3178151","url":null,"abstract":"We present an automated counterexample reproducibility tool based on MATLAB, called DSValidator, with the goal of reproducing counterexamples that refute specific properties related to digital systems. We exploit counterexamples generated by the Digital System Verifier (DSVerifier), which is a model checking tool based on satisfiability modulo theories for digital systems. DSValidator reproduces the execution of a digital system, relating its input with the counterexample, in order to establish trust in a verification result. We show that DSValidator can validate a set of intricate counterexamples for digital controllers used in a real quadrotor attitude system within seconds and also expose incorrect verification results in DSVerifier. The resulting toolbox leverages the potential of combining different verification tools for validating digital systems via an exchangeable counterexample format.","PeriodicalId":131076,"journal":{"name":"Proceedings of the 21st International Conference on Hybrid Systems: Computation and Control (part of CPS Week)","volume":"205 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114407852","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Proceedings of the 21st International Conference on Hybrid Systems: Computation and Control (part of CPS Week) 第21届混合系统国际会议论文集:计算与控制(CPS周的一部分)
{"title":"Proceedings of the 21st International Conference on Hybrid Systems: Computation and Control (part of CPS Week)","authors":"","doi":"10.1145/3178126","DOIUrl":"https://doi.org/10.1145/3178126","url":null,"abstract":"","PeriodicalId":131076,"journal":{"name":"Proceedings of the 21st International Conference on Hybrid Systems: Computation and Control (part of CPS Week)","volume":"133 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122185511","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
期刊
Proceedings of the 21st International Conference on Hybrid Systems: Computation and Control (part of CPS Week)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1