首页 > 最新文献

Annual Reviews in Control最新文献

英文 中文
Formal synthesis of controllers for safety-critical autonomous systems: Developments and challenges 安全关键型自主系统控制器的形式合成:发展与挑战
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2024-01-01 DOI: 10.1016/j.arcontrol.2024.100940
Xiang Yin , Bingzhao Gao , Xiao Yu

In recent years, formal methods have been extensively used in the design of autonomous systems. By employing mathematically rigorous techniques, formal methods can provide fully automated reasoning processes with provable safety guarantees for complex dynamic systems with intricate interactions between continuous dynamics and discrete logics. This paper provides a comprehensive review of formal controller synthesis techniques for safety-critical autonomous systems. Specifically, we categorize the formal control synthesis problem based on diverse system models, encompassing deterministic, non-deterministic, and stochastic, and various formal safety-critical specifications involving logic, real-time, and real-valued domains. The review covers fundamental formal control synthesis techniques, including abstraction-based approaches and abstraction-free methods. We explore the integration of data-driven synthesis approaches in formal control synthesis. Furthermore, we review formal techniques tailored for multi-agent systems (MAS), with a specific focus on various approaches to address the scalability challenges in large-scale systems. Finally, we discuss some recent trends and highlight research challenges in this area.

近年来,形式化方法被广泛应用于自主系统的设计。通过采用数学上严格的技术,形式化方法可以为连续动态和离散逻辑之间存在复杂交互的复杂动态系统提供可证明安全保证的全自动推理过程。本文全面回顾了用于安全关键型自主系统的形式控制器合成技术。具体来说,我们根据确定性、非确定性和随机性等不同系统模型,以及涉及逻辑、实时和实值域的各种形式化安全关键规范,对形式化控制合成问题进行了分类。综述涵盖了基本的形式控制合成技术,包括基于抽象的方法和无抽象方法。我们探讨了形式控制合成中数据驱动合成方法的集成。此外,我们还综述了为多代理系统(MAS)量身定制的形式化技术,特别关注解决大规模系统中可扩展性挑战的各种方法。最后,我们讨论了该领域的一些最新趋势,并强调了该领域的研究挑战。
{"title":"Formal synthesis of controllers for safety-critical autonomous systems: Developments and challenges","authors":"Xiang Yin ,&nbsp;Bingzhao Gao ,&nbsp;Xiao Yu","doi":"10.1016/j.arcontrol.2024.100940","DOIUrl":"https://doi.org/10.1016/j.arcontrol.2024.100940","url":null,"abstract":"<div><p>In recent years, <em>formal methods</em> have been extensively used in the design of autonomous systems. By employing mathematically rigorous techniques, formal methods can provide fully automated reasoning processes with provable safety guarantees for complex dynamic systems with intricate interactions between continuous dynamics and discrete logics. This paper provides a comprehensive review of formal controller synthesis techniques for safety-critical autonomous systems. Specifically, we categorize the formal control synthesis problem based on diverse system models, encompassing deterministic, non-deterministic, and stochastic, and various formal safety-critical specifications involving logic, real-time, and real-valued domains. The review covers fundamental formal control synthesis techniques, including abstraction-based approaches and abstraction-free methods. We explore the integration of data-driven synthesis approaches in formal control synthesis. Furthermore, we review formal techniques tailored for multi-agent systems (MAS), with a specific focus on various approaches to address the scalability challenges in large-scale systems. Finally, we discuss some recent trends and highlight research challenges in this area.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140103572","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Advances in the Theory of Control Barrier Functions: Addressing practical challenges in safe control synthesis for autonomous and robotic systems 控制障碍函数理论的进展:应对自主系统和机器人系统安全控制合成的实际挑战
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2024-01-01 DOI: 10.1016/j.arcontrol.2024.100945
Kunal Garg , James Usevitch , Joseph Breeden , Mitchell Black , Devansh Agrawal , Hardik Parwana , Dimitra Panagou

This tutorial paper presents recent work of the authors that extends the theory of Control Barrier Functions (CBFs) to address practical challenges in the synthesis of safe controllers for autonomous systems and robots. We present novel CBFs and methods that handle safety constraints (i) with time and input constraints under disturbances, (ii) with high-relative degree under disturbances and input constraints, and (iii) that are affected by adversarial inputs and sampled-data effects. We then present novel CBFs and adaptation methods that prevent loss of validity of the CBF, as well as methods to tune the parameters of the CBF online to reduce conservatism in the system response. We also address the pointwise-only optimal character of CBF-induced control inputs by introducing a CBF formulation that accounts for future trajectories, as well as implementation challenges such as how to preserve safety when using output feedback control and zero-order-hold control. Finally we consider how to synthesize non-smooth CBFs when discontinuous inputs and multiple constraints are present.

这篇教程论文介绍了作者的最新研究成果,这些成果扩展了控制障碍函数(CBF)理论,以解决自主系统和机器人安全控制器合成中的实际挑战。我们提出了新颖的 CBF 和方法,用于处理以下安全约束:(i) 在干扰下具有时间和输入约束;(ii) 在干扰和输入约束下具有高相对度;(iii) 受对抗性输入和采样数据影响。然后,我们提出了新的 CBF 和可防止 CBF 失去有效性的适应方法,以及在线调整 CBF 参数以减少系统响应保守性的方法。我们还通过引入一种考虑到未来轨迹的 CBF 方案,解决了 CBF 诱导的控制输入仅具有点状最优特性的问题,并解决了一些实施难题,如在使用输出反馈控制和零阶保持控制时如何保持安全性。最后,我们还考虑了在存在不连续输入和多重约束的情况下,如何合成非光滑的 CBF。
{"title":"Advances in the Theory of Control Barrier Functions: Addressing practical challenges in safe control synthesis for autonomous and robotic systems","authors":"Kunal Garg ,&nbsp;James Usevitch ,&nbsp;Joseph Breeden ,&nbsp;Mitchell Black ,&nbsp;Devansh Agrawal ,&nbsp;Hardik Parwana ,&nbsp;Dimitra Panagou","doi":"10.1016/j.arcontrol.2024.100945","DOIUrl":"https://doi.org/10.1016/j.arcontrol.2024.100945","url":null,"abstract":"<div><p>This tutorial paper presents recent work of the authors that extends the theory of Control Barrier Functions (CBFs) to address practical challenges in the synthesis of safe controllers for autonomous systems and robots. We present novel CBFs and methods that handle safety constraints (i) with time and input constraints under disturbances, (ii) with high-relative degree under disturbances and input constraints, and (iii) that are affected by adversarial inputs and sampled-data effects. We then present novel CBFs and adaptation methods that prevent loss of validity of the CBF, as well as methods to tune the parameters of the CBF online to reduce conservatism in the system response. We also address the pointwise-only optimal character of CBF-induced control inputs by introducing a CBF formulation that accounts for future trajectories, as well as implementation challenges such as how to preserve safety when using output feedback control and zero-order-hold control. Finally we consider how to synthesize non-smooth CBFs when discontinuous inputs and multiple constraints are present.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140103574","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Safety-critical control for autonomous systems: Control barrier functions via reduced-order models 自主系统的安全关键控制:通过简化模型实现控制障碍功能
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2024-01-01 DOI: 10.1016/j.arcontrol.2024.100947
Max H. Cohen , Tamas G. Molnar , Aaron D. Ames

Modern autonomous systems, such as flying, legged, and wheeled robots, are generally characterized by high-dimensional nonlinear dynamics, which presents challenges for model-based safety-critical control design. Motivated by the success of reduced-order models in robotics, this paper presents a tutorial on constructive safety-critical control via reduced-order models and control barrier functions (CBFs). To this end, we provide a unified formulation of techniques in the literature that share a common foundation of constructing CBFs for complex systems from CBFs for much simpler systems. Such ideas are illustrated through formal results, simple numerical examples, and case studies of real-world systems to which these techniques have been experimentally applied.

现代自主系统(如飞行机器人、腿式机器人和轮式机器人)通常具有高维非线性动力学特征,这给基于模型的安全关键控制设计带来了挑战。受减阶模型在机器人学中取得成功的启发,本文介绍了通过减阶模型和控制障碍函数(CBF)进行建设性安全临界控制的教程。为此,我们对文献中的技术进行了统一表述,这些技术有一个共同的基础,即从简单得多的系统的 CBF 中构建复杂系统的 CBF。我们将通过正式结果、简单的数值示例和实际系统的案例研究来说明这些观点,并在实验中应用了这些技术。
{"title":"Safety-critical control for autonomous systems: Control barrier functions via reduced-order models","authors":"Max H. Cohen ,&nbsp;Tamas G. Molnar ,&nbsp;Aaron D. Ames","doi":"10.1016/j.arcontrol.2024.100947","DOIUrl":"https://doi.org/10.1016/j.arcontrol.2024.100947","url":null,"abstract":"<div><p>Modern autonomous systems, such as flying, legged, and wheeled robots, are generally characterized by high-dimensional nonlinear dynamics, which presents challenges for model-based safety-critical control design. Motivated by the success of reduced-order models in robotics, this paper presents a tutorial on constructive safety-critical control via reduced-order models and control barrier functions (CBFs). To this end, we provide a unified formulation of techniques in the literature that share a common foundation of constructing CBFs for complex systems from CBFs for much simpler systems. Such ideas are illustrated through formal results, simple numerical examples, and case studies of real-world systems to which these techniques have been experimentally applied.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140134705","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Cooperative control of heterogeneous multi-agent systems under spatiotemporal constraints 时空约束下异构多代理系统的协同控制
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2024-01-01 DOI: 10.1016/j.arcontrol.2024.100946
Fei Chen, Mayank Sewlia, Dimos V. Dimarogonas

A current trend in research on multi-agent control systems is to consider high-level task specifications that go beyond traditional control objectives and take into account the heterogeneity of each agent in the system, i.e., the different capabilities of the agents in terms of actuation, sensing, communication and computation. This article provides an overview of our work on the problem of control of heterogeneous multi-agent systems under both spatial and temporal constraints as well as our perspective on the challenges and open problems associated with the consideration of such spatiotemporal constraints. Initially, we review a set of control strategies introduced by the authors addressing the satisfaction of cooperative tasks such as formation control as well as individual objectives such as reference tracking. The satisfaction of those objectives is ensured using prescribed performance control. Building upon these approaches we then review recent results on control under high-level spatiotemporal objectives expressed in Signal Temporal Logic, a formal language that allows to express complex spatial tasks that must be satisfied within pre-defined deadlines. Theoretical results considering multi-agent systems with various capabilities under spatiotemporal constraints are presented.

当前多代理控制系统研究的一个趋势是考虑高层次的任务规范,这些规范超越了传统的控制目标,并考虑到了系统中每个代理的异质性,即代理在执行、传感、通信和计算方面的不同能力。本文概述了我们在空间和时间约束条件下异构多代理系统控制问题上所做的工作,以及我们对与考虑此类时空约束条件相关的挑战和未决问题的看法。首先,我们回顾了作者提出的一系列控制策略,这些策略既要满足编队控制等合作任务的要求,又要满足参考跟踪等单个目标的要求。这些目标的满足是通过规定的性能控制来保证的。在这些方法的基础上,我们回顾了最近在高层次时空目标控制方面取得的成果,这些目标是用信号时空逻辑(Signal Temporal Logic)表达的,这种形式语言可以表达必须在预定期限内完成的复杂空间任务。我们还介绍了在时空约束条件下具有各种能力的多机器人系统的理论成果。
{"title":"Cooperative control of heterogeneous multi-agent systems under spatiotemporal constraints","authors":"Fei Chen,&nbsp;Mayank Sewlia,&nbsp;Dimos V. Dimarogonas","doi":"10.1016/j.arcontrol.2024.100946","DOIUrl":"https://doi.org/10.1016/j.arcontrol.2024.100946","url":null,"abstract":"<div><p>A current trend in research on multi-agent control systems is to consider high-level task specifications that go beyond traditional control objectives and take into account the heterogeneity of each agent in the system, i.e., the different capabilities of the agents in terms of actuation, sensing, communication and computation. This article provides an overview of our work on the problem of control of heterogeneous multi-agent systems under both spatial and temporal constraints as well as our perspective on the challenges and open problems associated with the consideration of such spatiotemporal constraints. Initially, we review a set of control strategies introduced by the authors addressing the satisfaction of cooperative tasks such as formation control as well as individual objectives such as reference tracking. The satisfaction of those objectives is ensured using prescribed performance control. Building upon these approaches we then review recent results on control under high-level spatiotemporal objectives expressed in Signal Temporal Logic, a formal language that allows to express complex spatial tasks that must be satisfied within pre-defined deadlines. Theoretical results considering multi-agent systems with various capabilities under spatiotemporal constraints are presented.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1367578824000154/pdfft?md5=97c17641fe2f8ee3e9875a3854c47e43&pid=1-s2.0-S1367578824000154-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140137780","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Analysis and design of model predictive control frameworks for dynamic operation—An overview 动态运行模型预测控制框架的分析与设计--概述
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2024-01-01 DOI: 10.1016/j.arcontrol.2023.100929
Johannes Köhler , Matthias A. Müller , Frank Allgöwer

This article provides an overview of model predictive control (MPC) frameworks for dynamic operation of nonlinear constrained systems. Dynamic operation is often an integral part of the control objective, ranging from tracking of reference signals to the general economic operation of a plant under online changing time-varying operating conditions. We focus on the particular challenges that arise when dealing with such more general control goals and present methods that have emerged in the literature to address these issues. The goal of this article is to present an overview of the state-of-the-art techniques, providing a diverse toolkit to apply and further develop MPC formulations that can handle the challenges intrinsic to dynamic operation. We also critically assess the applicability of the different research directions, discussing limitations and opportunities for further research.

本文概述了用于非线性约束系统动态运行的模型预测控制(MPC)框架。动态运行通常是控制目标不可分割的一部分,从跟踪参考信号到在线时变运行条件下工厂的一般经济运行,不一而足。我们将重点关注在处理此类更一般的控制目标时出现的特殊挑战,并介绍文献中出现的解决这些问题的方法。本文的目的是概述最先进的技术,为应用和进一步开发可应对动态运行固有挑战的 MPC 配方提供多样化的工具包。我们还严格评估了不同研究方向的适用性,讨论了进一步研究的局限性和机遇。
{"title":"Analysis and design of model predictive control frameworks for dynamic operation—An overview","authors":"Johannes Köhler ,&nbsp;Matthias A. Müller ,&nbsp;Frank Allgöwer","doi":"10.1016/j.arcontrol.2023.100929","DOIUrl":"https://doi.org/10.1016/j.arcontrol.2023.100929","url":null,"abstract":"<div><p>This article provides an overview of model predictive control (MPC) frameworks for dynamic operation of nonlinear constrained systems. Dynamic operation is often an integral part of the control objective, ranging from tracking of reference signals to the general economic operation of a plant under online changing time-varying operating conditions. We focus on the particular challenges that arise when dealing with such more general control goals and present methods that have emerged in the literature to address these issues. The goal of this article is to present an overview of the state-of-the-art techniques, providing a diverse toolkit to apply and further develop MPC formulations that can handle the challenges intrinsic to dynamic operation. We also critically assess the applicability of the different research directions, discussing limitations and opportunities for further research.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1367578823000937/pdfft?md5=af3388bebc701ddd116a994fa3e12c46&pid=1-s2.0-S1367578823000937-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139399409","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Lateral control for autonomous vehicles: A comparative evaluation 自动驾驶汽车横向控制:比较评价
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2023-11-03 DOI: 10.1016/j.arcontrol.2023.100910
Antonio Artuñedo, Marcos Moreno-Gonzalez, Jorge Villagra

The selection of an appropriate control strategy is essential for ensuring safe operation in autonomous driving. While numerous control strategies have been developed for specific driving scenarios, a comprehensive comparative assessment of their performance using the same tuning methodology is lacking in the literature. This paper addresses this gap by presenting a systematic evaluation of state-of-the-art model-free and model-based control strategies. The objective is to evaluate and contrast the performance of these controllers across a wide range of driving scenarios, reflecting the diverse needs of autonomous vehicles. To facilitate the comparative analysis, a comprehensive set of performance metrics is selected, encompassing accuracy, robustness, and comfort. The contributions of this research include the design of a systematic tuning methodology, the use of two novel metrics for stability and comfort comparisons and the evaluation through extensive simulations and real tests in an experimental instrumented vehicle over a wide range of trajectories.

选择合适的控制策略对于确保自动驾驶的安全运行至关重要。虽然已经为特定的驾驶场景开发了许多控制策略,但文献中缺乏使用相同调整方法对其性能进行全面的比较评估。本文通过对最先进的无模型和基于模型的控制策略进行系统评估来解决这一差距。目标是评估和对比这些控制器在各种驾驶场景中的性能,反映自动驾驶汽车的不同需求。为了便于比较分析,选择了一套全面的性能指标,包括准确性、稳健性和舒适性。这项研究的贡献包括设计一种系统的调整方法,使用两种新的指标进行稳定性和舒适性比较,以及通过在实验仪器车辆中进行广泛的模拟和实际测试来评估各种轨迹。
{"title":"Lateral control for autonomous vehicles: A comparative evaluation","authors":"Antonio Artuñedo,&nbsp;Marcos Moreno-Gonzalez,&nbsp;Jorge Villagra","doi":"10.1016/j.arcontrol.2023.100910","DOIUrl":"https://doi.org/10.1016/j.arcontrol.2023.100910","url":null,"abstract":"<div><p>The selection of an appropriate control strategy is essential for ensuring safe operation in autonomous driving. While numerous control strategies have been developed for specific driving scenarios, a comprehensive comparative assessment of their performance using the same tuning methodology is lacking in the literature. This paper addresses this gap by presenting a systematic evaluation of state-of-the-art model-free and model-based control strategies. The objective is to evaluate and contrast the performance of these controllers across a wide range of driving scenarios, reflecting the diverse needs of autonomous vehicles. To facilitate the comparative analysis, a comprehensive set of performance metrics is selected, encompassing accuracy, robustness, and comfort. The contributions of this research include the design of a systematic tuning methodology, the use of two novel metrics for stability and comfort comparisons and the evaluation through extensive simulations and real tests in an experimental instrumented vehicle over a wide range of trajectories.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2023-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71765855","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Survey of Feedback Particle Filter and related Controlled Interacting Particle Systems (CIPS) 反馈粒子滤波及相关可控相互作用粒子系统(CIPS)综述
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2023-01-03 DOI: 10.48550/arXiv.2301.00935
A. Taghvaei, P. Mehta
In this survey, we describe controlled interacting particle systems (CIPS) to approximate the solution of the optimal filtering and the optimal control problems. Part I of the survey is focussed on the feedback particle filter (FPF) algorithm, its derivation based on optimal transportation theory, and its relationship to the ensemble Kalman filter (EnKF) and the conventional sequential importance sampling-resampling (SIR) particle filters. The central numerical problem of FPF -- to approximate the solution of the Poisson equation -- is described together with the main solution approaches. An analytical and numerical comparison with the SIR particle filter is given to illustrate the advantages of the CIPS approach. Part II of the survey is focussed on adapting these algorithms for the problem of reinforcement learning. The survey includes several remarks that describe extensions as well as open problems in this subject.
在本文中,我们描述了受控相互作用粒子系统(CIPS)来近似求解最优滤波和最优控制问题。第一部分重点介绍了反馈粒子滤波(FPF)算法及其基于最优输运理论的推导,以及它与集合卡尔曼滤波(EnKF)和传统的顺序重要采样-重采样(SIR)粒子滤波的关系。描述了FPF的核心数值问题——逼近泊松方程的解——以及主要的求解方法。通过与SIR粒子滤波的分析和数值比较,说明了CIPS方法的优越性。调查的第二部分侧重于将这些算法用于强化学习问题。这篇综述包括了一些描述扩展的评论,以及本主题中尚未解决的问题。
{"title":"A Survey of Feedback Particle Filter and related Controlled Interacting Particle Systems (CIPS)","authors":"A. Taghvaei, P. Mehta","doi":"10.48550/arXiv.2301.00935","DOIUrl":"https://doi.org/10.48550/arXiv.2301.00935","url":null,"abstract":"In this survey, we describe controlled interacting particle systems (CIPS) to approximate the solution of the optimal filtering and the optimal control problems. Part I of the survey is focussed on the feedback particle filter (FPF) algorithm, its derivation based on optimal transportation theory, and its relationship to the ensemble Kalman filter (EnKF) and the conventional sequential importance sampling-resampling (SIR) particle filters. The central numerical problem of FPF -- to approximate the solution of the Poisson equation -- is described together with the main solution approaches. An analytical and numerical comparison with the SIR particle filter is given to illustrate the advantages of the CIPS approach. Part II of the survey is focussed on adapting these algorithms for the problem of reinforcement learning. The survey includes several remarks that describe extensions as well as open problems in this subject.","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2023-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83593288","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Modeling and control of overhead cranes: A tutorial overview and perspectives 桥式起重机的建模和控制:教程概述和观点
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2023-01-01 DOI: 10.1016/j.arcontrol.2023.03.002
Mohammad Rasool Mojallizadeh , Bernard Brogliato , Christophe Prieur

This article presents a complete review of the modeling and control schemes for overhead cranes operating in 2D and 3D spaces published to date. The modeling schemes including the pendulum-like models with rigid and flexible links are reviewed and their key characteristics are studied. Subsequently, an overview of the control methods developed for such models is presented. Afterward, a new simulation-oriented model enabling to capture both cables’ dynamic and global nonlinearities caused by the pendulation is developed, and different control methods that exist in the literature are evaluated and compared based on this model using numerical experiments. In the end, several research gaps are identified to be considered in future works.

本文全面回顾了迄今为止已发表的在二维和三维空间中运行的桥式起重机的建模和控制方案。文章回顾了包括具有刚性和柔性链接的摆锤模型在内的建模方案,并研究了它们的主要特征。随后,概述了针对此类模型开发的控制方法。随后,开发了一种新的面向仿真的模型,该模型能够捕捉到由摆动引起的缆索动态和全局非线性特性,并基于该模型通过数值实验对文献中存在的不同控制方法进行了评估和比较。最后,确定了未来工作中需要考虑的几项研究空白。
{"title":"Modeling and control of overhead cranes: A tutorial overview and perspectives","authors":"Mohammad Rasool Mojallizadeh ,&nbsp;Bernard Brogliato ,&nbsp;Christophe Prieur","doi":"10.1016/j.arcontrol.2023.03.002","DOIUrl":"10.1016/j.arcontrol.2023.03.002","url":null,"abstract":"<div><p>This article presents a complete review of the modeling and control schemes for overhead cranes operating in 2D and 3D spaces published to date. The modeling schemes including the pendulum-like models with rigid and flexible links are reviewed and their key characteristics are studied. Subsequently, an overview of the control methods developed for such models is presented. Afterward, a new simulation-oriented model enabling to capture both cables’ dynamic and global nonlinearities caused by the pendulation is developed, and different control methods that exist in the literature are evaluated and compared based on this model using numerical experiments. In the end, several research gaps are identified to be considered in future works.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44791919","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
A review of current state-of-the-art control methods for lower-limb powered prostheses 下肢动力假肢的控制方法综述
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2023-01-01 DOI: 10.1016/j.arcontrol.2023.03.003
Rachel Gehlhar , Maegan Tucker , Aaron J. Young , Aaron D. Ames

Lower-limb prostheses aim to restore ambulatory function for individuals with lower-limb amputations. While the design of lower-limb prostheses is important, this paper focuses on the complementary challenge—the control of lower-limb prostheses. Specifically, we focus on powered prostheses, a subset of lower-limb prostheses, which utilize actuators to inject mechanical power into the walking gait of a human user.

In this paper, we present a review of existing control strategies for lower-limb powered prostheses, including the control objectives, sensing capabilities, and control methodologies. We separate the various control methods into three main tiers of prosthesis control: High-level control for task and gait phase estimation, mid-level control for desired torque computation (both with and without the use of reference trajectories), and low-level control for enforcing the computed torque commands on the prosthesis. In particular, we focus on the high- and mid-level control approaches in this review. Additionally, we outline existing methods for customizing the prosthetic behavior for individual human users. Finally, we conclude with a discussion on future research directions for powered lower-limb prostheses based on the potential of current control methods and open problems in the field.

下肢假肢旨在为截肢患者恢复活动功能。虽然假肢的设计很重要,但本文关注的是互补的挑战——假肢的控制。具体来说,我们专注于动力假肢,这是下肢假肢的一个子集,它利用致动器为人类使用者的行走步态注入机械动力。在本文中,我们对下肢动力假肢的现有控制策略进行了综述,包括控制目标、传感能力和控制方法。我们将各种控制方法分为三个主要的假肢控制层:用于任务和步态相位估计的高级控制,用于期望扭矩计算的中级控制(使用和不使用参考轨迹),以及用于在假肢上执行计算扭矩命令的低级控制。在这篇综述中,我们特别关注高级和中级控制方法。此外,我们还概述了为个人用户定制假肢行为的现有方法。最后,基于当前控制方法的潜力和该领域的未决问题,我们对动力下肢假肢的未来研究方向进行了讨论。
{"title":"A review of current state-of-the-art control methods for lower-limb powered prostheses","authors":"Rachel Gehlhar ,&nbsp;Maegan Tucker ,&nbsp;Aaron J. Young ,&nbsp;Aaron D. Ames","doi":"10.1016/j.arcontrol.2023.03.003","DOIUrl":"10.1016/j.arcontrol.2023.03.003","url":null,"abstract":"<div><p>Lower-limb prostheses aim to restore ambulatory function for individuals with lower-limb amputations. While the design of lower-limb prostheses is important, this paper focuses on the complementary challenge—the control of lower-limb prostheses. Specifically, we focus on powered prostheses, a subset of lower-limb prostheses, which utilize actuators to inject mechanical power into the walking gait of a human user.</p><p>In this paper, we present a review of existing control strategies for lower-limb powered prostheses, including the control objectives, sensing capabilities, and control methodologies. We separate the various control methods into three main tiers of prosthesis control: High-level control for task and gait phase estimation, mid-level control for desired torque computation (both with and without the use of reference trajectories), and low-level control for enforcing the computed torque commands on the prosthesis. In particular, we focus on the high- and mid-level control approaches in this review. Additionally, we outline existing methods for customizing the prosthetic behavior for individual human users. Finally, we conclude with a discussion on future research directions for powered lower-limb prostheses based on the potential of current control methods and open problems in the field.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10449377/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10107806","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Leakage diagnosis with a contamination mitigation control framework using a graph theory based model 基于图论模型的污染缓解控制框架下的泄漏诊断
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2023-01-01 DOI: 10.1016/j.arcontrol.2023.03.010
Saruch Satishkumar Rathore , Rahul Misra , Carsten Skovmose Kallesøe , Rafal Wisniewski

This work proposes an operational management approach for water distribution networks (WDNs) that can detect and localize leakages while also mitigating contamination resulting from these leaks. The primary emphasis of this work is the development of a contamination mitigation control scheme. A leak typically leads to a drop in network pressure that increases the risk of contamination. A leakage localization algorithm is responsible for detecting and localizing the leakage in the WDN. When a leak is detected in the network the contamination mitigation control is activated. The flow and pressure settings of the pumps are regulated by the contamination mitigation control in an optimal manner to minimize the risk of contamination. The entire framework is tested on the Smart Water Infrastructure Laboratory situated at Aalborg University, Denmark and a large-scale benchmark water network, which is part of a city network, L-town.

这项工作提出了一种配水网络(WDN)的运营管理方法,该方法可以检测和定位泄漏,同时减轻这些泄漏造成的污染。这项工作的主要重点是制定污染缓解控制方案。泄漏通常会导致网络压力下降,从而增加污染风险。泄漏定位算法负责检测和定位WDN中的泄漏。当在网络中检测到泄漏时,污染缓解控制被激活。泵的流量和压力设置由污染缓解控制以最佳方式进行调节,以将污染风险降至最低。整个框架在丹麦奥尔堡大学的智能水务基础设施实验室和大型基准供水网络上进行了测试,该供水网络是城市网络L镇的一部分。
{"title":"Leakage diagnosis with a contamination mitigation control framework using a graph theory based model","authors":"Saruch Satishkumar Rathore ,&nbsp;Rahul Misra ,&nbsp;Carsten Skovmose Kallesøe ,&nbsp;Rafal Wisniewski","doi":"10.1016/j.arcontrol.2023.03.010","DOIUrl":"https://doi.org/10.1016/j.arcontrol.2023.03.010","url":null,"abstract":"<div><p>This work proposes an operational management approach for water distribution networks (WDNs) that can detect and localize leakages while also mitigating contamination resulting from these leaks. The primary emphasis of this work is the development of a contamination mitigation control scheme. A leak typically leads to a drop in network pressure that increases the risk of contamination. A leakage localization algorithm is responsible for detecting and localizing the leakage in the WDN. When a leak is detected in the network the contamination mitigation control is activated. The flow and pressure settings of the pumps are regulated by the contamination mitigation control in an optimal manner to minimize the risk of contamination. The entire framework is tested on the Smart Water Infrastructure Laboratory situated at Aalborg University, Denmark and a large-scale benchmark water network, which is part of a city network, L-town.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49739117","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
Annual Reviews in Control
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1