首页 > 最新文献

Annual Reviews in Control最新文献

英文 中文
Guarantees for data-driven control of nonlinear systems using semidefinite programming: A survey 用半有限编程保证非线性系统的数据驱动控制:调查
IF 9.4 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2023-01-01 DOI: 10.1016/j.arcontrol.2023.100911
Tim Martin , Thomas B. Schön , Frank Allgöwer

This survey presents recent research on determining control-theoretic properties and designing controllers with rigorous guarantees using semidefinite programming and for nonlinear systems for which no mathematical models but measured trajectories are available. Data-driven control techniques have been developed to circumvent a time-consuming modelling by first principles and because of the increasing availability of data. Recently, this research field has gained increased attention by the application of Willems’ fundamental lemma, which provides a fertile ground for the development of data-driven control schemes with guarantees for linear time-invariant systems. While the fundamental lemma can be generalized to further system classes, there does not exist a comparable data-based system representation for nonlinear systems. At the same time, nonlinear systems constitute the majority of practical systems. Moreover, they include additional challenges such as data-based surrogate models that prevent system analysis and controller design by convex optimization. Therefore, a variety of data-driven control approaches has been developed with different required prior insights into the system to ensure a guaranteed inference. In this survey, we will discuss developments in the context of data-driven control for nonlinear systems. In particular, we will focus on methods based on system representations providing guarantees from finite data, while the analysis and the controller design boil down to convex optimization problems given as semidefinite programming. Thus, these approaches achieve reasonable advances compared to the state-of-the-art system analysis and controller design by models from system identification. Specifically, the paper covers system representations based on extensions of Willems’ fundamental lemma, set membership, kernel techniques, the Koopman operator, and feedback linearization.

本调查报告介绍了最近在确定控制理论特性和设计具有严格保证的控制器方面开展的研究,这些研究采用半定量编程法,适用于没有数学模型但有测量轨迹的非线性系统。数据驱动控制技术的开发是为了避开耗时的第一原理建模,同时也是由于数据的可用性越来越高。最近,这一研究领域因 Willems 基本定理的应用而受到越来越多的关注,该定理为开发数据驱动控制方案提供了肥沃的土壤,并为线性时不变系统提供了保证。虽然基本定理可以推广到更多的系统类别,但对于非线性系统来说,还不存在类似的基于数据的系统表示法。与此同时,非线性系统在实际系统中占大多数。此外,非线性系统还面临更多挑战,如基于数据的代理模型阻碍了通过凸优化进行系统分析和控制器设计。因此,人们开发了多种数据驱动控制方法,这些方法要求对系统有不同的先验洞察力,以确保推理有保障。在本调查中,我们将讨论非线性系统数据驱动控制方面的发展。特别是,我们将重点关注基于系统表示的方法,这些方法可从有限数据中提供保证,而分析和控制器设计可归结为以半有限编程方式给出的凸优化问题。因此,与最先进的通过系统识别模型进行系统分析和控制器设计的方法相比,这些方法取得了合理的进步。具体来说,本文涵盖了基于 Willems 基本定理扩展的系统表示法、集合成员法、核技术、Koopman 算子和反馈线性化。
{"title":"Guarantees for data-driven control of nonlinear systems using semidefinite programming: A survey","authors":"Tim Martin ,&nbsp;Thomas B. Schön ,&nbsp;Frank Allgöwer","doi":"10.1016/j.arcontrol.2023.100911","DOIUrl":"10.1016/j.arcontrol.2023.100911","url":null,"abstract":"<div><p><span><span>This survey presents recent research on determining control-theoretic properties and designing controllers with rigorous guarantees using semidefinite programming and for nonlinear systems for which no mathematical models but measured trajectories are available. Data-driven control techniques have been developed to circumvent a time-consuming modelling by first principles and because of the increasing availability of data. Recently, this research field has gained increased attention by the application of Willems’ fundamental lemma, which provides a fertile ground for the development of data-driven control schemes with guarantees for linear time-invariant systems. While the fundamental lemma can be generalized to further system classes, there does not exist a comparable data-based system representation for nonlinear systems. At the same time, nonlinear systems constitute the majority of practical systems. Moreover, they include additional challenges such as data-based </span>surrogate models that prevent system analysis and </span>controller design<span> by convex optimization. Therefore, a variety of data-driven control approaches has been developed with different required prior insights into the system to ensure a guaranteed inference. In this survey, we will discuss developments in the context of data-driven control for nonlinear systems. In particular, we will focus on methods based on system representations providing guarantees from finite data, while the analysis and the controller design boil down to convex optimization problems<span> given as semidefinite programming. Thus, these approaches achieve reasonable advances compared to the state-of-the-art system analysis and controller design by models from system identification. Specifically, the paper covers system representations based on extensions of Willems’ fundamental lemma, set membership, kernel techniques, the Koopman operator, and feedback linearization.</span></span></p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"56 ","pages":"Article 100911"},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135455293","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Handbook of linear data-driven predictive control: Theory, implementation and design 线性数据驱动预测控制手册:理论、实现与设计
IF 9.4 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2023-01-01 DOI: 10.1016/j.arcontrol.2023.100914
P.C.N. Verheijen, V. Breschi, M. Lazar

Data-driven predictive control (DPC) has gained an increased interest as an alternative to model predictive control in recent years, since it requires less system knowledge for implementation and reliable data is commonly available in smart engineering systems. Several data-driven predictive control algorithms have been developed recently, which largely follow similar approaches, but with specific formulations and tuning parameters. This review aims to provide a structured and accessible guide on linear data-driven predictive control methods and practices for people in both academia and the industry seeking to approach and explore this field. To do so, we first discuss standard methods, such as subspace predictive control (SPC), and data-enabled predictive control (DeePC), but we also include newer hybrid approaches to DPC, such as γ–data-driven predictive control and generalized data-driven predictive control. For all presented data-driven predictive controllers we provide a detailed analysis regarding the underlying theory, implementation details and design guidelines, including an overview of methods to guarantee closed-loop stability and promising extensions towards handling nonlinear systems. The performance of the reviewed DPC approaches is compared via simulations on two benchmark examples from the literature, allowing us to provide a comprehensive overview of the different techniques in the presence of noisy data.

近年来,数据驱动预测控制(DPC)作为模型预测控制的替代方案越来越受到关注,因为它需要较少的系统知识来实现,并且在智能工程系统中通常可以获得可靠的数据。最近已经开发了几种数据驱动的预测控制算法,它们在很大程度上遵循了类似的方法,但具有特定的公式和调谐参数。本综述旨在为学术界和工业界寻求接近和探索这一领域的人们提供关于线性数据驱动的预测控制方法和实践的结构化和易于访问的指南。为此,我们首先讨论标准方法,如子空间预测控制(SPC)和数据支持预测控制(DeePC),但我们也包括DPC的新混合方法,如γ -数据驱动预测控制和广义数据驱动预测控制。对于所有提出的数据驱动预测控制器,我们提供了关于基础理论,实现细节和设计指南的详细分析,包括保证闭环稳定性的方法概述以及处理非线性系统的有前途的扩展。通过对文献中两个基准示例的模拟,比较了所审查的DPC方法的性能,使我们能够在存在噪声数据的情况下提供不同技术的全面概述。
{"title":"Handbook of linear data-driven predictive control: Theory, implementation and design","authors":"P.C.N. Verheijen,&nbsp;V. Breschi,&nbsp;M. Lazar","doi":"10.1016/j.arcontrol.2023.100914","DOIUrl":"10.1016/j.arcontrol.2023.100914","url":null,"abstract":"<div><p>Data-driven predictive control (DPC) has gained an increased interest as an alternative to model predictive control in recent years, since it requires less system knowledge for implementation and reliable data is commonly available in smart engineering systems. Several data-driven predictive control algorithms have been developed recently, which largely follow similar approaches, but with specific formulations and tuning parameters. This review aims to provide a structured and accessible guide on linear data-driven predictive control methods and practices for people in both academia and the industry seeking to approach and explore this field. To do so, we first discuss standard methods, such as subspace predictive control (SPC), and data-enabled predictive control (DeePC), but we also include newer hybrid approaches to DPC, such as <span><math><mi>γ</mi></math></span>–data-driven predictive control and generalized data-driven predictive control. For all presented data-driven predictive controllers we provide a detailed analysis regarding the underlying theory, implementation details and design guidelines, including an overview of methods to guarantee closed-loop stability and promising extensions towards handling nonlinear systems. The performance of the reviewed DPC approaches is compared via simulations on two benchmark examples from the literature, allowing us to provide a comprehensive overview of the different techniques in the presence of noisy data.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"56 ","pages":"Article 100914"},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1367578823000780/pdfft?md5=6b2e8bdfe4a714ce8d0101396d9d6243&pid=1-s2.0-S1367578823000780-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135563271","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Lyapunov stability tests for linear time-delay systems 线性时滞系统的Lyapunov稳定性检验
IF 9.4 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-07-25 DOI: 10.48550/arXiv.2207.12462
Sabine Mondi'e, A. Egorov, M. A. Gómez
An overview of stability conditions in terms of the Lyapunov matrix for time-delay systems is presented. The main results and proof are presented in details for the case of systems with multiple delays. The state of the art, ongoing research and potential extensions to other classes of delay systems are discussed.
从李雅普诺夫矩阵的角度概述了时滞系统的稳定性条件。详细给出了多时延系统的主要结果和证明。讨论了该方法的现状、正在进行的研究以及对其他类型延迟系统的潜在扩展。
{"title":"Lyapunov stability tests for linear time-delay systems","authors":"Sabine Mondi'e, A. Egorov, M. A. Gómez","doi":"10.48550/arXiv.2207.12462","DOIUrl":"https://doi.org/10.48550/arXiv.2207.12462","url":null,"abstract":"An overview of stability conditions in terms of the Lyapunov matrix for time-delay systems is presented. The main results and proof are presented in details for the case of systems with multiple delays. The state of the art, ongoing research and potential extensions to other classes of delay systems are discussed.","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"6 1","pages":"68-80"},"PeriodicalIF":9.4,"publicationDate":"2022-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88237882","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Linear quantum systems: a tutorial 线性量子系统:教程
IF 9.4 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-05-01 DOI: 10.48550/arXiv.2205.04080
Guofeng Zhang, Z. Dong
The purpose of this tutorial is to give a brief introduction to linear quantum control systems. The mathematical model of linear quantum control systems is presented first, then some fundamental control-theoretic notions such as stability, controllability and observability are given, which are closely related to several important concepts in quantum information science such as decoherence-free subsystems, quantum nondemolition variables, and back-action evasion measurements. After that, quantum Gaussian states are introduced, in particular, an information-theoretic uncertainty relation is presented which often gives a better bound for mixed Gaussian states than the well-known Heisenberg uncertainty relation. The quantum Kalman filter is presented for quantum linear systems, which is the quantum analogy of the Kalman filter for classical (namely, non-quantum-mechanical) linear systems. The quantum Kalman canonical decomposition for quantum linear systems is recorded, and its application is illustrated by means of a recent experiment. As single- and multi-photon states are useful resources in quantum information technology, the response of quantum linear systems to these types of input is presented. Finally, coherent feedback control of quantum linear systems is briefly introduced, and a recent experiment is used to demonstrate the effectiveness of quantum linear systems and networks theory.
本教程的目的是简要介绍线性量子控制系统。首先给出了线性量子控制系统的数学模型,然后给出了一些基本的控制理论概念,如稳定性、可控性和可观测性,这些概念与量子信息科学中的几个重要概念密切相关,如无退相干子系统、量子非破坏变量和反作用规避测量。在此基础上,引入了量子高斯态,提出了一种信息论的不确定性关系,它通常比著名的海森堡不确定性关系给出了更好的混合高斯态边界。提出了用于量子线性系统的量子卡尔曼滤波器,它是经典(即非量子力学)线性系统的卡尔曼滤波器的量子类比。记录了量子线性系统的量子卡尔曼正则分解,并通过最近的一个实验说明了它的应用。由于单光子态和多光子态在量子信息技术中是有用的资源,本文给出了量子线性系统对这两种输入的响应。最后简要介绍了量子线性系统的相干反馈控制,并用最近的一个实验证明了量子线性系统和网络理论的有效性。
{"title":"Linear quantum systems: a tutorial","authors":"Guofeng Zhang, Z. Dong","doi":"10.48550/arXiv.2205.04080","DOIUrl":"https://doi.org/10.48550/arXiv.2205.04080","url":null,"abstract":"The purpose of this tutorial is to give a brief introduction to linear quantum control systems. The mathematical model of linear quantum control systems is presented first, then some fundamental control-theoretic notions such as stability, controllability and observability are given, which are closely related to several important concepts in quantum information science such as decoherence-free subsystems, quantum nondemolition variables, and back-action evasion measurements. After that, quantum Gaussian states are introduced, in particular, an information-theoretic uncertainty relation is presented which often gives a better bound for mixed Gaussian states than the well-known Heisenberg uncertainty relation. The quantum Kalman filter is presented for quantum linear systems, which is the quantum analogy of the Kalman filter for classical (namely, non-quantum-mechanical) linear systems. The quantum Kalman canonical decomposition for quantum linear systems is recorded, and its application is illustrated by means of a recent experiment. As single- and multi-photon states are useful resources in quantum information technology, the response of quantum linear systems to these types of input is presented. Finally, coherent feedback control of quantum linear systems is briefly introduced, and a recent experiment is used to demonstrate the effectiveness of quantum linear systems and networks theory.","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"49 1","pages":"274-294"},"PeriodicalIF":9.4,"publicationDate":"2022-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86791145","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Special section on estimation and control of quantum systems 量子系统的估计和控制
IF 9.4 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-01-01 DOI: 10.1016/j.arcontrol.2022.10.001
Ian R. Petersen, Daoyi Dong
{"title":"Special section on estimation and control of quantum systems","authors":"Ian R. Petersen,&nbsp;Daoyi Dong","doi":"10.1016/j.arcontrol.2022.10.001","DOIUrl":"10.1016/j.arcontrol.2022.10.001","url":null,"abstract":"","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"54 ","pages":"Pages 241-242"},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76791807","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Special Section on Analysis and control design for neurodynamics 神经动力学分析与控制设计专区
IF 9.4 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-01-01 DOI: 10.1016/j.arcontrol.2022.09.007
Sérgio Pequito, Erfan Nozari, Fabio Pasqualetti
{"title":"Special Section on Analysis and control design for neurodynamics","authors":"Sérgio Pequito,&nbsp;Erfan Nozari,&nbsp;Fabio Pasqualetti","doi":"10.1016/j.arcontrol.2022.09.007","DOIUrl":"10.1016/j.arcontrol.2022.09.007","url":null,"abstract":"","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"54 ","pages":"Pages 324-326"},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81845504","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Quantum covariance and filtering 量子协方差与滤波
IF 9.4 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-01-01 DOI: 10.1016/j.arcontrol.2022.05.003
John E. Gough

We give a tutorial exposition of the analogue of the filtering equation for quantum systems focusing on the quantum probabilistic framework and developing the ideas from the classical theory. Quantum covariances and conditional expectations on von Neumann algebras play an essential part in the presentation.

我们给出了一个关于量子系统滤波方程模拟的教程,重点是量子概率框架,并从经典理论中发展思想。冯·诺依曼代数的量子协方差和条件期望在演示中起着重要的作用。
{"title":"Quantum covariance and filtering","authors":"John E. Gough","doi":"10.1016/j.arcontrol.2022.05.003","DOIUrl":"10.1016/j.arcontrol.2022.05.003","url":null,"abstract":"<div><p>We give a tutorial exposition of the analogue of the filtering equation for quantum systems<span><span> focusing on the quantum probabilistic framework and developing the ideas from the classical theory. Quantum covariances and </span>conditional expectations on von Neumann algebras play an essential part in the presentation.</span></p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"54 ","pages":"Pages 262-273"},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85633362","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Control of cooperative manipulator-endowed systems under high-level tasks and uncertain dynamics 高阶任务和不确定动态下的协作机器人系统控制
IF 9.4 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-01-01 DOI: 10.1016/j.arcontrol.2022.09.004
Christos K. Verginis , Dimos V. Dimarogonas

This paper considers the problem of distributed motion- and task-planning of multi-agent and multi-agent-object systems under temporal-logic-based tasks and uncertain dynamics. We focus on manipulator-endowed robotic agents that can interact with their surroundings. We present first continuous control algorithms for multi-agent navigation and cooperative object manipulation that exhibit the following properties. First, they are distributed in the sense that each agent calculates its own control signal from local interaction with the other agents and the environment. Second, they guarantee safety properties in terms of inter-agent collision avoidance and obstacle avoidance. Third, they adapt on-the-fly to dynamic uncertainties and are robust to exogenous disturbances. The aforementioned algorithms allow the abstraction of the underlying system to a finite-state representation. Inspired by formal-verification techniques, we use such a representation to derive plans for the agents that satisfy the given temporal-logic tasks. Various simulation results and hardware experiments verify the efficiency of the proposed algorithms.

研究了基于时间逻辑任务和不确定动态的多智能体和多智能体-对象系统的分布式运动和任务规划问题。我们专注于具有操纵能力的机器人代理,它们可以与周围环境相互作用。我们提出了第一个用于多智能体导航和协作对象操作的连续控制算法,它具有以下特性。首先,它们是分布式的,每个智能体从与其他智能体和环境的本地交互中计算自己的控制信号。二是保证了智能体间避碰和避障的安全性能。第三,它们适应动态不确定性,对外源干扰具有鲁棒性。上述算法允许将底层系统抽象为有限状态表示。受形式验证技术的启发,我们使用这种表示来推导满足给定时间逻辑任务的代理的计划。各种仿真结果和硬件实验验证了所提算法的有效性。
{"title":"Control of cooperative manipulator-endowed systems under high-level tasks and uncertain dynamics","authors":"Christos K. Verginis ,&nbsp;Dimos V. Dimarogonas","doi":"10.1016/j.arcontrol.2022.09.004","DOIUrl":"10.1016/j.arcontrol.2022.09.004","url":null,"abstract":"<div><p>This paper considers the problem of distributed motion- and task-planning of multi-agent and multi-agent-object systems under temporal-logic-based tasks and uncertain dynamics. We focus on manipulator-endowed robotic agents that can interact with their surroundings. We present first continuous control algorithms for multi-agent navigation and cooperative object manipulation that exhibit the following properties. First, they are distributed in the sense that each agent calculates its own control signal from local interaction with the other agents and the environment. Second, they guarantee safety properties in terms of inter-agent collision avoidance and obstacle avoidance. Third, they adapt on-the-fly to dynamic uncertainties and are robust to exogenous disturbances. The aforementioned algorithms allow the abstraction of the underlying system to a finite-state representation. Inspired by formal-verification techniques, we use such a representation to derive plans for the agents that satisfy the given temporal-logic tasks. Various simulation results and hardware experiments verify the efficiency of the proposed algorithms.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"54 ","pages":"Pages 219-240"},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1367578822000980/pdfft?md5=49c495bc749b8e5fedb05c72da854f6e&pid=1-s2.0-S1367578822000980-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89804076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Reinforcement learning in spacecraft control applications: Advances, prospects, and challenges 航天器控制应用中的强化学习:进展、前景和挑战
IF 9.4 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-01-01 DOI: 10.1016/j.arcontrol.2022.07.004
Massimo Tipaldi , Raffaele Iervolino , Paolo Roberto Massenio

This paper presents and analyzes Reinforcement Learning (RL) based approaches to solve spacecraft control problems. Different application fields are considered, e.g., guidance, navigation and control systems for spacecraft landing on celestial bodies, constellation orbital control, and maneuver planning in orbit transfers. It is discussed how RL solutions can address the emerging needs of designing spacecraft with highly autonomous on-board capabilities and implementing controllers (i.e., RL agents) robust to system uncertainties and adaptive to changing environments. For each application field, the RL framework core elements (e.g., the reward function, the RL algorithm and the environment model used for the RL agent training) are discussed with the aim of providing some guidelines in the formulation of spacecraft control problems via a RL framework. At the same time, the adoption of RL in real space projects is also analyzed. Different open points are identified and discussed, e.g., the availability of high-fidelity simulators for the RL agent training and the verification of RL-based solutions. This way, recommendations for future work are proposed with the aim of reducing the technological gap between the solutions proposed by the academic community and the needs/requirements of the space industry.

提出并分析了基于强化学习(RL)的航天器控制问题求解方法。考虑了航天器在天体着陆的制导、导航和控制系统、星座轨道控制以及轨道转移中的机动规划等不同的应用领域。讨论了RL解决方案如何满足设计具有高度自主机载能力的航天器和实现对系统不确定性具有鲁棒性并适应不断变化的环境的控制器(即RL代理)的新需求。针对每个应用领域,讨论了RL框架的核心要素(如奖励函数、RL算法和用于RL代理训练的环境模型),目的是为通过RL框架制定航天器控制问题提供一些指导。同时,对RL在实际空间工程中的应用进行了分析。本文确定并讨论了不同的开放点,例如,用于强化学习代理训练的高保真模拟器的可用性以及基于强化学习的解决方案的验证。这样,就提出了对今后工作的建议,目的是缩小学术界提出的解决办法与空间工业的需要/要求之间的技术差距。
{"title":"Reinforcement learning in spacecraft control applications: Advances, prospects, and challenges","authors":"Massimo Tipaldi ,&nbsp;Raffaele Iervolino ,&nbsp;Paolo Roberto Massenio","doi":"10.1016/j.arcontrol.2022.07.004","DOIUrl":"10.1016/j.arcontrol.2022.07.004","url":null,"abstract":"<div><p>This paper presents and analyzes Reinforcement Learning (RL) based approaches to solve spacecraft control<span> problems. Different application fields are considered, e.g., guidance, navigation and control systems for spacecraft landing on celestial bodies, constellation orbital control, and maneuver planning in orbit transfers. It is discussed how RL solutions can address the emerging needs of designing spacecraft with highly autonomous on-board capabilities and implementing controllers (i.e., RL agents) robust to system uncertainties and adaptive to changing environments. For each application field, the RL framework core elements (e.g., the reward function, the RL algorithm and the environment model used for the RL agent training) are discussed with the aim of providing some guidelines in the formulation of spacecraft control problems via a RL framework. At the same time, the adoption of RL in real space projects is also analyzed. Different open points are identified and discussed, e.g., the availability of high-fidelity simulators for the RL agent training and the verification of RL-based solutions. This way, recommendations for future work are proposed with the aim of reducing the technological gap between the solutions proposed by the academic community and the needs/requirements of the space industry.</span></p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"54 ","pages":"Pages 1-23"},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78437945","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 14
Synchronization and pinning control of stochastic coevolving networks 随机协同进化网络的同步与固定控制
IF 9.4 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2022-01-01 DOI: 10.1016/j.arcontrol.2022.04.005
Fabio Della Rossa , Pietro De Lellis

Network dynamical systems are often characterized by the interlaced evolution of the node and edge dynamics, which are driven by both deterministic and stochastic factors. This manuscript offers a general mathematical model of coevolving network, which associates a state variable to each node and edge in the network, and describes their evolution through coupled stochastic differential equations. We study the emergence of synchronization, be it spontaneous or induced by a pinning control action, and provide sufficient conditions for local and global convergence. We enable the use of the Master Stability Function approach for studying coevolving networks, thereby obtaining conditions for almost sure local exponential convergence, whereas global conditions are derived using a Lyapunov-based approach. The theoretical results are then leveraged to design synchronization and pinning control protocols in two select applications. In the first one, the edge dynamics are tailored to induce spontaneous synchronization, whereas in the second the pinning edges are activated/deactivated and their weights modulated to drive the network towards the pinner’s trajectory in a distributed fashion.

网络动力系统通常具有节点和边缘动态交错演化的特征,这种演化是由确定性和随机因素共同驱动的。本文提出了一个共同进化网络的一般数学模型,该模型将一个状态变量关联到网络中的每个节点和边缘,并通过耦合随机微分方程描述它们的演化。我们研究了同步的出现,无论是自发的还是由钉住控制作用引起的,并提供了局部和全局收敛的充分条件。我们允许使用主稳定函数方法来研究共同进化网络,从而获得几乎肯定的局部指数收敛条件,而全局条件则使用基于lyapunov的方法导出。然后利用理论结果在两个选择的应用程序中设计同步和固定控制协议。在第一种方法中,边缘动态被定制以诱导自发同步,而在第二种方法中,钉钉边缘被激活/停用,其权重被调制,以分布式方式驱动网络朝着钉钉器的轨迹移动。
{"title":"Synchronization and pinning control of stochastic coevolving networks","authors":"Fabio Della Rossa ,&nbsp;Pietro De Lellis","doi":"10.1016/j.arcontrol.2022.04.005","DOIUrl":"10.1016/j.arcontrol.2022.04.005","url":null,"abstract":"<div><p>Network dynamical systems are often characterized by the interlaced evolution of the node and edge dynamics, which are driven by both deterministic and stochastic factors. This manuscript offers a general mathematical model of coevolving network, which associates a state variable to each node and edge in the network, and describes their evolution through coupled stochastic differential equations. We study the emergence of synchronization, be it spontaneous or induced by a pinning control action, and provide sufficient conditions for local and global convergence. We enable the use of the Master Stability Function approach for studying coevolving networks, thereby obtaining conditions for almost sure local exponential convergence, whereas global conditions are derived using a Lyapunov-based approach. The theoretical results are then leveraged to design synchronization and pinning control protocols in two select applications. In the first one, the edge dynamics are tailored to induce spontaneous synchronization, whereas in the second the pinning edges are activated/deactivated and their weights modulated to drive the network towards the pinner’s trajectory in a distributed fashion.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"53 ","pages":"Pages 147-160"},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"54182229","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
期刊
Annual Reviews in Control
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1