首页 > 最新文献

Annual Reviews in Control最新文献

英文 中文
Lyapunov stability tests for linear time-delay systems 线性时滞系统的Lyapunov稳定性检验
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2022-07-25 DOI: 10.48550/arXiv.2207.12462
Sabine Mondi'e, A. Egorov, M. A. Gómez
An overview of stability conditions in terms of the Lyapunov matrix for time-delay systems is presented. The main results and proof are presented in details for the case of systems with multiple delays. The state of the art, ongoing research and potential extensions to other classes of delay systems are discussed.
从李雅普诺夫矩阵的角度概述了时滞系统的稳定性条件。详细给出了多时延系统的主要结果和证明。讨论了该方法的现状、正在进行的研究以及对其他类型延迟系统的潜在扩展。
{"title":"Lyapunov stability tests for linear time-delay systems","authors":"Sabine Mondi'e, A. Egorov, M. A. Gómez","doi":"10.48550/arXiv.2207.12462","DOIUrl":"https://doi.org/10.48550/arXiv.2207.12462","url":null,"abstract":"An overview of stability conditions in terms of the Lyapunov matrix for time-delay systems is presented. The main results and proof are presented in details for the case of systems with multiple delays. The state of the art, ongoing research and potential extensions to other classes of delay systems are discussed.","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2022-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88237882","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Linear quantum systems: a tutorial 线性量子系统:教程
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2022-05-01 DOI: 10.48550/arXiv.2205.04080
Guofeng Zhang, Z. Dong
The purpose of this tutorial is to give a brief introduction to linear quantum control systems. The mathematical model of linear quantum control systems is presented first, then some fundamental control-theoretic notions such as stability, controllability and observability are given, which are closely related to several important concepts in quantum information science such as decoherence-free subsystems, quantum nondemolition variables, and back-action evasion measurements. After that, quantum Gaussian states are introduced, in particular, an information-theoretic uncertainty relation is presented which often gives a better bound for mixed Gaussian states than the well-known Heisenberg uncertainty relation. The quantum Kalman filter is presented for quantum linear systems, which is the quantum analogy of the Kalman filter for classical (namely, non-quantum-mechanical) linear systems. The quantum Kalman canonical decomposition for quantum linear systems is recorded, and its application is illustrated by means of a recent experiment. As single- and multi-photon states are useful resources in quantum information technology, the response of quantum linear systems to these types of input is presented. Finally, coherent feedback control of quantum linear systems is briefly introduced, and a recent experiment is used to demonstrate the effectiveness of quantum linear systems and networks theory.
本教程的目的是简要介绍线性量子控制系统。首先给出了线性量子控制系统的数学模型,然后给出了一些基本的控制理论概念,如稳定性、可控性和可观测性,这些概念与量子信息科学中的几个重要概念密切相关,如无退相干子系统、量子非破坏变量和反作用规避测量。在此基础上,引入了量子高斯态,提出了一种信息论的不确定性关系,它通常比著名的海森堡不确定性关系给出了更好的混合高斯态边界。提出了用于量子线性系统的量子卡尔曼滤波器,它是经典(即非量子力学)线性系统的卡尔曼滤波器的量子类比。记录了量子线性系统的量子卡尔曼正则分解,并通过最近的一个实验说明了它的应用。由于单光子态和多光子态在量子信息技术中是有用的资源,本文给出了量子线性系统对这两种输入的响应。最后简要介绍了量子线性系统的相干反馈控制,并用最近的一个实验证明了量子线性系统和网络理论的有效性。
{"title":"Linear quantum systems: a tutorial","authors":"Guofeng Zhang, Z. Dong","doi":"10.48550/arXiv.2205.04080","DOIUrl":"https://doi.org/10.48550/arXiv.2205.04080","url":null,"abstract":"The purpose of this tutorial is to give a brief introduction to linear quantum control systems. The mathematical model of linear quantum control systems is presented first, then some fundamental control-theoretic notions such as stability, controllability and observability are given, which are closely related to several important concepts in quantum information science such as decoherence-free subsystems, quantum nondemolition variables, and back-action evasion measurements. After that, quantum Gaussian states are introduced, in particular, an information-theoretic uncertainty relation is presented which often gives a better bound for mixed Gaussian states than the well-known Heisenberg uncertainty relation. The quantum Kalman filter is presented for quantum linear systems, which is the quantum analogy of the Kalman filter for classical (namely, non-quantum-mechanical) linear systems. The quantum Kalman canonical decomposition for quantum linear systems is recorded, and its application is illustrated by means of a recent experiment. As single- and multi-photon states are useful resources in quantum information technology, the response of quantum linear systems to these types of input is presented. Finally, coherent feedback control of quantum linear systems is briefly introduced, and a recent experiment is used to demonstrate the effectiveness of quantum linear systems and networks theory.","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2022-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86791145","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Special Section on Analysis and control design for neurodynamics 神经动力学分析与控制设计专区
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2022-01-01 DOI: 10.1016/j.arcontrol.2022.09.007
Sérgio Pequito, Erfan Nozari, Fabio Pasqualetti
{"title":"Special Section on Analysis and control design for neurodynamics","authors":"Sérgio Pequito, Erfan Nozari, Fabio Pasqualetti","doi":"10.1016/j.arcontrol.2022.09.007","DOIUrl":"10.1016/j.arcontrol.2022.09.007","url":null,"abstract":"","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81845504","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Quantum covariance and filtering 量子协方差与滤波
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2022-01-01 DOI: 10.1016/j.arcontrol.2022.05.003
John E. Gough

We give a tutorial exposition of the analogue of the filtering equation for quantum systems focusing on the quantum probabilistic framework and developing the ideas from the classical theory. Quantum covariances and conditional expectations on von Neumann algebras play an essential part in the presentation.

我们给出了一个关于量子系统滤波方程模拟的教程,重点是量子概率框架,并从经典理论中发展思想。冯·诺依曼代数的量子协方差和条件期望在演示中起着重要的作用。
{"title":"Quantum covariance and filtering","authors":"John E. Gough","doi":"10.1016/j.arcontrol.2022.05.003","DOIUrl":"10.1016/j.arcontrol.2022.05.003","url":null,"abstract":"<div><p>We give a tutorial exposition of the analogue of the filtering equation for quantum systems<span><span> focusing on the quantum probabilistic framework and developing the ideas from the classical theory. Quantum covariances and </span>conditional expectations on von Neumann algebras play an essential part in the presentation.</span></p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85633362","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Special section on estimation and control of quantum systems 量子系统的估计和控制
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2022-01-01 DOI: 10.1016/j.arcontrol.2022.10.001
Ian R. Petersen, Daoyi Dong
{"title":"Special section on estimation and control of quantum systems","authors":"Ian R. Petersen,&nbsp;Daoyi Dong","doi":"10.1016/j.arcontrol.2022.10.001","DOIUrl":"10.1016/j.arcontrol.2022.10.001","url":null,"abstract":"","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76791807","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Control of cooperative manipulator-endowed systems under high-level tasks and uncertain dynamics 高阶任务和不确定动态下的协作机器人系统控制
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2022-01-01 DOI: 10.1016/j.arcontrol.2022.09.004
Christos K. Verginis , Dimos V. Dimarogonas

This paper considers the problem of distributed motion- and task-planning of multi-agent and multi-agent-object systems under temporal-logic-based tasks and uncertain dynamics. We focus on manipulator-endowed robotic agents that can interact with their surroundings. We present first continuous control algorithms for multi-agent navigation and cooperative object manipulation that exhibit the following properties. First, they are distributed in the sense that each agent calculates its own control signal from local interaction with the other agents and the environment. Second, they guarantee safety properties in terms of inter-agent collision avoidance and obstacle avoidance. Third, they adapt on-the-fly to dynamic uncertainties and are robust to exogenous disturbances. The aforementioned algorithms allow the abstraction of the underlying system to a finite-state representation. Inspired by formal-verification techniques, we use such a representation to derive plans for the agents that satisfy the given temporal-logic tasks. Various simulation results and hardware experiments verify the efficiency of the proposed algorithms.

研究了基于时间逻辑任务和不确定动态的多智能体和多智能体-对象系统的分布式运动和任务规划问题。我们专注于具有操纵能力的机器人代理,它们可以与周围环境相互作用。我们提出了第一个用于多智能体导航和协作对象操作的连续控制算法,它具有以下特性。首先,它们是分布式的,每个智能体从与其他智能体和环境的本地交互中计算自己的控制信号。二是保证了智能体间避碰和避障的安全性能。第三,它们适应动态不确定性,对外源干扰具有鲁棒性。上述算法允许将底层系统抽象为有限状态表示。受形式验证技术的启发,我们使用这种表示来推导满足给定时间逻辑任务的代理的计划。各种仿真结果和硬件实验验证了所提算法的有效性。
{"title":"Control of cooperative manipulator-endowed systems under high-level tasks and uncertain dynamics","authors":"Christos K. Verginis ,&nbsp;Dimos V. Dimarogonas","doi":"10.1016/j.arcontrol.2022.09.004","DOIUrl":"10.1016/j.arcontrol.2022.09.004","url":null,"abstract":"<div><p>This paper considers the problem of distributed motion- and task-planning of multi-agent and multi-agent-object systems under temporal-logic-based tasks and uncertain dynamics. We focus on manipulator-endowed robotic agents that can interact with their surroundings. We present first continuous control algorithms for multi-agent navigation and cooperative object manipulation that exhibit the following properties. First, they are distributed in the sense that each agent calculates its own control signal from local interaction with the other agents and the environment. Second, they guarantee safety properties in terms of inter-agent collision avoidance and obstacle avoidance. Third, they adapt on-the-fly to dynamic uncertainties and are robust to exogenous disturbances. The aforementioned algorithms allow the abstraction of the underlying system to a finite-state representation. Inspired by formal-verification techniques, we use such a representation to derive plans for the agents that satisfy the given temporal-logic tasks. Various simulation results and hardware experiments verify the efficiency of the proposed algorithms.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1367578822000980/pdfft?md5=49c495bc749b8e5fedb05c72da854f6e&pid=1-s2.0-S1367578822000980-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89804076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Synchronization and pinning control of stochastic coevolving networks 随机协同进化网络的同步与固定控制
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2022-01-01 DOI: 10.1016/j.arcontrol.2022.04.005
Fabio Della Rossa , Pietro De Lellis

Network dynamical systems are often characterized by the interlaced evolution of the node and edge dynamics, which are driven by both deterministic and stochastic factors. This manuscript offers a general mathematical model of coevolving network, which associates a state variable to each node and edge in the network, and describes their evolution through coupled stochastic differential equations. We study the emergence of synchronization, be it spontaneous or induced by a pinning control action, and provide sufficient conditions for local and global convergence. We enable the use of the Master Stability Function approach for studying coevolving networks, thereby obtaining conditions for almost sure local exponential convergence, whereas global conditions are derived using a Lyapunov-based approach. The theoretical results are then leveraged to design synchronization and pinning control protocols in two select applications. In the first one, the edge dynamics are tailored to induce spontaneous synchronization, whereas in the second the pinning edges are activated/deactivated and their weights modulated to drive the network towards the pinner’s trajectory in a distributed fashion.

网络动力系统通常具有节点和边缘动态交错演化的特征,这种演化是由确定性和随机因素共同驱动的。本文提出了一个共同进化网络的一般数学模型,该模型将一个状态变量关联到网络中的每个节点和边缘,并通过耦合随机微分方程描述它们的演化。我们研究了同步的出现,无论是自发的还是由钉住控制作用引起的,并提供了局部和全局收敛的充分条件。我们允许使用主稳定函数方法来研究共同进化网络,从而获得几乎肯定的局部指数收敛条件,而全局条件则使用基于lyapunov的方法导出。然后利用理论结果在两个选择的应用程序中设计同步和固定控制协议。在第一种方法中,边缘动态被定制以诱导自发同步,而在第二种方法中,钉钉边缘被激活/停用,其权重被调制,以分布式方式驱动网络朝着钉钉器的轨迹移动。
{"title":"Synchronization and pinning control of stochastic coevolving networks","authors":"Fabio Della Rossa ,&nbsp;Pietro De Lellis","doi":"10.1016/j.arcontrol.2022.04.005","DOIUrl":"10.1016/j.arcontrol.2022.04.005","url":null,"abstract":"<div><p>Network dynamical systems are often characterized by the interlaced evolution of the node and edge dynamics, which are driven by both deterministic and stochastic factors. This manuscript offers a general mathematical model of coevolving network, which associates a state variable to each node and edge in the network, and describes their evolution through coupled stochastic differential equations. We study the emergence of synchronization, be it spontaneous or induced by a pinning control action, and provide sufficient conditions for local and global convergence. We enable the use of the Master Stability Function approach for studying coevolving networks, thereby obtaining conditions for almost sure local exponential convergence, whereas global conditions are derived using a Lyapunov-based approach. The theoretical results are then leveraged to design synchronization and pinning control protocols in two select applications. In the first one, the edge dynamics are tailored to induce spontaneous synchronization, whereas in the second the pinning edges are activated/deactivated and their weights modulated to drive the network towards the pinner’s trajectory in a distributed fashion.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"54182229","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
State estimation of the Stefan PDE: A tutorial on design and applications to polar ice and batteries Stefan PDE的状态估计:极地冰和电池的设计和应用教程
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2022-01-01 DOI: 10.1016/j.arcontrol.2022.02.001
Shumon Koga , Miroslav Krstic

The Stefan PDE system is a representative model for thermal phase change phenomena, such as melting and solidification, arising in numerous science and engineering processes. The mathematical description is given by a Partial Differential Equation (PDE) of the temperature distribution defined on a spatial interval with a moving boundary, where the boundary represents the liquid–solid interface and its dynamics are governed by an Ordinary Differential Equation (ODE). The PDE–ODE coupling at the boundary is nonlinear and creates a significant challenge for state estimation with provable convergence and robustness.

This tutorial article presents a state estimation method based on PDE backstepping for the Stefan system, using measurements only at the moving boundary. PDE backstepping observer design generates an observer gain by employing a Volterra transformation of the observer error state into a desirable target system, solving a Goursat-form PDE for the transformation’s kernel, and performing a Lyapunov analysis of the target observer error system.

The observer is applied to models of problems motivated by climate change and the need for renewable energy storage: a model of polar ice dynamics and a model of charging and discharging in lithium-ion batteries. The numerical results for polar ice demonstrate a robust performance of the designed estimator with respect to the unmodeled salinity effect in sea ice. The results for an electrochemical PDE model of a lithium-ion battery with a phase transition material show the elimination of more than 15 % error in State-of-Charge estimate within 5 min even in the presence of sensor noise.

Stefan PDE系统是许多科学和工程过程中出现的熔化和凝固等热相变现象的代表性模型。用偏微分方程(PDE)给出了温度分布的数学描述,该温度分布定义在具有运动边界的空间区间上,其中边界代表液固界面,其动力学由常微分方程(ODE)控制。边界处的PDE-ODE耦合是非线性的,对具有可证明的收敛性和鲁棒性的状态估计提出了重大挑战。本文介绍了一种基于PDE反演的Stefan系统状态估计方法,该方法仅在移动边界处使用测量值。PDE反演观测器设计通过将观测器误差状态Volterra变换为理想的目标系统,求解变换核的goursat形式PDE,并对目标观测器误差系统进行Lyapunov分析,从而产生观测器增益。观测者应用于由气候变化和可再生能源存储需求引起的问题模型:极地冰动力学模型和锂离子电池充放电模型。极地冰的数值结果表明,所设计的估计器对于海冰中未模拟的盐度效应具有良好的鲁棒性。使用相变材料的锂离子电池的电化学PDE模型的结果表明,即使在存在传感器噪声的情况下,也可以在5分钟内消除超过15%的充电状态估计误差。
{"title":"State estimation of the Stefan PDE: A tutorial on design and applications to polar ice and batteries","authors":"Shumon Koga ,&nbsp;Miroslav Krstic","doi":"10.1016/j.arcontrol.2022.02.001","DOIUrl":"10.1016/j.arcontrol.2022.02.001","url":null,"abstract":"<div><p><span>The Stefan PDE system is a representative model for thermal phase change phenomena, such as melting and solidification, arising in numerous science and </span>engineering processes<span><span>. The mathematical description is given by a Partial Differential Equation (PDE) of the </span>temperature distribution defined on a spatial interval with a moving boundary, where the boundary represents the liquid–solid interface and its dynamics are governed by an Ordinary Differential Equation (ODE). The PDE–ODE coupling at the boundary is nonlinear and creates a significant challenge for state estimation with provable convergence and robustness.</span></p><p>This tutorial article presents a state estimation method based on PDE backstepping for the Stefan system, using measurements only at the moving boundary. PDE backstepping observer design generates an observer gain by employing a Volterra transformation of the observer error state into a desirable target system, solving a Goursat-form PDE for the transformation’s kernel, and performing a Lyapunov analysis of the target observer error system.</p><p>The observer is applied to models of problems motivated by climate change and the need for renewable energy storage: a model of polar ice dynamics and a model of charging and discharging in lithium-ion batteries. The numerical results for polar ice demonstrate a robust performance of the designed estimator with respect to the unmodeled salinity effect in sea ice. The results for an electrochemical PDE model of a lithium-ion battery with a phase transition material show the elimination of more than 15 % error in State-of-Charge estimate within 5 min even in the presence of sensor noise.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78212776","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Reinforcement learning in spacecraft control applications: Advances, prospects, and challenges 航天器控制应用中的强化学习:进展、前景和挑战
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2022-01-01 DOI: 10.1016/j.arcontrol.2022.07.004
Massimo Tipaldi , Raffaele Iervolino , Paolo Roberto Massenio

This paper presents and analyzes Reinforcement Learning (RL) based approaches to solve spacecraft control problems. Different application fields are considered, e.g., guidance, navigation and control systems for spacecraft landing on celestial bodies, constellation orbital control, and maneuver planning in orbit transfers. It is discussed how RL solutions can address the emerging needs of designing spacecraft with highly autonomous on-board capabilities and implementing controllers (i.e., RL agents) robust to system uncertainties and adaptive to changing environments. For each application field, the RL framework core elements (e.g., the reward function, the RL algorithm and the environment model used for the RL agent training) are discussed with the aim of providing some guidelines in the formulation of spacecraft control problems via a RL framework. At the same time, the adoption of RL in real space projects is also analyzed. Different open points are identified and discussed, e.g., the availability of high-fidelity simulators for the RL agent training and the verification of RL-based solutions. This way, recommendations for future work are proposed with the aim of reducing the technological gap between the solutions proposed by the academic community and the needs/requirements of the space industry.

提出并分析了基于强化学习(RL)的航天器控制问题求解方法。考虑了航天器在天体着陆的制导、导航和控制系统、星座轨道控制以及轨道转移中的机动规划等不同的应用领域。讨论了RL解决方案如何满足设计具有高度自主机载能力的航天器和实现对系统不确定性具有鲁棒性并适应不断变化的环境的控制器(即RL代理)的新需求。针对每个应用领域,讨论了RL框架的核心要素(如奖励函数、RL算法和用于RL代理训练的环境模型),目的是为通过RL框架制定航天器控制问题提供一些指导。同时,对RL在实际空间工程中的应用进行了分析。本文确定并讨论了不同的开放点,例如,用于强化学习代理训练的高保真模拟器的可用性以及基于强化学习的解决方案的验证。这样,就提出了对今后工作的建议,目的是缩小学术界提出的解决办法与空间工业的需要/要求之间的技术差距。
{"title":"Reinforcement learning in spacecraft control applications: Advances, prospects, and challenges","authors":"Massimo Tipaldi ,&nbsp;Raffaele Iervolino ,&nbsp;Paolo Roberto Massenio","doi":"10.1016/j.arcontrol.2022.07.004","DOIUrl":"10.1016/j.arcontrol.2022.07.004","url":null,"abstract":"<div><p>This paper presents and analyzes Reinforcement Learning (RL) based approaches to solve spacecraft control<span> problems. Different application fields are considered, e.g., guidance, navigation and control systems for spacecraft landing on celestial bodies, constellation orbital control, and maneuver planning in orbit transfers. It is discussed how RL solutions can address the emerging needs of designing spacecraft with highly autonomous on-board capabilities and implementing controllers (i.e., RL agents) robust to system uncertainties and adaptive to changing environments. For each application field, the RL framework core elements (e.g., the reward function, the RL algorithm and the environment model used for the RL agent training) are discussed with the aim of providing some guidelines in the formulation of spacecraft control problems via a RL framework. At the same time, the adoption of RL in real space projects is also analyzed. Different open points are identified and discussed, e.g., the availability of high-fidelity simulators for the RL agent training and the verification of RL-based solutions. This way, recommendations for future work are proposed with the aim of reducing the technological gap between the solutions proposed by the academic community and the needs/requirements of the space industry.</span></p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78437945","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 14
Fractional cyber-neural systems — A brief survey 分数网络-神经系统-简要概述
IF 9.4 2区 计算机科学 Q1 Engineering Pub Date : 2022-01-01 DOI: 10.1016/j.arcontrol.2022.06.002
Emily Reed , Sarthak Chatterjee , Guilherme Ramos , Paul Bogdan , Sérgio Pequito

Neurotechnology has made great strides in the last 20 years. However, we still have a long way to go to commercialize many of these technologies as we lack a unified framework to study cyber-neural systems (CNS) that bring the hardware, software, and the neural system together. Dynamical systems play a key role in developing these technologies as they capture different aspects of the brain and provide insight into their function. Converging evidence suggests that fractional-order dynamical systems are advantageous in modeling neural systems because of their compact representation and accuracy in capturing the long-range memory exhibited in neural behavior. In this brief survey, we provide an overview of fractional CNS that entails fractional-order systems in the context of CNS. In particular, we introduce basic definitions required for the analysis and synthesis of fractional CNS, encompassing system identification, state estimation, and closed-loop control. Additionally, we provide an illustration of some applications in the context of CNS and draw some possible future research directions. Advancements in these three areas will be critical in developing the next generation of CNS, which will, ultimately, improve people’s quality of life.

神经技术在过去的20年里取得了巨大的进步。然而,我们仍然有很长的路要走,以商业化这些技术,因为我们缺乏一个统一的框架来研究网络神经系统(CNS),将硬件,软件和神经系统结合在一起。动力系统在这些技术的发展中起着关键作用,因为它们捕捉大脑的不同方面,并提供对其功能的洞察。越来越多的证据表明,分数阶动力系统在神经系统建模方面具有优势,因为它们具有紧凑的表征和捕获神经行为中表现出的远程记忆的准确性。在这个简短的调查中,我们提供了分数级中枢神经系统的概述,在中枢神经系统的背景下需要分数阶系统。特别地,我们介绍了分析和合成分数CNS所需的基本定义,包括系统识别,状态估计和闭环控制。此外,我们还介绍了一些在中枢神经系统中的应用,并提出了未来可能的研究方向。这三个领域的进展对于开发下一代中枢神经系统至关重要,最终将提高人们的生活质量。
{"title":"Fractional cyber-neural systems — A brief survey","authors":"Emily Reed ,&nbsp;Sarthak Chatterjee ,&nbsp;Guilherme Ramos ,&nbsp;Paul Bogdan ,&nbsp;Sérgio Pequito","doi":"10.1016/j.arcontrol.2022.06.002","DOIUrl":"10.1016/j.arcontrol.2022.06.002","url":null,"abstract":"<div><p>Neurotechnology has made great strides in the last 20 years. However, we still have a long way to go to commercialize many of these technologies as we lack a unified framework to study cyber-neural systems (CNS) that bring the hardware, software, and the neural system together. Dynamical systems play a key role in developing these technologies as they capture different aspects of the brain and provide insight into their function. Converging evidence suggests that fractional-order dynamical systems are advantageous in modeling neural systems because of their compact representation and accuracy in capturing the long-range memory exhibited in neural behavior. In this brief survey, we provide an overview of fractional CNS that entails fractional-order systems in the context of CNS. In particular, we introduce basic definitions required for the analysis and synthesis of fractional CNS, encompassing system identification, state estimation, and closed-loop control. Additionally, we provide an illustration of some applications in the context of CNS and draw some possible future research directions. Advancements in these three areas will be critical in developing the next generation of CNS, which will, ultimately, improve people’s quality of life.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":null,"pages":null},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83005483","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
期刊
Annual Reviews in Control
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1