首页 > 最新文献

Automatica最新文献

英文 中文
Online change points detection for linear dynamical systems with finite sample guarantees 有限样本保证线性动力系统的在线变化点检测
IF 4.8 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-09-07 DOI: 10.1016/j.automatica.2024.111894
Lei Xin , George T.-C. Chiu , Shreyas Sundaram

The problem of online change point detection is to detect abrupt changes in properties of time series, ideally as soon as possible after those changes occur. Existing work on online change point detection either assumes i.i.d. data, focuses on asymptotic analysis, does not present theoretical guarantees on the trade-off between detection accuracy and detection delay, or is only suitable for detecting single change points. In this work, we study the online change point detection problem for linear dynamical systems with unknown dynamics, where the data exhibits temporal correlations and the system could have multiple change points. We develop a data-dependent threshold that can be used in our test that allows one to achieve a pre-specified upper bound on the probability of making a false alarm. We further provide a finite-sample-based bound for the probability of detecting a change point. Our bound demonstrates how parameters used in our algorithm affect the detection probability and delay, and provides guidance on the minimum required time between changes to guarantee detection.

在线变化点检测的问题是检测时间序列属性的突然变化,最好是在这些变化发生后尽快检测。现有的在线变化点检测工作要么假定数据为 i.i.d.,要么侧重于渐近分析,要么没有提出检测精度和检测延迟之间权衡的理论保证,要么只适用于检测单个变化点。在这项工作中,我们研究了具有未知动态的线性动力系统的在线变化点检测问题,在这种情况下,数据具有时间相关性,系统可能有多个变化点。我们开发了一种与数据相关的阈值,可用于我们的检测,从而使误报概率达到预先设定的上限。我们进一步为检测到变化点的概率提供了一个基于有限样本的界限。我们的约束说明了我们算法中使用的参数如何影响检测概率和延迟,并为保证检测到变化所需的最小间隔时间提供了指导。
{"title":"Online change points detection for linear dynamical systems with finite sample guarantees","authors":"Lei Xin ,&nbsp;George T.-C. Chiu ,&nbsp;Shreyas Sundaram","doi":"10.1016/j.automatica.2024.111894","DOIUrl":"10.1016/j.automatica.2024.111894","url":null,"abstract":"<div><p>The problem of online change point detection is to detect abrupt changes in properties of time series, ideally as soon as possible after those changes occur. Existing work on online change point detection either assumes i.i.d. data, focuses on asymptotic analysis, does not present theoretical guarantees on the trade-off between detection accuracy and detection delay, or is only suitable for detecting single change points. In this work, we study the online change point detection problem for linear dynamical systems with unknown dynamics, where the data exhibits temporal correlations and the system could have multiple change points. We develop a data-dependent threshold that can be used in our test that allows one to achieve a pre-specified upper bound on the probability of making a false alarm. We further provide a finite-sample-based bound for the probability of detecting a change point. Our bound demonstrates how parameters used in our algorithm affect the detection probability and delay, and provides guidance on the minimum required time between changes to guarantee detection.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111894"},"PeriodicalIF":4.8,"publicationDate":"2024-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003881/pdfft?md5=253252efe9e72628a7809ea795bb855e&pid=1-s2.0-S0005109824003881-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162579","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Distributed continuous-time time-varying optimization for networked Lagrangian systems with quadratic cost functions 具有二次成本函数的网络拉格朗日系统的分布式连续时间时变优化
IF 4.8 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-09-07 DOI: 10.1016/j.automatica.2024.111882
Yong Ding , Hanlei Wang , Wei Ren

In this paper, the distributed time-varying optimization problem is investigated for networked Lagrangian systems with parametric uncertainties. Usually, in the literature, to address some distributed control problems for nonlinear systems, a networked virtual system is constructed, and a tracking algorithm is designed such that the agents’ physical states track the virtual states. It is worth pointing out that such an idea requires the exchange of the virtual states and hence necessitates communication among the group. In addition, due to the complexities of the Lagrangian dynamics and the distributed time-varying optimization problem, there exist significant challenges. This paper proposes distributed time-varying optimization algorithms that achieve zero optimum-tracking errors for the networked Lagrangian agents without the communication requirement. The main idea behind the proposed algorithms is to construct a reference system for each agent to generate a reference velocity using absolute and relative physical state measurements with no exchange of virtual states needed, and to design adaptive controllers for Lagrangian systems such that the physical states are able to track the reference velocities and hence the optimal trajectory. The algorithms introduce mutual feedback between the reference systems and the local controllers via physical states/measurements and are amenable to implementation via local onboard sensing in a communication unfriendly environment. Specifically, first, a base algorithm is proposed to solve the distributed time-varying optimization problem for networked Lagrangian systems under switching graphs. Then, based on the base algorithm, a continuous function is introduced to approximate the signum function, forming a continuous distributed optimization algorithm and hence removing the chattering. Such a continuous algorithm is convergent with bounded ultimate optimum-tracking errors, which are proportion to approximation errors. Finally, numerical simulations are provided to illustrate the validity of the proposed algorithms.

本文研究了具有参数不确定性的网络拉格朗日系统的分布式时变优化问题。通常,文献中为了解决一些非线性系统的分布式控制问题,会构建一个网络虚拟系统,并设计一种跟踪算法,使代理的物理状态跟踪虚拟状态。值得指出的是,这种想法需要交换虚拟状态,因此需要小组之间进行通信。此外,由于拉格朗日动力学和分布式时变优化问题的复杂性,存在着巨大的挑战。本文提出了分布式时变优化算法,可在无需通信的情况下实现网络化拉格朗日代理的零最佳跟踪误差。所提算法的主要思想是为每个代理构建一个参考系统,利用绝对和相对物理状态测量值生成参考速度,无需交换虚拟状态,并为拉格朗日系统设计自适应控制器,使物理状态能够跟踪参考速度,从而实现最优轨迹。这些算法通过物理状态/测量值在参考系统和本地控制器之间引入了相互反馈,并可在通信不友好的环境中通过本地机载传感实现。具体来说,首先提出了一种基础算法,用于解决切换图下网络化拉格朗日系统的分布式时变优化问题。然后,在基础算法的基础上,引入一个连续函数来近似符号函数,形成一个连续的分布式优化算法,从而消除颤振。这种连续算法是收敛的,其终极最优跟踪误差是有界的,与近似误差成正比。最后,通过数值模拟说明了所提算法的有效性。
{"title":"Distributed continuous-time time-varying optimization for networked Lagrangian systems with quadratic cost functions","authors":"Yong Ding ,&nbsp;Hanlei Wang ,&nbsp;Wei Ren","doi":"10.1016/j.automatica.2024.111882","DOIUrl":"10.1016/j.automatica.2024.111882","url":null,"abstract":"<div><p>In this paper, the distributed time-varying optimization problem is investigated for networked Lagrangian systems with parametric uncertainties. Usually, in the literature, to address some distributed control problems for nonlinear systems, a networked virtual system is constructed, and a tracking algorithm is designed such that the agents’ physical states track the virtual states. It is worth pointing out that such an idea requires the exchange of the virtual states and hence necessitates communication among the group. In addition, due to the complexities of the Lagrangian dynamics and the distributed time-varying optimization problem, there exist significant challenges. This paper proposes distributed time-varying optimization algorithms that achieve zero optimum-tracking errors for the networked Lagrangian agents without the communication requirement. The main idea behind the proposed algorithms is to construct a reference system for each agent to generate a reference velocity using absolute and relative physical state measurements with no exchange of virtual states needed, and to design adaptive controllers for Lagrangian systems such that the physical states are able to track the reference velocities and hence the optimal trajectory. The algorithms introduce mutual feedback between the reference systems and the local controllers via physical states/measurements and are amenable to implementation via local onboard sensing in a communication unfriendly environment. Specifically, first, a base algorithm is proposed to solve the distributed time-varying optimization problem for networked Lagrangian systems under switching graphs. Then, based on the base algorithm, a continuous function is introduced to approximate the signum function, forming a continuous distributed optimization algorithm and hence removing the chattering. Such a continuous algorithm is convergent with bounded ultimate optimum-tracking errors, which are proportion to approximation errors. Finally, numerical simulations are provided to illustrate the validity of the proposed algorithms.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111882"},"PeriodicalIF":4.8,"publicationDate":"2024-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003765/pdfft?md5=268cd3ac8c9394f35de6171bde25b9be&pid=1-s2.0-S0005109824003765-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Online estimated-based-state feedback control of n-qubit stochastic open quantum systems n 量子位随机开放量子系统的在线基于估计的状态反馈控制
IF 4.8 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-09-06 DOI: 10.1016/j.automatica.2024.111883
Shuang Cong , Zhixiang Dong , Jie Wen , Kezhi Li

For n-qubit stochastic open quantum systems, an online quantum state estimation (OQSE) algorithm and the associated online estimated-based-state feedback control (OQSE-FC) are proposed in this paper. The proposed OQSE algorithm integrates the online alternating direction multiplier method (OADM) to the continuous weak measurement (CWM). The quantum state feedback control laws are designed based on the Lyapunov stability theorem, and the states for feedback control are online estimated by OQSE algorithm. The convergence of OQSE algorithm and the asymptotic stability of the state feedback control laws are proved.

针对 n 量子位随机开放量子系统,本文提出了一种在线量子态估计(OQSE)算法和相关的基于估计的在线状态反馈控制(OQSE-FC)。所提出的 OQSE 算法将在线交替方向乘法器法(OADM)与连续弱测量法(CWM)相结合。基于 Lyapunov 稳定性定理设计量子态反馈控制律,并通过 OQSE 算法在线估计反馈控制的状态。证明了 OQSE 算法的收敛性和状态反馈控制律的渐近稳定性。
{"title":"Online estimated-based-state feedback control of n-qubit stochastic open quantum systems","authors":"Shuang Cong ,&nbsp;Zhixiang Dong ,&nbsp;Jie Wen ,&nbsp;Kezhi Li","doi":"10.1016/j.automatica.2024.111883","DOIUrl":"10.1016/j.automatica.2024.111883","url":null,"abstract":"<div><p>For <span><math><mi>n</mi></math></span>-qubit stochastic open quantum systems, an online quantum state estimation (OQSE) algorithm and the associated online estimated-based-state feedback control (OQSE-FC) are proposed in this paper. The proposed OQSE algorithm integrates the online alternating direction multiplier method (OADM) to the continuous weak measurement (CWM). The quantum state feedback control laws are designed based on the Lyapunov stability theorem, and the states for feedback control are online estimated by OQSE algorithm. The convergence of OQSE algorithm and the asymptotic stability of the state feedback control laws are proved.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111883"},"PeriodicalIF":4.8,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003777/pdfft?md5=e20a03851b75b5f56ef9ad5bc20ad096&pid=1-s2.0-S0005109824003777-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162498","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Distributed online optimization for multi-agent optimal transport 多代理优化运输的分布式在线优化
IF 4.8 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-09-05 DOI: 10.1016/j.automatica.2024.111880
Vishaal Krishnan , Sonia Martínez

We propose a scalable, distributed algorithm for the optimal transport of large-scale multi-agent systems. We formulate the problem as one of steering the collective towards a target probability measure while minimizing the total cost of transport, with the additional constraint of distributed implementation. Using optimal transport theory, we realize the solution as an iterative transport based on a stochastic proximal descent scheme. At each stage of the transport, the agents implement an online, distributed primal–dual algorithm to obtain local estimates of the Kantorovich potential for optimal transport from the current distribution of the collective to the target distribution. Using these estimates as their local objective functions, the agents then implement the transport by stochastic proximal descent. This two-step process is carried out recursively by the agents to converge asymptotically to the target distribution. We rigorously establish the underlying theoretical framework and convergence of the algorithm and test its behavior in numerical experiments.

我们提出了一种可扩展的分布式算法,用于优化大规模多代理系统的运输。我们将这一问题表述为:在使运输总成本最小化的同时,引导集体向目标概率度量前进,并附加分布式实施的约束条件。利用最优传输理论,我们以随机近似下降方案为基础,实现了迭代传输的解决方案。在运输的每个阶段,代理都会执行在线分布式初等二元算法,以获得从当前集体分布到目标分布的最优运输的康托洛维奇势的局部估计值。利用这些估计值作为局部目标函数,代理们就可以通过随机近似下降法实现传输。这两步过程由代理递归执行,以渐近收敛到目标分布。我们严格建立了算法的基础理论框架和收敛性,并在数值实验中对其行为进行了测试。
{"title":"Distributed online optimization for multi-agent optimal transport","authors":"Vishaal Krishnan ,&nbsp;Sonia Martínez","doi":"10.1016/j.automatica.2024.111880","DOIUrl":"10.1016/j.automatica.2024.111880","url":null,"abstract":"<div><p>We propose a scalable, distributed algorithm for the optimal transport of large-scale multi-agent systems. We formulate the problem as one of steering the collective towards a target probability measure while minimizing the total cost of transport, with the additional constraint of distributed implementation. Using optimal transport theory, we realize the solution as an iterative transport based on a stochastic proximal descent scheme. At each stage of the transport, the agents implement an online, distributed primal–dual algorithm to obtain local estimates of the Kantorovich potential for optimal transport from the current distribution of the collective to the target distribution. Using these estimates as their local objective functions, the agents then implement the transport by stochastic proximal descent. This two-step process is carried out recursively by the agents to converge asymptotically to the target distribution. We rigorously establish the underlying theoretical framework and convergence of the algorithm and test its behavior in numerical experiments.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111880"},"PeriodicalIF":4.8,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003741/pdfft?md5=279afaa21d8e82d5ccefa238244d0e47&pid=1-s2.0-S0005109824003741-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162505","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A switching control strategy for policy selection in stochastic Dynamic Programming problems 随机动态编程问题中政策选择的切换控制策略
IF 4.8 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-09-05 DOI: 10.1016/j.automatica.2024.111884
Massimo Tipaldi , Raffaele Iervolino , Paolo Roberto Massenio , David Naso

This paper presents a switching control strategy as a criterion for policy selection in stochastic Dynamic Programming problems over an infinite time horizon. In particular, the Bellman operator, applied iteratively to solve such problems, is generalized to the case of stochastic policies, and formulated as a discrete-time switched affine system. Then, a Lyapunov-based policy selection strategy is designed to ensure the practical convergence of the resulting closed-loop system trajectories towards an appropriately chosen reference value function. This way, it is possible to verify how the chosen reference value function can be approached by using a stabilizing switching signal, the latter defined on a given finite set of stationary stochastic policies. Finally, the presented method is applied to the Value Iteration algorithm, and an illustrative example of a recycling robot is provided to demonstrate its effectiveness in terms of convergence performance.

本文提出了一种开关控制策略,作为在无限时间范围内随机动态编程问题中选择策略的标准。具体而言,本文将用于迭代求解此类问题的贝尔曼算子推广到随机策略的情况中,并将其表述为离散时间切换仿射系统。然后,设计了一种基于 Lyapunov 的策略选择策略,以确保所得到的闭环系统轨迹朝着适当选择的参考值函数实际收敛。通过这种方法,可以验证如何利用稳定开关信号接近所选的参考值函数,后者定义在给定的有限静态随机策略集合上。最后,介绍的方法被应用于价值迭代算法,并提供了一个回收机器人的示例来证明其收敛性能的有效性。
{"title":"A switching control strategy for policy selection in stochastic Dynamic Programming problems","authors":"Massimo Tipaldi ,&nbsp;Raffaele Iervolino ,&nbsp;Paolo Roberto Massenio ,&nbsp;David Naso","doi":"10.1016/j.automatica.2024.111884","DOIUrl":"10.1016/j.automatica.2024.111884","url":null,"abstract":"<div><p>This paper presents a switching control strategy as a criterion for policy selection in stochastic Dynamic Programming problems over an infinite time horizon. In particular, the Bellman operator, applied iteratively to solve such problems, is generalized to the case of stochastic policies, and formulated as a discrete-time switched affine system. Then, a Lyapunov-based policy selection strategy is designed to ensure the practical convergence of the resulting closed-loop system trajectories towards an appropriately chosen reference value function. This way, it is possible to verify how the chosen reference value function can be approached by using a stabilizing switching signal, the latter defined on a given finite set of stationary stochastic policies. Finally, the presented method is applied to the Value Iteration algorithm, and an illustrative example of a recycling robot is provided to demonstrate its effectiveness in terms of convergence performance.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111884"},"PeriodicalIF":4.8,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003789/pdfft?md5=6c3de146a3dd2eb4416dc66a045345cd&pid=1-s2.0-S0005109824003789-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162500","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Quantitatively nonblocking supervisory control of discrete-event systems 离散事件系统的定量无阻塞监督控制
IF 4.8 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-08-31 DOI: 10.1016/j.automatica.2024.111879
Renyuan Zhang , Jiahao Wang , Zenghui Wang , Kai Cai

In this paper, we propose a new property of quantitative nonblockingness of an automaton with respect to a given cover on its set of marker states. This property quantifies the standard nonblocking property by capturing the practical requirement that every subset (i.e. cell) of marker states can be reached within a prescribed number of steps from any reachable state and following any trajectory of the system. Accordingly, we formulate a new problem of quantitatively nonblocking supervisory control, and characterize its solvability in terms of a new concept of quantitative language completability. It is proven that there exists the unique supremal quantitatively completable sublanguage of a given language, and we develop an effective algorithm to compute the supremal sublanguage. Finally, combining with the algorithm of computing the supremal controllable sublanguage, we design an algorithm to compute the maximally permissive solution to the formulated quantitatively nonblocking supervisory control problem.

在本文中,我们提出了一种新的自动机定量无阻塞性属性,它与自动机标记状态集上的给定覆盖相关。这一属性量化了标准的非阻塞性,它捕捉到了这样一个实际要求,即每个标记状态子集(即单元)都能在规定的步数内从任意可到达状态到达,并遵循系统的任意轨迹。因此,我们提出了一个新的定量无阻塞监督控制问题,并用定量语言可完备性这一新概念来描述其可解性。我们证明了存在给定语言的唯一超定量可完备性子语言,并开发了计算超定量子语言的有效算法。最后,结合计算至上可控子语言的算法,我们设计了一种算法来计算所提出的定量无阻塞监督控制问题的最大允许解。
{"title":"Quantitatively nonblocking supervisory control of discrete-event systems","authors":"Renyuan Zhang ,&nbsp;Jiahao Wang ,&nbsp;Zenghui Wang ,&nbsp;Kai Cai","doi":"10.1016/j.automatica.2024.111879","DOIUrl":"10.1016/j.automatica.2024.111879","url":null,"abstract":"<div><p>In this paper, we propose a new property of <em>quantitative nonblockingness</em> of an automaton with respect to a given cover on its set of marker states. This property <em>quantifies</em> the standard nonblocking property by capturing the practical requirement that every subset (i.e. cell) of marker states can be reached within a prescribed number of steps from any reachable state and following any trajectory of the system. Accordingly, we formulate a new problem of quantitatively nonblocking supervisory control, and characterize its solvability in terms of a new concept of quantitative language completability. It is proven that there exists the unique supremal quantitatively completable sublanguage of a given language, and we develop an effective algorithm to compute the supremal sublanguage. Finally, combining with the algorithm of computing the supremal controllable sublanguage, we design an algorithm to compute the maximally permissive solution to the formulated quantitatively nonblocking supervisory control problem.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"170 ","pages":"Article 111879"},"PeriodicalIF":4.8,"publicationDate":"2024-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142095236","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An approach to mismatched disturbance rejection control for uncontrollable systems 不可控系统的不匹配干扰抑制控制方法
IF 4.8 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-08-31 DOI: 10.1016/j.automatica.2024.111876
Shichao Lv , Hongdan Li , Kai Peng , Huanshui Zhang , Xunmin Yin

This study focuses on the problem of optimal mismatched disturbance rejection control for uncontrollable linear discrete-time systems. In contrast to previous studies, by introducing a quadratic performance index such that the regulated state can track a reference trajectory and minimize the effects of disturbances, mismatched disturbance rejection control is transformed into a linear quadratic tracking problem. The necessary and sufficient conditions for the solvability of this problem over a finite horizon and a disturbance rejection controller are derived by solving a forward–backward difference equation. In the case of an infinite horizon, a sufficient condition for the stabilization of the system is obtained under the detectable condition. Additionally, in combination with the generalized extended state observer, a controller design method is proposed, and the stability analysis of the system under this controller is presented. This paper details our novel approach to disturbance rejection. Finally, four examples are provided to demonstrate the effectiveness of the proposed method.

本研究的重点是不可控线性离散时间系统的最优错配干扰抑制控制问题。与以往研究不同的是,通过引入二次性能指标,使调节状态能跟踪参考轨迹并使干扰影响最小,错配干扰抑制控制被转化为线性二次跟踪问题。通过求解前向-后向差分方程,得出了该问题在有限视界和干扰抑制控制器上可解的必要条件和充分条件。在无限视界的情况下,在可探测条件下获得了系统稳定的充分条件。此外,结合广义扩展状态观测器,还提出了一种控制器设计方法,并对该控制器下的系统进行了稳定性分析。本文详细介绍了我们新颖的干扰抑制方法。最后,本文提供了四个实例来证明所提方法的有效性。
{"title":"An approach to mismatched disturbance rejection control for uncontrollable systems","authors":"Shichao Lv ,&nbsp;Hongdan Li ,&nbsp;Kai Peng ,&nbsp;Huanshui Zhang ,&nbsp;Xunmin Yin","doi":"10.1016/j.automatica.2024.111876","DOIUrl":"10.1016/j.automatica.2024.111876","url":null,"abstract":"<div><p>This study focuses on the problem of optimal mismatched disturbance rejection control for uncontrollable linear discrete-time systems. In contrast to previous studies, by introducing a quadratic performance index such that the regulated state can track a reference trajectory and minimize the effects of disturbances, mismatched disturbance rejection control is transformed into a linear quadratic tracking problem. The necessary and sufficient conditions for the solvability of this problem over a finite horizon and a disturbance rejection controller are derived by solving a forward–backward difference equation. In the case of an infinite horizon, a sufficient condition for the stabilization of the system is obtained under the detectable condition. Additionally, in combination with the generalized extended state observer, a controller design method is proposed, and the stability analysis of the system under this controller is presented. This paper details our novel approach to disturbance rejection. Finally, four examples are provided to demonstrate the effectiveness of the proposed method.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"170 ","pages":"Article 111876"},"PeriodicalIF":4.8,"publicationDate":"2024-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142095237","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Solving optimal predictor-feedback control using approximate dynamic programming 利用近似动态程序设计解决最优预测反馈控制问题
IF 4.8 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-08-31 DOI: 10.1016/j.automatica.2024.111848
Hongxia Wang , Fuyu Zhao , Zhaorong Zhang , Juanjuan Xu , Xun Li

This paper is concerned with approximately solving the optimal predictor-feedback control problem of multiplicative-noise systems with input delay in infinite horizon. The optimal predictor-feedback control, provided by the analytical method, is determined by Riccati–ZXL equations and is hard to obtain in the case of unknown system dynamics. We aim to propose a policy iteration (PI) algorithm for solving the optimal solution by approximate dynamic programming. For convergence analysis of the algorithm, we first develop a necessary and sufficient stabilizing condition, in the form of several new Lyapunov-type equations, which parameterizes all predictor-feedback controllers and can be seen as an important addition to Lyapunov stability theory. We then propose an iterative scheme for the Riccati–ZXL equations computations, along with convergence analysis, based on the condition. Inspired by this scheme, a data-driven online PI algorithm, convergence implied in that of the iterative scheme, is proposed for the optimal predictor-feedback control problem without full system dynamics. Finally, a numerical example is used to evaluate the proposed PI algorithm.

本文主要研究在无限视距内近似求解具有输入延迟的乘噪声系统的最优预测-反馈控制问题。解析法提供的最优预测反馈控制由 Riccati-ZXL 方程决定,在系统动态未知的情况下很难获得。我们旨在提出一种策略迭代(PI)算法,通过近似动态编程求解最优解。为了分析该算法的收敛性,我们首先以几个新的 Lyapunov 型方程的形式提出了一个必要且充分的稳定条件,该条件涉及所有预测反馈控制器的参数,可视为对 Lyapunov 稳定性理论的重要补充。然后,我们提出了一种基于该条件的 Riccati-ZXL 方程计算迭代方案以及收敛性分析。受这一方案的启发,我们提出了一种数据驱动的在线 PI 算法,其收敛性隐含于迭代方案的收敛性,适用于无完整系统动态的最优预测器-反馈控制问题。最后,通过一个数值示例来评估所提出的 PI 算法。
{"title":"Solving optimal predictor-feedback control using approximate dynamic programming","authors":"Hongxia Wang ,&nbsp;Fuyu Zhao ,&nbsp;Zhaorong Zhang ,&nbsp;Juanjuan Xu ,&nbsp;Xun Li","doi":"10.1016/j.automatica.2024.111848","DOIUrl":"10.1016/j.automatica.2024.111848","url":null,"abstract":"<div><p>This paper is concerned with approximately solving the optimal predictor-feedback control problem of multiplicative-noise systems with input delay in infinite horizon. The optimal predictor-feedback control, provided by the analytical method, is determined by Riccati–ZXL equations and is hard to obtain in the case of unknown system dynamics. We aim to propose a policy iteration (PI) algorithm for solving the optimal solution by approximate dynamic programming. For convergence analysis of the algorithm, we first develop a necessary and sufficient stabilizing condition, in the form of several new Lyapunov-type equations, which parameterizes all predictor-feedback controllers and can be seen as an important addition to Lyapunov stability theory. We then propose an iterative scheme for the Riccati–ZXL equations computations, along with convergence analysis, based on the condition. Inspired by this scheme, a data-driven online PI algorithm, convergence implied in that of the iterative scheme, is proposed for the optimal predictor-feedback control problem without full system dynamics. Finally, a numerical example is used to evaluate the proposed PI algorithm.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"170 ","pages":"Article 111848"},"PeriodicalIF":4.8,"publicationDate":"2024-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142095239","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On a class of linear quadratic Gaussian quantilized mean field games 关于一类线性二次高斯量化均值场博弈
IF 4.8 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-08-31 DOI: 10.1016/j.automatica.2024.111878
Rinel Foguen Tchuendom , Roland Malhamé , Peter E. Caines

An energy provider faced with energy generation risks and a large homogeneous pool of customers designs its energy price as a time-varying function of a risk-related quantile of the total energy demand, which generalizes pricing through the mean of the total energy demand. In the infinite population limit, we model the pricing problem with a class of linear quadratic Gaussian quantilized mean field games. For these quantilized mean field games, we show existence and uniqueness of an equilibrium which reveals the price trajectory, as well as an approximate Nash property when the quantilized mean field game’s feedback control functions are applied to the large but finite game and the rate of convergence of the Nash deviation to zero as a function of the population size and the quantile is provided. Finally, the use of this class of quantilized mean field games is illustrated in the context of equivalent thermal parameter models for households heater and an energy provider using solar generation.

能源供应商面临着能源生产风险和大量同质客户,其能源价格的设计是总能源需求中与风险相关的量化值的时变函数,它通过总能源需求的均值进行一般化定价。在无限人口极限中,我们用一类线性二次高斯量化均值场博弈来模拟定价问题。对于这些量化均值场博弈,我们证明了揭示价格轨迹的均衡的存在性和唯一性,以及将量化均值场博弈的反馈控制函数应用于大型但有限博弈时的近似纳什特性,并提供了纳什偏差趋近于零的速率与人口数量和数量级的函数关系。最后,在家庭加热器和使用太阳能发电的能源提供商的等效热参数模型中说明了这一类量化均值场博弈的应用。
{"title":"On a class of linear quadratic Gaussian quantilized mean field games","authors":"Rinel Foguen Tchuendom ,&nbsp;Roland Malhamé ,&nbsp;Peter E. Caines","doi":"10.1016/j.automatica.2024.111878","DOIUrl":"10.1016/j.automatica.2024.111878","url":null,"abstract":"<div><p>An energy provider faced with energy generation risks and a large homogeneous pool of customers designs its energy price as a time-varying function of a risk-related quantile of the total energy demand, which generalizes pricing through the mean of the total energy demand. In the infinite population limit, we model the pricing problem with a class of linear quadratic Gaussian quantilized mean field games. For these quantilized mean field games, we show existence and uniqueness of an equilibrium which reveals the price trajectory, as well as an approximate Nash property when the quantilized mean field game’s feedback control functions are applied to the large but finite game and the rate of convergence of the Nash deviation to zero as a function of the population size and the quantile is provided. Finally, the use of this class of quantilized mean field games is illustrated in the context of equivalent thermal parameter models for households heater and an energy provider using solar generation.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"170 ","pages":"Article 111878"},"PeriodicalIF":4.8,"publicationDate":"2024-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142095238","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Resilient bipartite consensus of high-order heterogeneous multi-agent systems under Byzantine attacks 拜占庭攻击下高阶异构多代理系统的弹性二方共识
IF 4.8 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-08-28 DOI: 10.1016/j.automatica.2024.111834
Yang Yang, Wei Sun

This paper addresses a resilient bipartite output consensus issue for high-order heterogeneous multi-agent systems (MASs) with Byzantine attacks. Output regulator equations as well observers are introduced for bipartite leader-following issue with heterogeneous dynamics. For the security concerns, a multidimensional-bipartite-absolute-mean-subsequence-reduced (MBA-MSR) algorithm is developed for each component of received information from neighbors. This algorithm sorts and trims a set of structures, which judge the absolute value of the difference between the output of the current follower observer and that of the signed neighbor observer. It is able to exclude bounded paralyzed signals as the graph is strongly robust. Based on the filtered information via the algorithm, a resilient adaptive observer is designed to for individual follower. A resilient control strategy is then proposed for the MAS to achieve bipartite output consensus under f-local/total attack. For reduction of number of sort, a conditional MBA-MSR (CMBA-MSR) algorithm is also developed. Finally, simulation examples are given to illustrate the effectiveness of the theoretical results.

本文探讨了具有拜占庭攻击的高阶异构多代理系统(MAS)的弹性双向输出共识问题。针对具有异构动态的双向领导-跟随问题,引入了输出调节方程以及观测器。出于安全考虑,针对从邻居那里接收到的信息的每个组成部分,开发了一种多维-双方-绝对-均值-子序列缩减(MBA-MSR)算法。该算法对一组结构进行排序和修剪,判断当前跟随者观测器输出与已签名邻居观测器输出之间差值的绝对值。由于图具有很强的鲁棒性,因此它能排除有界瘫痪信号。基于通过该算法过滤后的信息,为单个跟随者设计了一个弹性自适应观测器。然后为 MAS 提出了一种弹性控制策略,以在 f 局部/总攻击下实现两端输出共识。为了减少排序次数,还开发了一种有条件的 MBA-MSR 算法(CMBA-MSR)。最后,还给出了仿真实例来说明理论结果的有效性。
{"title":"Resilient bipartite consensus of high-order heterogeneous multi-agent systems under Byzantine attacks","authors":"Yang Yang,&nbsp;Wei Sun","doi":"10.1016/j.automatica.2024.111834","DOIUrl":"10.1016/j.automatica.2024.111834","url":null,"abstract":"<div><p>This paper addresses a resilient bipartite output consensus issue for high-order heterogeneous multi-agent systems (MASs) with Byzantine attacks. Output regulator equations as well observers are introduced for bipartite leader-following issue with heterogeneous dynamics. For the security concerns, a multidimensional-bipartite-absolute-mean-subsequence-reduced (MBA-MSR) algorithm is developed for each component of received information from neighbors. This algorithm sorts and trims a set of structures, which judge the absolute value of the difference between the output of the current follower observer and that of the signed neighbor observer. It is able to exclude bounded paralyzed signals as the graph is strongly robust. Based on the filtered information via the algorithm, a resilient adaptive observer is designed to for individual follower. A resilient control strategy is then proposed for the MAS to achieve bipartite output consensus under <span><math><mi>f</mi></math></span>-local/total attack. For reduction of number of sort, a conditional MBA-MSR (CMBA-MSR) algorithm is also developed. Finally, simulation examples are given to illustrate the effectiveness of the theoretical results.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"169 ","pages":"Article 111834"},"PeriodicalIF":4.8,"publicationDate":"2024-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142089672","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Automatica
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1