Pub Date : 2024-09-07DOI: 10.1016/j.automatica.2024.111894
Lei Xin , George T.-C. Chiu , Shreyas Sundaram
The problem of online change point detection is to detect abrupt changes in properties of time series, ideally as soon as possible after those changes occur. Existing work on online change point detection either assumes i.i.d. data, focuses on asymptotic analysis, does not present theoretical guarantees on the trade-off between detection accuracy and detection delay, or is only suitable for detecting single change points. In this work, we study the online change point detection problem for linear dynamical systems with unknown dynamics, where the data exhibits temporal correlations and the system could have multiple change points. We develop a data-dependent threshold that can be used in our test that allows one to achieve a pre-specified upper bound on the probability of making a false alarm. We further provide a finite-sample-based bound for the probability of detecting a change point. Our bound demonstrates how parameters used in our algorithm affect the detection probability and delay, and provides guidance on the minimum required time between changes to guarantee detection.
{"title":"Online change points detection for linear dynamical systems with finite sample guarantees","authors":"Lei Xin , George T.-C. Chiu , Shreyas Sundaram","doi":"10.1016/j.automatica.2024.111894","DOIUrl":"10.1016/j.automatica.2024.111894","url":null,"abstract":"<div><p>The problem of online change point detection is to detect abrupt changes in properties of time series, ideally as soon as possible after those changes occur. Existing work on online change point detection either assumes i.i.d. data, focuses on asymptotic analysis, does not present theoretical guarantees on the trade-off between detection accuracy and detection delay, or is only suitable for detecting single change points. In this work, we study the online change point detection problem for linear dynamical systems with unknown dynamics, where the data exhibits temporal correlations and the system could have multiple change points. We develop a data-dependent threshold that can be used in our test that allows one to achieve a pre-specified upper bound on the probability of making a false alarm. We further provide a finite-sample-based bound for the probability of detecting a change point. Our bound demonstrates how parameters used in our algorithm affect the detection probability and delay, and provides guidance on the minimum required time between changes to guarantee detection.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111894"},"PeriodicalIF":4.8,"publicationDate":"2024-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003881/pdfft?md5=253252efe9e72628a7809ea795bb855e&pid=1-s2.0-S0005109824003881-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162579","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-07DOI: 10.1016/j.automatica.2024.111882
Yong Ding , Hanlei Wang , Wei Ren
In this paper, the distributed time-varying optimization problem is investigated for networked Lagrangian systems with parametric uncertainties. Usually, in the literature, to address some distributed control problems for nonlinear systems, a networked virtual system is constructed, and a tracking algorithm is designed such that the agents’ physical states track the virtual states. It is worth pointing out that such an idea requires the exchange of the virtual states and hence necessitates communication among the group. In addition, due to the complexities of the Lagrangian dynamics and the distributed time-varying optimization problem, there exist significant challenges. This paper proposes distributed time-varying optimization algorithms that achieve zero optimum-tracking errors for the networked Lagrangian agents without the communication requirement. The main idea behind the proposed algorithms is to construct a reference system for each agent to generate a reference velocity using absolute and relative physical state measurements with no exchange of virtual states needed, and to design adaptive controllers for Lagrangian systems such that the physical states are able to track the reference velocities and hence the optimal trajectory. The algorithms introduce mutual feedback between the reference systems and the local controllers via physical states/measurements and are amenable to implementation via local onboard sensing in a communication unfriendly environment. Specifically, first, a base algorithm is proposed to solve the distributed time-varying optimization problem for networked Lagrangian systems under switching graphs. Then, based on the base algorithm, a continuous function is introduced to approximate the signum function, forming a continuous distributed optimization algorithm and hence removing the chattering. Such a continuous algorithm is convergent with bounded ultimate optimum-tracking errors, which are proportion to approximation errors. Finally, numerical simulations are provided to illustrate the validity of the proposed algorithms.
{"title":"Distributed continuous-time time-varying optimization for networked Lagrangian systems with quadratic cost functions","authors":"Yong Ding , Hanlei Wang , Wei Ren","doi":"10.1016/j.automatica.2024.111882","DOIUrl":"10.1016/j.automatica.2024.111882","url":null,"abstract":"<div><p>In this paper, the distributed time-varying optimization problem is investigated for networked Lagrangian systems with parametric uncertainties. Usually, in the literature, to address some distributed control problems for nonlinear systems, a networked virtual system is constructed, and a tracking algorithm is designed such that the agents’ physical states track the virtual states. It is worth pointing out that such an idea requires the exchange of the virtual states and hence necessitates communication among the group. In addition, due to the complexities of the Lagrangian dynamics and the distributed time-varying optimization problem, there exist significant challenges. This paper proposes distributed time-varying optimization algorithms that achieve zero optimum-tracking errors for the networked Lagrangian agents without the communication requirement. The main idea behind the proposed algorithms is to construct a reference system for each agent to generate a reference velocity using absolute and relative physical state measurements with no exchange of virtual states needed, and to design adaptive controllers for Lagrangian systems such that the physical states are able to track the reference velocities and hence the optimal trajectory. The algorithms introduce mutual feedback between the reference systems and the local controllers via physical states/measurements and are amenable to implementation via local onboard sensing in a communication unfriendly environment. Specifically, first, a base algorithm is proposed to solve the distributed time-varying optimization problem for networked Lagrangian systems under switching graphs. Then, based on the base algorithm, a continuous function is introduced to approximate the signum function, forming a continuous distributed optimization algorithm and hence removing the chattering. Such a continuous algorithm is convergent with bounded ultimate optimum-tracking errors, which are proportion to approximation errors. Finally, numerical simulations are provided to illustrate the validity of the proposed algorithms.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111882"},"PeriodicalIF":4.8,"publicationDate":"2024-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003765/pdfft?md5=268cd3ac8c9394f35de6171bde25b9be&pid=1-s2.0-S0005109824003765-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-06DOI: 10.1016/j.automatica.2024.111883
Shuang Cong , Zhixiang Dong , Jie Wen , Kezhi Li
For -qubit stochastic open quantum systems, an online quantum state estimation (OQSE) algorithm and the associated online estimated-based-state feedback control (OQSE-FC) are proposed in this paper. The proposed OQSE algorithm integrates the online alternating direction multiplier method (OADM) to the continuous weak measurement (CWM). The quantum state feedback control laws are designed based on the Lyapunov stability theorem, and the states for feedback control are online estimated by OQSE algorithm. The convergence of OQSE algorithm and the asymptotic stability of the state feedback control laws are proved.
{"title":"Online estimated-based-state feedback control of n-qubit stochastic open quantum systems","authors":"Shuang Cong , Zhixiang Dong , Jie Wen , Kezhi Li","doi":"10.1016/j.automatica.2024.111883","DOIUrl":"10.1016/j.automatica.2024.111883","url":null,"abstract":"<div><p>For <span><math><mi>n</mi></math></span>-qubit stochastic open quantum systems, an online quantum state estimation (OQSE) algorithm and the associated online estimated-based-state feedback control (OQSE-FC) are proposed in this paper. The proposed OQSE algorithm integrates the online alternating direction multiplier method (OADM) to the continuous weak measurement (CWM). The quantum state feedback control laws are designed based on the Lyapunov stability theorem, and the states for feedback control are online estimated by OQSE algorithm. The convergence of OQSE algorithm and the asymptotic stability of the state feedback control laws are proved.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111883"},"PeriodicalIF":4.8,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003777/pdfft?md5=e20a03851b75b5f56ef9ad5bc20ad096&pid=1-s2.0-S0005109824003777-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162498","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-05DOI: 10.1016/j.automatica.2024.111880
Vishaal Krishnan , Sonia Martínez
We propose a scalable, distributed algorithm for the optimal transport of large-scale multi-agent systems. We formulate the problem as one of steering the collective towards a target probability measure while minimizing the total cost of transport, with the additional constraint of distributed implementation. Using optimal transport theory, we realize the solution as an iterative transport based on a stochastic proximal descent scheme. At each stage of the transport, the agents implement an online, distributed primal–dual algorithm to obtain local estimates of the Kantorovich potential for optimal transport from the current distribution of the collective to the target distribution. Using these estimates as their local objective functions, the agents then implement the transport by stochastic proximal descent. This two-step process is carried out recursively by the agents to converge asymptotically to the target distribution. We rigorously establish the underlying theoretical framework and convergence of the algorithm and test its behavior in numerical experiments.
{"title":"Distributed online optimization for multi-agent optimal transport","authors":"Vishaal Krishnan , Sonia Martínez","doi":"10.1016/j.automatica.2024.111880","DOIUrl":"10.1016/j.automatica.2024.111880","url":null,"abstract":"<div><p>We propose a scalable, distributed algorithm for the optimal transport of large-scale multi-agent systems. We formulate the problem as one of steering the collective towards a target probability measure while minimizing the total cost of transport, with the additional constraint of distributed implementation. Using optimal transport theory, we realize the solution as an iterative transport based on a stochastic proximal descent scheme. At each stage of the transport, the agents implement an online, distributed primal–dual algorithm to obtain local estimates of the Kantorovich potential for optimal transport from the current distribution of the collective to the target distribution. Using these estimates as their local objective functions, the agents then implement the transport by stochastic proximal descent. This two-step process is carried out recursively by the agents to converge asymptotically to the target distribution. We rigorously establish the underlying theoretical framework and convergence of the algorithm and test its behavior in numerical experiments.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111880"},"PeriodicalIF":4.8,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003741/pdfft?md5=279afaa21d8e82d5ccefa238244d0e47&pid=1-s2.0-S0005109824003741-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162505","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-05DOI: 10.1016/j.automatica.2024.111884
Massimo Tipaldi , Raffaele Iervolino , Paolo Roberto Massenio , David Naso
This paper presents a switching control strategy as a criterion for policy selection in stochastic Dynamic Programming problems over an infinite time horizon. In particular, the Bellman operator, applied iteratively to solve such problems, is generalized to the case of stochastic policies, and formulated as a discrete-time switched affine system. Then, a Lyapunov-based policy selection strategy is designed to ensure the practical convergence of the resulting closed-loop system trajectories towards an appropriately chosen reference value function. This way, it is possible to verify how the chosen reference value function can be approached by using a stabilizing switching signal, the latter defined on a given finite set of stationary stochastic policies. Finally, the presented method is applied to the Value Iteration algorithm, and an illustrative example of a recycling robot is provided to demonstrate its effectiveness in terms of convergence performance.
{"title":"A switching control strategy for policy selection in stochastic Dynamic Programming problems","authors":"Massimo Tipaldi , Raffaele Iervolino , Paolo Roberto Massenio , David Naso","doi":"10.1016/j.automatica.2024.111884","DOIUrl":"10.1016/j.automatica.2024.111884","url":null,"abstract":"<div><p>This paper presents a switching control strategy as a criterion for policy selection in stochastic Dynamic Programming problems over an infinite time horizon. In particular, the Bellman operator, applied iteratively to solve such problems, is generalized to the case of stochastic policies, and formulated as a discrete-time switched affine system. Then, a Lyapunov-based policy selection strategy is designed to ensure the practical convergence of the resulting closed-loop system trajectories towards an appropriately chosen reference value function. This way, it is possible to verify how the chosen reference value function can be approached by using a stabilizing switching signal, the latter defined on a given finite set of stationary stochastic policies. Finally, the presented method is applied to the Value Iteration algorithm, and an illustrative example of a recycling robot is provided to demonstrate its effectiveness in terms of convergence performance.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111884"},"PeriodicalIF":4.8,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003789/pdfft?md5=6c3de146a3dd2eb4416dc66a045345cd&pid=1-s2.0-S0005109824003789-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162500","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-31DOI: 10.1016/j.automatica.2024.111879
Renyuan Zhang , Jiahao Wang , Zenghui Wang , Kai Cai
In this paper, we propose a new property of quantitative nonblockingness of an automaton with respect to a given cover on its set of marker states. This property quantifies the standard nonblocking property by capturing the practical requirement that every subset (i.e. cell) of marker states can be reached within a prescribed number of steps from any reachable state and following any trajectory of the system. Accordingly, we formulate a new problem of quantitatively nonblocking supervisory control, and characterize its solvability in terms of a new concept of quantitative language completability. It is proven that there exists the unique supremal quantitatively completable sublanguage of a given language, and we develop an effective algorithm to compute the supremal sublanguage. Finally, combining with the algorithm of computing the supremal controllable sublanguage, we design an algorithm to compute the maximally permissive solution to the formulated quantitatively nonblocking supervisory control problem.
{"title":"Quantitatively nonblocking supervisory control of discrete-event systems","authors":"Renyuan Zhang , Jiahao Wang , Zenghui Wang , Kai Cai","doi":"10.1016/j.automatica.2024.111879","DOIUrl":"10.1016/j.automatica.2024.111879","url":null,"abstract":"<div><p>In this paper, we propose a new property of <em>quantitative nonblockingness</em> of an automaton with respect to a given cover on its set of marker states. This property <em>quantifies</em> the standard nonblocking property by capturing the practical requirement that every subset (i.e. cell) of marker states can be reached within a prescribed number of steps from any reachable state and following any trajectory of the system. Accordingly, we formulate a new problem of quantitatively nonblocking supervisory control, and characterize its solvability in terms of a new concept of quantitative language completability. It is proven that there exists the unique supremal quantitatively completable sublanguage of a given language, and we develop an effective algorithm to compute the supremal sublanguage. Finally, combining with the algorithm of computing the supremal controllable sublanguage, we design an algorithm to compute the maximally permissive solution to the formulated quantitatively nonblocking supervisory control problem.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"170 ","pages":"Article 111879"},"PeriodicalIF":4.8,"publicationDate":"2024-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142095236","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-31DOI: 10.1016/j.automatica.2024.111876
Shichao Lv , Hongdan Li , Kai Peng , Huanshui Zhang , Xunmin Yin
This study focuses on the problem of optimal mismatched disturbance rejection control for uncontrollable linear discrete-time systems. In contrast to previous studies, by introducing a quadratic performance index such that the regulated state can track a reference trajectory and minimize the effects of disturbances, mismatched disturbance rejection control is transformed into a linear quadratic tracking problem. The necessary and sufficient conditions for the solvability of this problem over a finite horizon and a disturbance rejection controller are derived by solving a forward–backward difference equation. In the case of an infinite horizon, a sufficient condition for the stabilization of the system is obtained under the detectable condition. Additionally, in combination with the generalized extended state observer, a controller design method is proposed, and the stability analysis of the system under this controller is presented. This paper details our novel approach to disturbance rejection. Finally, four examples are provided to demonstrate the effectiveness of the proposed method.
{"title":"An approach to mismatched disturbance rejection control for uncontrollable systems","authors":"Shichao Lv , Hongdan Li , Kai Peng , Huanshui Zhang , Xunmin Yin","doi":"10.1016/j.automatica.2024.111876","DOIUrl":"10.1016/j.automatica.2024.111876","url":null,"abstract":"<div><p>This study focuses on the problem of optimal mismatched disturbance rejection control for uncontrollable linear discrete-time systems. In contrast to previous studies, by introducing a quadratic performance index such that the regulated state can track a reference trajectory and minimize the effects of disturbances, mismatched disturbance rejection control is transformed into a linear quadratic tracking problem. The necessary and sufficient conditions for the solvability of this problem over a finite horizon and a disturbance rejection controller are derived by solving a forward–backward difference equation. In the case of an infinite horizon, a sufficient condition for the stabilization of the system is obtained under the detectable condition. Additionally, in combination with the generalized extended state observer, a controller design method is proposed, and the stability analysis of the system under this controller is presented. This paper details our novel approach to disturbance rejection. Finally, four examples are provided to demonstrate the effectiveness of the proposed method.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"170 ","pages":"Article 111876"},"PeriodicalIF":4.8,"publicationDate":"2024-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142095237","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-31DOI: 10.1016/j.automatica.2024.111848
Hongxia Wang , Fuyu Zhao , Zhaorong Zhang , Juanjuan Xu , Xun Li
This paper is concerned with approximately solving the optimal predictor-feedback control problem of multiplicative-noise systems with input delay in infinite horizon. The optimal predictor-feedback control, provided by the analytical method, is determined by Riccati–ZXL equations and is hard to obtain in the case of unknown system dynamics. We aim to propose a policy iteration (PI) algorithm for solving the optimal solution by approximate dynamic programming. For convergence analysis of the algorithm, we first develop a necessary and sufficient stabilizing condition, in the form of several new Lyapunov-type equations, which parameterizes all predictor-feedback controllers and can be seen as an important addition to Lyapunov stability theory. We then propose an iterative scheme for the Riccati–ZXL equations computations, along with convergence analysis, based on the condition. Inspired by this scheme, a data-driven online PI algorithm, convergence implied in that of the iterative scheme, is proposed for the optimal predictor-feedback control problem without full system dynamics. Finally, a numerical example is used to evaluate the proposed PI algorithm.
本文主要研究在无限视距内近似求解具有输入延迟的乘噪声系统的最优预测-反馈控制问题。解析法提供的最优预测反馈控制由 Riccati-ZXL 方程决定,在系统动态未知的情况下很难获得。我们旨在提出一种策略迭代(PI)算法,通过近似动态编程求解最优解。为了分析该算法的收敛性,我们首先以几个新的 Lyapunov 型方程的形式提出了一个必要且充分的稳定条件,该条件涉及所有预测反馈控制器的参数,可视为对 Lyapunov 稳定性理论的重要补充。然后,我们提出了一种基于该条件的 Riccati-ZXL 方程计算迭代方案以及收敛性分析。受这一方案的启发,我们提出了一种数据驱动的在线 PI 算法,其收敛性隐含于迭代方案的收敛性,适用于无完整系统动态的最优预测器-反馈控制问题。最后,通过一个数值示例来评估所提出的 PI 算法。
{"title":"Solving optimal predictor-feedback control using approximate dynamic programming","authors":"Hongxia Wang , Fuyu Zhao , Zhaorong Zhang , Juanjuan Xu , Xun Li","doi":"10.1016/j.automatica.2024.111848","DOIUrl":"10.1016/j.automatica.2024.111848","url":null,"abstract":"<div><p>This paper is concerned with approximately solving the optimal predictor-feedback control problem of multiplicative-noise systems with input delay in infinite horizon. The optimal predictor-feedback control, provided by the analytical method, is determined by Riccati–ZXL equations and is hard to obtain in the case of unknown system dynamics. We aim to propose a policy iteration (PI) algorithm for solving the optimal solution by approximate dynamic programming. For convergence analysis of the algorithm, we first develop a necessary and sufficient stabilizing condition, in the form of several new Lyapunov-type equations, which parameterizes all predictor-feedback controllers and can be seen as an important addition to Lyapunov stability theory. We then propose an iterative scheme for the Riccati–ZXL equations computations, along with convergence analysis, based on the condition. Inspired by this scheme, a data-driven online PI algorithm, convergence implied in that of the iterative scheme, is proposed for the optimal predictor-feedback control problem without full system dynamics. Finally, a numerical example is used to evaluate the proposed PI algorithm.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"170 ","pages":"Article 111848"},"PeriodicalIF":4.8,"publicationDate":"2024-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142095239","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-31DOI: 10.1016/j.automatica.2024.111878
Rinel Foguen Tchuendom , Roland Malhamé , Peter E. Caines
An energy provider faced with energy generation risks and a large homogeneous pool of customers designs its energy price as a time-varying function of a risk-related quantile of the total energy demand, which generalizes pricing through the mean of the total energy demand. In the infinite population limit, we model the pricing problem with a class of linear quadratic Gaussian quantilized mean field games. For these quantilized mean field games, we show existence and uniqueness of an equilibrium which reveals the price trajectory, as well as an approximate Nash property when the quantilized mean field game’s feedback control functions are applied to the large but finite game and the rate of convergence of the Nash deviation to zero as a function of the population size and the quantile is provided. Finally, the use of this class of quantilized mean field games is illustrated in the context of equivalent thermal parameter models for households heater and an energy provider using solar generation.
{"title":"On a class of linear quadratic Gaussian quantilized mean field games","authors":"Rinel Foguen Tchuendom , Roland Malhamé , Peter E. Caines","doi":"10.1016/j.automatica.2024.111878","DOIUrl":"10.1016/j.automatica.2024.111878","url":null,"abstract":"<div><p>An energy provider faced with energy generation risks and a large homogeneous pool of customers designs its energy price as a time-varying function of a risk-related quantile of the total energy demand, which generalizes pricing through the mean of the total energy demand. In the infinite population limit, we model the pricing problem with a class of linear quadratic Gaussian quantilized mean field games. For these quantilized mean field games, we show existence and uniqueness of an equilibrium which reveals the price trajectory, as well as an approximate Nash property when the quantilized mean field game’s feedback control functions are applied to the large but finite game and the rate of convergence of the Nash deviation to zero as a function of the population size and the quantile is provided. Finally, the use of this class of quantilized mean field games is illustrated in the context of equivalent thermal parameter models for households heater and an energy provider using solar generation.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"170 ","pages":"Article 111878"},"PeriodicalIF":4.8,"publicationDate":"2024-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142095238","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-28DOI: 10.1016/j.automatica.2024.111834
Yang Yang, Wei Sun
This paper addresses a resilient bipartite output consensus issue for high-order heterogeneous multi-agent systems (MASs) with Byzantine attacks. Output regulator equations as well observers are introduced for bipartite leader-following issue with heterogeneous dynamics. For the security concerns, a multidimensional-bipartite-absolute-mean-subsequence-reduced (MBA-MSR) algorithm is developed for each component of received information from neighbors. This algorithm sorts and trims a set of structures, which judge the absolute value of the difference between the output of the current follower observer and that of the signed neighbor observer. It is able to exclude bounded paralyzed signals as the graph is strongly robust. Based on the filtered information via the algorithm, a resilient adaptive observer is designed to for individual follower. A resilient control strategy is then proposed for the MAS to achieve bipartite output consensus under -local/total attack. For reduction of number of sort, a conditional MBA-MSR (CMBA-MSR) algorithm is also developed. Finally, simulation examples are given to illustrate the effectiveness of the theoretical results.
本文探讨了具有拜占庭攻击的高阶异构多代理系统(MAS)的弹性双向输出共识问题。针对具有异构动态的双向领导-跟随问题,引入了输出调节方程以及观测器。出于安全考虑,针对从邻居那里接收到的信息的每个组成部分,开发了一种多维-双方-绝对-均值-子序列缩减(MBA-MSR)算法。该算法对一组结构进行排序和修剪,判断当前跟随者观测器输出与已签名邻居观测器输出之间差值的绝对值。由于图具有很强的鲁棒性,因此它能排除有界瘫痪信号。基于通过该算法过滤后的信息,为单个跟随者设计了一个弹性自适应观测器。然后为 MAS 提出了一种弹性控制策略,以在 f 局部/总攻击下实现两端输出共识。为了减少排序次数,还开发了一种有条件的 MBA-MSR 算法(CMBA-MSR)。最后,还给出了仿真实例来说明理论结果的有效性。
{"title":"Resilient bipartite consensus of high-order heterogeneous multi-agent systems under Byzantine attacks","authors":"Yang Yang, Wei Sun","doi":"10.1016/j.automatica.2024.111834","DOIUrl":"10.1016/j.automatica.2024.111834","url":null,"abstract":"<div><p>This paper addresses a resilient bipartite output consensus issue for high-order heterogeneous multi-agent systems (MASs) with Byzantine attacks. Output regulator equations as well observers are introduced for bipartite leader-following issue with heterogeneous dynamics. For the security concerns, a multidimensional-bipartite-absolute-mean-subsequence-reduced (MBA-MSR) algorithm is developed for each component of received information from neighbors. This algorithm sorts and trims a set of structures, which judge the absolute value of the difference between the output of the current follower observer and that of the signed neighbor observer. It is able to exclude bounded paralyzed signals as the graph is strongly robust. Based on the filtered information via the algorithm, a resilient adaptive observer is designed to for individual follower. A resilient control strategy is then proposed for the MAS to achieve bipartite output consensus under <span><math><mi>f</mi></math></span>-local/total attack. For reduction of number of sort, a conditional MBA-MSR (CMBA-MSR) algorithm is also developed. Finally, simulation examples are given to illustrate the effectiveness of the theoretical results.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"169 ","pages":"Article 111834"},"PeriodicalIF":4.8,"publicationDate":"2024-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142089672","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}