The convergence and stability of uncertain nonlinear systems is a challenging problem in the nonlinear control area. Besides, in many practical cases, all states are not measurable and are affected by measurement noise. Based on this motivation, the first objective of this paper is to design a novel output feedback robust model predictive control approach for nonlinear systems with state- and input-dependent uncertainties and measurement noise. This approach combines state estimation and robust model predictive control (MPC) into one min–max optimization and by solving the optimization, these two tasks are performed simultaneously. The studied nonlinear system comprises a linear part, a nonlinear part, and a function that denotes the state- and input-dependent uncertainties. Therefore, the other objective is to reduce the computational complexity; thus, the system's nonlinear term and the aforementioned uncertainties are converted into additional disturbances. Subsequently, the optimization problem becomes a quadratic form, which leads to global convergence with the appropriate selection of objective function weights. Besides, this paper explores the convergence of the closed-loop system states and the sufficient synthesis conditions to guarantee input-to-state stability. The implementation on a numerical example and a CSTR process demonstrate the applicability and reliability of the proposed approach.
{"title":"Simultaneous robust model predictive control and state estimation for nonlinear systems with state- and input-dependent uncertainties","authors":"Farid Badfar, Ali Akbar Safavi","doi":"10.1002/asjc.3382","DOIUrl":"10.1002/asjc.3382","url":null,"abstract":"<p>The convergence and stability of uncertain nonlinear systems is a challenging problem in the nonlinear control area. Besides, in many practical cases, all states are not measurable and are affected by measurement noise. Based on this motivation, the first objective of this paper is to design a novel output feedback robust model predictive control approach for nonlinear systems with state- and input-dependent uncertainties and measurement noise. This approach combines state estimation and robust model predictive control (MPC) into one min–max optimization and by solving the optimization, these two tasks are performed simultaneously. The studied nonlinear system comprises a linear part, a nonlinear part, and a function that denotes the state- and input-dependent uncertainties. Therefore, the other objective is to reduce the computational complexity; thus, the system's nonlinear term and the aforementioned uncertainties are converted into additional disturbances. Subsequently, the optimization problem becomes a quadratic form, which leads to global convergence with the appropriate selection of objective function weights. Besides, this paper explores the convergence of the closed-loop system states and the sufficient synthesis conditions to guarantee input-to-state stability. The implementation on a numerical example and a CSTR process demonstrate the applicability and reliability of the proposed approach.</p>","PeriodicalId":55453,"journal":{"name":"Asian Journal of Control","volume":"26 6","pages":"3082-3101"},"PeriodicalIF":2.7,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140828027","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This paper introduces mix-zero-sum differential (MZSD) game theory to address multi-player tracking systems, offering a better understanding of the coexistence of cooperation and competition among players. Within this framework, we present an optimal safety tracking control (OSTC) method, which incorporates a control barrier function (CBF) into the value function to ensure that the tracking error remains within a specified range, thus guaranteeing safety while achieving optimization. Simultaneously, to eliminate the need for system dynamics, we propose a novel approach leveraging off-policy integral reinforcement learning (IRL) technology to obtain the Nash equilibrium solution of the MZSD games. We establish a unique critics–actors neural network (NN) structure that updates concurrently. Furthermore, we analyze stability and convergence using the Lyapunov method. We conduct two simulations to demonstrate the effectiveness of the proposed algorithm.
{"title":"Safe tracking in games: Achieving optimal control with unknown dynamics and constraints","authors":"Xiaohong Cui, Wenjie Chen, Binrui Wang, Kun Zhou","doi":"10.1002/asjc.3397","DOIUrl":"10.1002/asjc.3397","url":null,"abstract":"<p>This paper introduces mix-zero-sum differential (MZSD) game theory to address multi-player tracking systems, offering a better understanding of the coexistence of cooperation and competition among players. Within this framework, we present an optimal safety tracking control (OSTC) method, which incorporates a control barrier function (CBF) into the value function to ensure that the tracking error remains within a specified range, thus guaranteeing safety while achieving optimization. Simultaneously, to eliminate the need for system dynamics, we propose a novel approach leveraging off-policy integral reinforcement learning (IRL) technology to obtain the Nash equilibrium solution of the MZSD games. We establish a unique critics–actors neural network (NN) structure that updates concurrently. Furthermore, we analyze stability and convergence using the Lyapunov method. We conduct two simulations to demonstrate the effectiveness of the proposed algorithm.</p>","PeriodicalId":55453,"journal":{"name":"Asian Journal of Control","volume":"26 6","pages":"3190-3209"},"PeriodicalIF":2.7,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140828029","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This paper investigates the problem of robust coordination control based on interval observers for multi-agent systems in the presence of input saturation and disturbances. Firstly, in the scenario where the system state is not directly measurable, two types of interval observers are, respectively, constructed by resorting to the upper and lower bounds on external perturbances as well as the output information. Secondly, a parametric Lyapunov equation-based low-gain feedback control method is proposed to guarantee semiglobal bounded consensus. In contrast to the conventional approach based on parametric algebraic Riccati equations, the proposed method offers the advantage of allowing the parameters to be determined in advance. Finally, a simulation example and a practical electrical circuit model are conducted to verify the theoretical results.
{"title":"Semiglobal interval observer-based robust coordination control of multi-agent systems with input saturation","authors":"Zhipeng Zhang, Jun Shen, Hongling Qiu, Cheng Fei","doi":"10.1002/asjc.3406","DOIUrl":"10.1002/asjc.3406","url":null,"abstract":"<p>This paper investigates the problem of robust coordination control based on interval observers for multi-agent systems in the presence of input saturation and disturbances. Firstly, in the scenario where the system state is not directly measurable, two types of interval observers are, respectively, constructed by resorting to the upper and lower bounds on external perturbances as well as the output information. Secondly, a parametric Lyapunov equation-based low-gain feedback control method is proposed to guarantee semiglobal bounded consensus. In contrast to the conventional approach based on parametric algebraic Riccati equations, the proposed method offers the advantage of allowing the parameters to be determined in advance. Finally, a simulation example and a practical electrical circuit model are conducted to verify the theoretical results.</p>","PeriodicalId":55453,"journal":{"name":"Asian Journal of Control","volume":"26 6","pages":"3302-3313"},"PeriodicalIF":2.7,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140828204","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
State-based games contain an additional state space by comparing with normal games. Correspondingly, the equilibrium of state-based games is called recurrent state equilibrium (RSE). For state-based games, the stochastic convergence to RSE is investigated in this paper. Firstly, the stochastic convergence of state-based games is defined. Then, a kind of state-based best-response update rule is designed for state-based games. Under this update rule, the state-based games can be converted into the Markovian switching logical networks through the semi-tensor product. Next, based on the results of Markovian switching logical networks and positive systems, the stochastic convergence of state-based games is investigated and a verifiable criterion is derived. Finally, an example is presented to illustrate the validity of the obtained criterion.
{"title":"Stochastic convergence to recurrent state equilibrium for state-based games","authors":"Xiaomeng Wei, Haitao Li","doi":"10.1002/asjc.3400","DOIUrl":"10.1002/asjc.3400","url":null,"abstract":"<p>State-based games contain an additional state space by comparing with normal games. Correspondingly, the equilibrium of state-based games is called recurrent state equilibrium (RSE). For state-based games, the stochastic convergence to RSE is investigated in this paper. Firstly, the stochastic convergence of state-based games is defined. Then, a kind of state-based best-response update rule is designed for state-based games. Under this update rule, the state-based games can be converted into the Markovian switching logical networks through the semi-tensor product. Next, based on the results of Markovian switching logical networks and positive systems, the stochastic convergence of state-based games is investigated and a verifiable criterion is derived. Finally, an example is presented to illustrate the validity of the obtained criterion.</p>","PeriodicalId":55453,"journal":{"name":"Asian Journal of Control","volume":"26 6","pages":"3226-3234"},"PeriodicalIF":2.7,"publicationDate":"2024-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140810387","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The proportional-integral-derivative (PID) was developed and recognized for its reliability. A PID controller is not only simple but also relatively cheap. However, the controller causes system performance degeneration over time due to the presence of windup in a motor speed control system. The windup phenomenon is caused by the saturated control state. Various anti-windup methods were introduced to decrease a system's long settling time and extreme overshooting. Most anti-windup techniques require integral switching between saturated and unsaturated states, whereby both versions of steady-state integral proportional-integral controller do not need integral switching mechanism. They possess a certain degree of decoupling between