首页 > 最新文献

Systems & Control Letters最新文献

英文 中文
Adaptive output feedback containment control for parabolic PDE multi-agent systems
IF 2.1 3区 计算机科学 Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-02-01 DOI: 10.1016/j.sysconle.2024.105994
Li Tang, Feixia Liu
This paper investigates the output feedback containment control problem of multi-agent systems (MASs) with multiple leaders described by partial differential equations (PDEs). In contrast to MASs modeled by ODEs, the PDEs system studied in this paper considers additional spatial variables, which leads to traditional ODEs control design methods inapplicable, then the design of observer based adaptive distributed protocols is more challenging. Considering that leaders may be task-driven, the control inputs of the leaders are non-zero and time-varying. Through the introduction of nonlinear terms in the containment controller to eliminate the influence of leader control inputs, the paper ultimately achieves bounded tracking errors and containment errors for agents under undirected graph topologies. Finally, the designed control scheme is validated through examples.
本文研究了由偏微分方程(PDEs)描述的多领导者多代理系统(MASs)的输出反馈控制问题。与用偏微分方程建模的 MAS 相比,本文研究的偏微分方程系统考虑了额外的空间变量,这导致传统的偏微分方程控制设计方法不适用,那么基于观测器的自适应分布式协议的设计就更具挑战性。考虑到领导者可能是任务驱动的,领导者的控制输入是非零和时变的。通过在遏制控制器中引入非线性项来消除领导者控制输入的影响,本文最终实现了无向图拓扑下代理的有界跟踪误差和遏制误差。最后,本文通过实例验证了所设计的控制方案。
{"title":"Adaptive output feedback containment control for parabolic PDE multi-agent systems","authors":"Li Tang,&nbsp;Feixia Liu","doi":"10.1016/j.sysconle.2024.105994","DOIUrl":"10.1016/j.sysconle.2024.105994","url":null,"abstract":"<div><div>This paper investigates the output feedback containment control problem of multi-agent systems (MASs) with multiple leaders described by partial differential equations (PDEs). In contrast to MASs modeled by ODEs, the PDEs system studied in this paper considers additional spatial variables, which leads to traditional ODEs control design methods inapplicable, then the design of observer based adaptive distributed protocols is more challenging. Considering that leaders may be task-driven, the control inputs of the leaders are non-zero and time-varying. Through the introduction of nonlinear terms in the containment controller to eliminate the influence of leader control inputs, the paper ultimately achieves bounded tracking errors and containment errors for agents under undirected graph topologies. Finally, the designed control scheme is validated through examples.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"196 ","pages":"Article 105994"},"PeriodicalIF":2.1,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143183652","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Practical considerations for implementing robust-to-early termination model predictive control
IF 2.1 3区 计算机科学 Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-02-01 DOI: 10.1016/j.sysconle.2024.106018
Mohsen Amiri, Mehdi Hosseinzadeh
Model Predictive Control (MPC) is widely used to achieve performance objectives, while enforcing operational and safety constraints. Despite its high performance, MPC often demands significant computational resources, making it challenging to implement in systems with limited computing capacity. A recent approach to address this challenge is to use the Robust-to-Early Termination (REAP) strategy. At any time instant, REAP converts the MPC problem into the evolution of a virtual dynamical system whose trajectory converges to the optimal solution, and provides guaranteed sub-optimal and feasible solution whenever its evolution is terminated due to limited computational power. REAP has been introduced as a continuous-time scheme and its theoretical properties have been derived under the assumption that it performs all the computations in continuous time. However, REAP should be practically implemented in discrete-time. This paper focuses on the discrete-time implementation of REAP, exploring conditions under which anytime feasibility and convergence properties are maintained when the computations are performed in discrete time. The proposed methodology is validated and evaluated through extensive simulation and experimental studies.
{"title":"Practical considerations for implementing robust-to-early termination model predictive control","authors":"Mohsen Amiri,&nbsp;Mehdi Hosseinzadeh","doi":"10.1016/j.sysconle.2024.106018","DOIUrl":"10.1016/j.sysconle.2024.106018","url":null,"abstract":"<div><div>Model Predictive Control (MPC) is widely used to achieve performance objectives, while enforcing operational and safety constraints. Despite its high performance, MPC often demands significant computational resources, making it challenging to implement in systems with limited computing capacity. A recent approach to address this challenge is to use the Robust-to-Early Termination (REAP) strategy. At any time instant, REAP converts the MPC problem into the evolution of a virtual dynamical system whose trajectory converges to the optimal solution, and provides guaranteed sub-optimal and feasible solution whenever its evolution is terminated due to limited computational power. REAP has been introduced as a continuous-time scheme and its theoretical properties have been derived under the assumption that it performs all the computations in continuous time. However, REAP should be practically implemented in discrete-time. This paper focuses on the discrete-time implementation of REAP, exploring conditions under which anytime feasibility and convergence properties are maintained when the computations are performed in discrete time. The proposed methodology is validated and evaluated through extensive simulation and experimental studies.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"196 ","pages":"Article 106018"},"PeriodicalIF":2.1,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143182057","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Myopic optimal strategies for a class of continuous-time deterministic and stochastic control problems
IF 2.1 3区 计算机科学 Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-02-01 DOI: 10.1016/j.sysconle.2024.106016
José E. Márquez-Prado , Onésimo Hernández-Lerma , Héctor Jasso-Fuentes
We give conditions for a class of continuous-time deterministic and stochastic optimal control problems to have myopic optimal strategies, that is, optimal controls obtained by solving optimization problems independent of the state trajectory. We show how these sufficient conditions are the same for the deterministic and stochastic cases, which means that the certainty equivalence principle is satisfied. Moreover, for the infinite-horizon time-homogeneous case, myopic optimal strategies are obtained by solving a single optimization problem; hence, optimal controls are constant functions.
我们给出了一类连续时间确定性和随机最优控制问题具有近视最优策略的条件,即通过求解与状态轨迹无关的优化问题获得最优控制。我们展示了这些充分条件在确定性和随机性情况下是如何相同的,这意味着确定性等价原理得到了满足。此外,对于无限视距时间同构情况,近视最优策略是通过求解单一优化问题获得的;因此,最优控制是常数函数。
{"title":"Myopic optimal strategies for a class of continuous-time deterministic and stochastic control problems","authors":"José E. Márquez-Prado ,&nbsp;Onésimo Hernández-Lerma ,&nbsp;Héctor Jasso-Fuentes","doi":"10.1016/j.sysconle.2024.106016","DOIUrl":"10.1016/j.sysconle.2024.106016","url":null,"abstract":"<div><div>We give conditions for a class of continuous-time deterministic and stochastic optimal control problems to have <em>myopic optimal strategies</em>, that is, optimal controls obtained by solving optimization problems independent of the state trajectory. We show how these sufficient conditions are the same for the deterministic and stochastic cases, which means that the <em>certainty equivalence principle</em> is satisfied. Moreover, for the infinite-horizon time-homogeneous case, myopic optimal strategies are obtained by solving a single optimization problem; hence, optimal controls are constant functions.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"196 ","pages":"Article 106016"},"PeriodicalIF":2.1,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143183649","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Formal safety verification of non-deterministic systems based on probabilistic reachability computation
IF 2.1 3区 计算机科学 Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-02-01 DOI: 10.1016/j.sysconle.2024.106014
Yuminghao Xiao, Tianbing Xia, Hongdong Wang
In this paper, we develop a formal safety verification method based on analytic probabilistic reachability computation, which can estimate the probability of controlled non-deterministic systems entering unsafe states subject to disturbances. Specifically, we employ stochastic differential equations (SDEs) to describe the dynamics of the system and resort to a regularized indicator function to express the collision probability between the state trajectory of the system and unsafe states. We proceed to formulate this collision probability as the viscosity solution to a second-order variational-inequality and provide a rigorous proof for such a novel interpretation. Moreover, we discuss the ENO-Godunov scheme for solving the deduced variational-inequality, which obviates the need for Monte-Carlo simulations and the optimality condition along a complex boundary. The developed framework offers a structured approach to identify potential risks in safety critical systems and maintains a user-friendly implementation. Lastly, we demonstrate the above application in a safety verification problem related to maritime navigation.
{"title":"Formal safety verification of non-deterministic systems based on probabilistic reachability computation","authors":"Yuminghao Xiao,&nbsp;Tianbing Xia,&nbsp;Hongdong Wang","doi":"10.1016/j.sysconle.2024.106014","DOIUrl":"10.1016/j.sysconle.2024.106014","url":null,"abstract":"<div><div>In this paper, we develop a formal safety verification method based on analytic probabilistic reachability computation, which can estimate the probability of controlled non-deterministic systems entering unsafe states subject to disturbances. Specifically, we employ stochastic differential equations (SDEs) to describe the dynamics of the system and resort to a regularized indicator function to express the collision probability between the state trajectory of the system and unsafe states. We proceed to formulate this collision probability as the viscosity solution to a second-order variational-inequality and provide a rigorous proof for such a novel interpretation. Moreover, we discuss the ENO-Godunov scheme for solving the deduced variational-inequality, which obviates the need for Monte-Carlo simulations and the optimality condition along a complex boundary. The developed framework offers a structured approach to identify potential risks in safety critical systems and maintains a user-friendly implementation. Lastly, we demonstrate the above application in a safety verification problem related to maritime navigation.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"196 ","pages":"Article 106014"},"PeriodicalIF":2.1,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143182972","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On computation of approximate solutions to large-scale backstepping kernel equations via continuum approximation
IF 2.1 3区 计算机科学 Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-02-01 DOI: 10.1016/j.sysconle.2024.105982
Jukka-Pekka Humaloja, Nikolaos Bekiaris-Liberis
We provide two methods for computation of continuum backstepping kernels that arise in control of continua (ensembles) of linear hyperbolic PDEs and which can approximate backstepping kernels arising in control of a large-scale, PDE system counterpart (with computational complexity that does not grow with the number of state components of the large-scale system). In the first method, we provide explicit formulae for the solution to the continuum kernels PDEs, employing a (triple) power series representation of the continuum kernel and establishing its convergence properties. In this case, we also provide means for reducing computational complexity by properly truncating the power series (in the powers of the ensemble variable). In the second method, we identify a class of systems for which the solution to the continuum (and hence, also an approximate solution to the respective large-scale) kernel equations can be constructed in closed form. We also present numerical examples to illustrate computational efficiency/accuracy of the approaches, as well as to validate the stabilization properties of the approximate control kernels, constructed based on the continuum.
{"title":"On computation of approximate solutions to large-scale backstepping kernel equations via continuum approximation","authors":"Jukka-Pekka Humaloja,&nbsp;Nikolaos Bekiaris-Liberis","doi":"10.1016/j.sysconle.2024.105982","DOIUrl":"10.1016/j.sysconle.2024.105982","url":null,"abstract":"<div><div>We provide two methods for computation of continuum backstepping kernels that arise in control of continua (ensembles) of linear hyperbolic PDEs and which can approximate backstepping kernels arising in control of a large-scale, PDE system counterpart (with computational complexity that does not grow with the number of state components of the large-scale system). In the first method, we provide explicit formulae for the solution to the continuum kernels PDEs, employing a (triple) power series representation of the continuum kernel and establishing its convergence properties. In this case, we also provide means for reducing computational complexity by properly truncating the power series (in the powers of the ensemble variable). In the second method, we identify a class of systems for which the solution to the continuum (and hence, also an approximate solution to the respective large-scale) kernel equations can be constructed in closed form. We also present numerical examples to illustrate computational efficiency/accuracy of the approaches, as well as to validate the stabilization properties of the approximate control kernels, constructed based on the continuum.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"196 ","pages":"Article 105982"},"PeriodicalIF":2.1,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143182995","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exponential stabilization of linear systems using nearest-action control with countable input set
IF 2.1 3区 计算机科学 Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-02-01 DOI: 10.1016/j.sysconle.2024.105992
Muhammad Zaki Almuzakki , Bayu Jayawardhana , Aneel Tanwani , Antonis I. Vakis
This paper studies stabilization of linear time-invariant (LTI) systems when control actions can only be realized in finitely many directions where it is possible to actuate uniformly or logarithmically extended positive scaling factors in each direction. Furthermore, a nearest-action selection approach is used to map the continuous measurements to a realizable action where we show that the approach satisfies a weak sector condition for multiple-input multiple-output (MIMO) systems. Using the notion of input-to-state stability, under some assumptions imposed on the transfer function of the system, we show that the closed-loop system converges to the target ball exponentially fast. Moreover, when logarithmic extension for the scaling factors is realizable, the closed-loop system is able to achieve asymptotic stability instead of only practical stability. Finally, we present an example of the application that confirms our analysis.
{"title":"Exponential stabilization of linear systems using nearest-action control with countable input set","authors":"Muhammad Zaki Almuzakki ,&nbsp;Bayu Jayawardhana ,&nbsp;Aneel Tanwani ,&nbsp;Antonis I. Vakis","doi":"10.1016/j.sysconle.2024.105992","DOIUrl":"10.1016/j.sysconle.2024.105992","url":null,"abstract":"<div><div>This paper studies stabilization of linear time-invariant (LTI) systems when control actions can only be realized in <em>finitely</em> many directions where it is possible to actuate uniformly or logarithmically extended positive scaling factors in each direction. Furthermore, a nearest-action selection approach is used to map the continuous measurements to a realizable action where we show that the approach satisfies a <em>weak</em> sector condition for multiple-input multiple-output (MIMO) systems. Using the notion of input-to-state stability, under some assumptions imposed on the transfer function of the system, we show that the closed-loop system converges to the target ball exponentially fast. Moreover, when logarithmic extension for the scaling factors is realizable, the closed-loop system is able to achieve asymptotic stability instead of only practical stability. Finally, we present an example of the application that confirms our analysis.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"196 ","pages":"Article 105992"},"PeriodicalIF":2.1,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143182999","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Impulsive and impulse-free PD solutions of singular LQ control 奇异 LQ 控制的脉冲和无脉冲 PD 解
IF 2.1 3区 计算机科学 Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-02-01 DOI: 10.1016/j.sysconle.2025.106024
Jovan Stefanovski
This paper addresses the singular linear–quadratic (LQ) control problem, considering cases with or without impulses in the state, and with or without stability. The optimal controller obtained includes a derivative of the state. The assumptions made are system stabilizability and the left-invertibility of the plant transfer matrix. Necessary and sufficient conditions for stability and the impulse-freeness of the optimal state are provided. These conditions are related to the absence of invariant zeros on the imaginary axis, and at infinity with orders greater than one, as well as to strong detectability. When these conditions are not met, the subspace ensuring that the optimal state is impulse-free, if the initial state belongs to that subspace, is determined. Additionally, a suboptimal yet practically realizable controller is presented, along with an explicit expression for the difference between the cost functional values corresponding to the suboptimal and optimal controllers. Illustrative examples are included.
{"title":"Impulsive and impulse-free PD solutions of singular LQ control","authors":"Jovan Stefanovski","doi":"10.1016/j.sysconle.2025.106024","DOIUrl":"10.1016/j.sysconle.2025.106024","url":null,"abstract":"<div><div>This paper addresses the singular linear–quadratic (LQ) control problem, considering cases with or without impulses in the state, and with or without stability. The optimal controller obtained includes a derivative of the state. The assumptions made are system stabilizability and the left-invertibility of the plant transfer matrix. Necessary and sufficient conditions for stability and the impulse-freeness of the optimal state are provided. These conditions are related to the absence of invariant zeros on the imaginary axis, and at infinity with orders greater than one, as well as to strong<span><math><msup><mrow></mrow><mrow><mo>∗</mo></mrow></msup></math></span> detectability. When these conditions are not met, the subspace ensuring that the optimal state is impulse-free, if the initial state belongs to that subspace, is determined. Additionally, a suboptimal yet practically realizable controller is presented, along with an explicit expression for the difference between the cost functional values corresponding to the suboptimal and optimal controllers. Illustrative examples are included.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"196 ","pages":"Article 106024"},"PeriodicalIF":2.1,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143182440","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Detectability of linear stochastic impulsive systems with state-dependent noises
IF 2.1 3区 计算机科学 Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-02-01 DOI: 10.1016/j.sysconle.2024.105989
Shixian Luo , Xin Chen , Feiqi Deng , Yan Jiang
This paper focuses on the characterization of moment detectability and almost sure detectability for linear stochastic impulsive systems. The concepts and characterizations of the 2pth moment detectability and almost sure detectability are first introduced. Two expanded systems, the state-expanded stochastic system and the moment equation, are established by utilizing the generalized H-representation technique. A series of geometric and algebraic conditions for the 2pth moment detectability of the linear stochastic impulsive systems are established by analyzing the 2nd moment detectability of the state-expanded system and the complete detectability of the moment equation. Subsequently, by introducing a strictly positive-definite quasi-periodic composite polynomial Lyapunov candidate, almost sure detectability criteria are framed in terms of linear matrix inequalities, showing that almost sure detectability is less conservative than moment detectability. Finally, two numerical examples with comparisons are provided to illustrate the proposed theoretical results.
本文主要研究线性随机脉冲系统的矩可探测性和几乎确定可探测性的特征。首先介绍了第 2 次矩可探测性和几乎确定可探测性的概念和特征。利用广义 H 表示技术建立了两个扩展系统,即状态扩展随机系统和矩方程。通过分析状态扩展系统的第 2 矩可探测性和矩方程的完全可探测性,为线性随机脉冲系统的第 2pth 矩可探测性建立了一系列几何和代数条件。随后,通过引入严格正有限准周期复合多项式 Lyapunov 候选方程,用线性矩阵不等式框定了几乎确定的可探测性准则,表明几乎确定的可探测性不如矩可探测性保守。最后,提供了两个数值示例并进行了比较,以说明所提出的理论结果。
{"title":"Detectability of linear stochastic impulsive systems with state-dependent noises","authors":"Shixian Luo ,&nbsp;Xin Chen ,&nbsp;Feiqi Deng ,&nbsp;Yan Jiang","doi":"10.1016/j.sysconle.2024.105989","DOIUrl":"10.1016/j.sysconle.2024.105989","url":null,"abstract":"<div><div>This paper focuses on the characterization of moment detectability and almost sure detectability for linear stochastic impulsive systems. The concepts and characterizations of the <span><math><mrow><mn>2</mn><mi>p</mi></mrow></math></span>th moment detectability and almost sure detectability are first introduced. Two expanded systems, the state-expanded stochastic system and the moment equation, are established by utilizing the generalized <span><math><mi>H</mi></math></span>-representation technique. A series of geometric and algebraic conditions for the <span><math><mrow><mn>2</mn><mi>p</mi></mrow></math></span>th moment detectability of the linear stochastic impulsive systems are established by analyzing the 2nd moment detectability of the state-expanded system and the complete detectability of the moment equation. Subsequently, by introducing a strictly positive-definite quasi-periodic composite polynomial Lyapunov candidate, almost sure detectability criteria are framed in terms of linear matrix inequalities, showing that almost sure detectability is less conservative than moment detectability. Finally, two numerical examples with comparisons are provided to illustrate the proposed theoretical results.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"196 ","pages":"Article 105989"},"PeriodicalIF":2.1,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143183644","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The minimal hitting probability of continuous-time controlled Markov systems with countable states 状态可数的连续时间受控马尔可夫系统的最小命中概率
IF 2.1 3区 计算机科学 Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-02-01 DOI: 10.1016/j.sysconle.2024.106002
Yanyun Li , Junping Li
This paper concentrates on the minimal hitting probability of continuous-time controlled Markov systems (CTCMSs) with countable state and finite admissible action spaces. The existence of an optimal policy is first proved. In particular, for a special and important case of controlled branching processes (CBPs), it is proved that the minimal hitting probability is the unique solution to an improved optimal system of equations. Furthermore, a novel and precise improved-policy iteration algorithm of an optimal policy and the minimal hitting probability (minimal extinction probability) is presented for CBPs.
{"title":"The minimal hitting probability of continuous-time controlled Markov systems with countable states","authors":"Yanyun Li ,&nbsp;Junping Li","doi":"10.1016/j.sysconle.2024.106002","DOIUrl":"10.1016/j.sysconle.2024.106002","url":null,"abstract":"<div><div>This paper concentrates on the minimal hitting probability of continuous-time controlled Markov systems (CTCMSs) with countable state and finite admissible action spaces. The existence of an optimal policy is first proved. In particular, for a special and important case of controlled branching processes (CBPs), it is proved that the minimal hitting probability is the unique solution to an improved optimal system of equations. Furthermore, a novel and precise improved-policy iteration algorithm of an optimal policy and the minimal hitting probability (minimal extinction probability) is presented for CBPs.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"196 ","pages":"Article 106002"},"PeriodicalIF":2.1,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143182987","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The delay feedback control for the McKean–Vlasov stochastic differential equations with common noise
IF 2.1 3区 计算机科学 Q3 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-02-01 DOI: 10.1016/j.sysconle.2024.105993
Xing Chen , Xiaoyue Li , Chenggui Yuan
Since response lags are essential in the feedback loops and are required by most physical systems, it is more appropriate to stabilize McKean–Vlasov stochastic differential equations (MV-SDEs) with common noise through the implementation of delay feedback control mechanisms. The aim of this paper is to design delay feedback control functions such that the controlled system is bounded in infinite horizon and further exponentially stable in the mean square. The designed controller, which depends only on the system state is easier to implement than that in Wu et al. (2022) which was designed to depend on both system state and measure. The existence and uniqueness of the global solution of the controlled system is proved. The Itô formula in both state and measure is derived. The proposed delay feedback control strategies are rendered viable for effective stabilization of MV-SDEs with common noise. Furthermore, the moment Lyapunov exponent, which is intricately linked to the time delays, is meticulously estimated.
由于响应滞后在反馈回路中至关重要,而且大多数物理系统都需要响应滞后,因此通过实施延迟反馈控制机制来稳定具有普通噪声的麦金-弗拉索夫随机微分方程(MV-SDE)更为合适。本文的目的是设计延迟反馈控制函数,使被控系统在无限视界内是有界的,并进一步在均方上呈指数稳定。所设计的控制器只取决于系统状态,比 Wu 等人(2022 年)设计的同时取决于系统状态和测量值的控制器更容易实现。证明了受控系统全局解的存在性和唯一性。推导出了状态和度量的 Itô 公式。所提出的延迟反馈控制策略对于具有普通噪声的 MV-SDEs 的有效稳定是可行的。此外,还细致地估算了与时间延迟密切相关的矩 Lyapunov 指数。
{"title":"The delay feedback control for the McKean–Vlasov stochastic differential equations with common noise","authors":"Xing Chen ,&nbsp;Xiaoyue Li ,&nbsp;Chenggui Yuan","doi":"10.1016/j.sysconle.2024.105993","DOIUrl":"10.1016/j.sysconle.2024.105993","url":null,"abstract":"<div><div>Since response lags are essential in the feedback loops and are required by most physical systems, it is more appropriate to stabilize McKean–Vlasov stochastic differential equations (MV-SDEs) with common noise through the implementation of delay feedback control mechanisms. The aim of this paper is to design delay feedback control functions such that the controlled system is bounded in infinite horizon and further exponentially stable in the mean square. The designed controller, which depends only on the system state is easier to implement than that in Wu et al. (2022) which was designed to depend on both system state and measure. The existence and uniqueness of the global solution of the controlled system is proved. The Itô formula in both state and measure is derived. The proposed delay feedback control strategies are rendered viable for effective stabilization of MV-SDEs with common noise. Furthermore, the moment Lyapunov exponent, which is intricately linked to the time delays, is meticulously estimated.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"196 ","pages":"Article 105993"},"PeriodicalIF":2.1,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143183242","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Systems & Control Letters
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1