首页 > 最新文献

SIAM Journal on Control and Optimization最新文献

英文 中文
Stochastic Fixed-Point Iterations for Nonexpansive Maps: Convergence and Error Bounds 非扩展映射的随机定点迭代:收敛性与误差边界
IF 2.2 2区 数学 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-01-18 DOI: 10.1137/22m1515550
Mario Bravo, Roberto Cominetti
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 191-219, February 2024.
Abstract. We study a stochastically perturbed version of the well-known Krasnoselskii–Mann iteration for computing fixed points of nonexpansive maps in finite dimensional normed spaces. We discuss sufficient conditions on the stochastic noise and stepsizes that guarantee almost sure convergence of the iterates towards a fixed point and derive nonasymptotic error bounds and convergence rates for the fixed-point residuals. Our main results concern the case of a martingale difference noise with variances that can possibly grow unbounded. This supports an application to reinforcement learning for average reward Markov decision processes, for which we establish convergence and asymptotic rates. We also analyze in depth the case where the noise has uniformly bounded variance, obtaining error bounds with explicit computable constants.
SIAM 控制与优化期刊》第 62 卷第 1 期第 191-219 页,2024 年 2 月。 摘要。我们研究了著名的 Krasnoselskii-Mann 迭代的随机扰动版本,用于计算有限维规范空间中的无穷映射的定点。我们讨论了随机噪声和步长的充分条件,这些条件保证了迭代几乎肯定收敛于定点,并推导出了非渐近误差边界和定点残差的收敛率。我们的主要结果涉及方差可能无限制增长的鞅差分噪声。这支持了平均报酬马尔可夫决策过程的强化学习应用,我们为其建立了收敛性和渐近率。我们还深入分析了噪声方差均匀有界的情况,获得了具有明确可计算常数的误差边界。
{"title":"Stochastic Fixed-Point Iterations for Nonexpansive Maps: Convergence and Error Bounds","authors":"Mario Bravo, Roberto Cominetti","doi":"10.1137/22m1515550","DOIUrl":"https://doi.org/10.1137/22m1515550","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 191-219, February 2024. <br/> Abstract. We study a stochastically perturbed version of the well-known Krasnoselskii–Mann iteration for computing fixed points of nonexpansive maps in finite dimensional normed spaces. We discuss sufficient conditions on the stochastic noise and stepsizes that guarantee almost sure convergence of the iterates towards a fixed point and derive nonasymptotic error bounds and convergence rates for the fixed-point residuals. Our main results concern the case of a martingale difference noise with variances that can possibly grow unbounded. This supports an application to reinforcement learning for average reward Markov decision processes, for which we establish convergence and asymptotic rates. We also analyze in depth the case where the noise has uniformly bounded variance, obtaining error bounds with explicit computable constants.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"22 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139500222","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Optimal Scheduling of Entropy Regularizer for Continuous-Time Linear-Quadratic Reinforcement Learning 连续时间线性-二次强化学习的熵正则优化调度
IF 2.2 2区 数学 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-01-17 DOI: 10.1137/22m1515744
Lukasz Szpruch, Tanut Treetanthiploet, Yufei Zhang
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 135-166, February 2024.
Abstract. This work uses the entropy-regularized relaxed stochastic control perspective as a principled framework for designing reinforcement learning (RL) algorithms. Herein, an agent interacts with the environment by generating noisy controls distributed according to the optimal relaxed policy. The noisy policies, on the one hand, explore the space and hence facilitate learning, but, on the other hand, they introduce bias by assigning a positive probability to nonoptimal actions. This exploration-exploitation trade-off is determined by the strength of entropy regularization. We study algorithms resulting from two entropy regularization formulations: the exploratory control approach, where entropy is added to the cost objective, and the proximal policy update approach, where entropy penalizes policy divergence between consecutive episodes. We focus on the finite horizon continuous-time linear-quadratic (LQ) RL problem, where a linear dynamics with unknown drift coefficients is controlled subject to quadratic costs. In this setting, both algorithms yield a Gaussian relaxed policy. We quantify the precise difference between the value functions of a Gaussian policy and its noisy evaluation and show that the execution noise must be independent across time. By tuning the frequency of sampling from relaxed policies and the parameter governing the strength of entropy regularization, we prove that the regret, for both learning algorithms, is of the order [math] (up to a logarithmic factor) over [math] episodes, matching the best known result from the literature.
SIAM 控制与优化期刊》第 62 卷第 1 期第 135-166 页,2024 年 2 月。 摘要本研究从熵规则化松弛随机控制的角度出发,为设计强化学习(RL)算法提供了一个原则性框架。在这里,代理通过根据最优松弛策略生成分布式噪声控制来与环境交互。一方面,噪声策略可以探索空间,从而促进学习,但另一方面,噪声策略会给非最佳行动分配正概率,从而引入偏差。这种探索与利用之间的权衡取决于熵正则化的强度。我们研究了两种熵正则化公式所产生的算法:探索控制法和近似策略更新法,前者将熵添加到成本目标中,后者则对连续事件之间的策略偏差进行惩罚。我们将重点放在有限视界连续时间线性-二次方(LQ)RL 问题上,在该问题中,具有未知漂移系数的线性动力学受到二次方成本的控制。在这种情况下,两种算法都能得到高斯松弛策略。我们量化了高斯策略的值函数与其噪声评估之间的精确差异,并证明了执行噪声必须是跨时间独立的。通过调整从松弛策略中采样的频率和管理熵正则化强度的参数,我们证明了这两种学习算法在[math]事件上的遗憾都是[math]数量级(达到对数因子),与文献中已知的最佳结果相吻合。
{"title":"Optimal Scheduling of Entropy Regularizer for Continuous-Time Linear-Quadratic Reinforcement Learning","authors":"Lukasz Szpruch, Tanut Treetanthiploet, Yufei Zhang","doi":"10.1137/22m1515744","DOIUrl":"https://doi.org/10.1137/22m1515744","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 135-166, February 2024. <br/> Abstract. This work uses the entropy-regularized relaxed stochastic control perspective as a principled framework for designing reinforcement learning (RL) algorithms. Herein, an agent interacts with the environment by generating noisy controls distributed according to the optimal relaxed policy. The noisy policies, on the one hand, explore the space and hence facilitate learning, but, on the other hand, they introduce bias by assigning a positive probability to nonoptimal actions. This exploration-exploitation trade-off is determined by the strength of entropy regularization. We study algorithms resulting from two entropy regularization formulations: the exploratory control approach, where entropy is added to the cost objective, and the proximal policy update approach, where entropy penalizes policy divergence between consecutive episodes. We focus on the finite horizon continuous-time linear-quadratic (LQ) RL problem, where a linear dynamics with unknown drift coefficients is controlled subject to quadratic costs. In this setting, both algorithms yield a Gaussian relaxed policy. We quantify the precise difference between the value functions of a Gaussian policy and its noisy evaluation and show that the execution noise must be independent across time. By tuning the frequency of sampling from relaxed policies and the parameter governing the strength of entropy regularization, we prove that the regret, for both learning algorithms, is of the order [math] (up to a logarithmic factor) over [math] episodes, matching the best known result from the literature.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"75 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-01-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139500602","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
State Estimation with Event Sensors: Observability Analysis and Multi-sensor Fusion 使用事件传感器进行状态估计:可观测性分析与多传感器融合
IF 2.2 2区 数学 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-01-17 DOI: 10.1137/22m1539204
Xinhui Liu, Kaikai Zheng, Dawei Shi, Tongwen Chen
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 167-190, February 2024.
Abstract. This work investigates a state estimation problem for linear time-invariant systems based on polarized measurement information from event sensors. To enable estimator design, a new notion of observability, namely, [math]-observability is defined with the precision parameter [math] which relates to the worst-case performance of inferring the initial state, based on which a criterion is developed to test the [math]-observability of discrete-time linear systems. Utilizing multisensor polarity data from event sensors and the implicit information hidden in event-triggering conditions at no-event instants, an iterative event-triggered state estimator is designed to evaluate a set containing all possible values of the state. The proposed estimator is built by outer approximation of intersecting ellipsoids that are predicted from previous state estimates and the ellipsoids inferred from received polarity information of event sensors as well as the event-triggering protocol; the estimated regions of the state derived from multisensor event measurements are fused together, the sizes of which are proved to be asymptotically bounded. Distributed implementation of the estimation algorithm utilizing a two-layer processor network of hierarchy architecture is discussed, and the temporal computational complexity of the algorithm implemented in centralized and distributed ways is analyzed. The efficiency of the proposed event-triggered state estimator is verified by numerical experiments.
SIAM 控制与优化期刊》第 62 卷第 1 期第 167-190 页,2024 年 2 月。 摘要本文研究了基于事件传感器极化测量信息的线性时不变系统的状态估计问题。为了能够设计估计器,本文定义了一个新的可观测性概念,即[math]-可观测性,其精度参数[math]与推断初始状态的最坏情况性能有关,并在此基础上制定了一个标准来测试离散时间线性系统的[math]-可观测性。利用来自事件传感器的多传感器极性数据和隐藏在无事件时刻事件触发条件中的隐含信息,设计了一种迭代事件触发状态估计器,以评估包含所有可能状态值的集合。所提出的估计器是通过对相交椭圆的外近似来建立的,这些椭圆是根据先前的状态估计和从接收到的事件传感器极性信息以及事件触发协议中推断出的椭圆来预测的;从多传感器事件测量中得出的状态估计区域被融合在一起,其大小被证明是渐进有界的。讨论了利用分层结构的双层处理器网络对估计算法进行分布式实施的问题,并分析了以集中和分布式方式实施的算法的时间计算复杂性。通过数值实验验证了所提出的事件触发状态估计器的效率。
{"title":"State Estimation with Event Sensors: Observability Analysis and Multi-sensor Fusion","authors":"Xinhui Liu, Kaikai Zheng, Dawei Shi, Tongwen Chen","doi":"10.1137/22m1539204","DOIUrl":"https://doi.org/10.1137/22m1539204","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 167-190, February 2024. <br/> Abstract. This work investigates a state estimation problem for linear time-invariant systems based on polarized measurement information from event sensors. To enable estimator design, a new notion of observability, namely, [math]-observability is defined with the precision parameter [math] which relates to the worst-case performance of inferring the initial state, based on which a criterion is developed to test the [math]-observability of discrete-time linear systems. Utilizing multisensor polarity data from event sensors and the implicit information hidden in event-triggering conditions at no-event instants, an iterative event-triggered state estimator is designed to evaluate a set containing all possible values of the state. The proposed estimator is built by outer approximation of intersecting ellipsoids that are predicted from previous state estimates and the ellipsoids inferred from received polarity information of event sensors as well as the event-triggering protocol; the estimated regions of the state derived from multisensor event measurements are fused together, the sizes of which are proved to be asymptotically bounded. Distributed implementation of the estimation algorithm utilizing a two-layer processor network of hierarchy architecture is discussed, and the temporal computational complexity of the algorithm implemented in centralized and distributed ways is analyzed. The efficiency of the proposed event-triggered state estimator is verified by numerical experiments.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"1 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-01-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139500269","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Maximality Principle in Singular Control with Absorption and Its Applications to the Dividend Problem 带吸收的奇异控制中的最大化原理及其在红利问题中的应用
IF 2.2 2区 数学 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-01-12 DOI: 10.1137/22m152791x
Tiziano De Angelis, Erik Ekström, Marcus Olofsson
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 91-117, February 2024.
Abstract. Motivated by a new formulation of the classical dividend problem, we show that Peskir’s maximality principle can be transferred to singular stochastic control problems with two-dimensional degenerate dynamics and absorption along the diagonal of the state space. We construct an optimal control as a Skorokhod reflection along a moving barrier, where the barrier can be computed analytically as the smallest solution to a certain nonlinear ODE. Contrarily to the classical one-dimensional formulation of the dividend problem, our framework produces a nontrivial solution when the firm’s (predividend) equity capital evolves as a geometric Brownian motion. Such a solution is also qualitatively different from the one traditionally obtained for the arithmetic Brownian motion.
SIAM 控制与优化期刊》第 62 卷第 1 期第 91-117 页,2024 年 2 月。 摘要。受经典红利问题新表述的启发,我们证明了 Peskir 最大化原理可以转移到具有二维退化动力学和沿状态空间对角线吸收的奇异随机控制问题上。我们将最优控制构造为沿移动障碍的 Skorokhod 反射,其中障碍可作为特定非线性 ODE 的最小解进行分析计算。与股息问题的经典一维表述不同,当公司的(股息前)股权资本以几何布朗运动的形式演变时,我们的框架会产生一个非难解。这种解与传统的算术布朗运动解也有本质区别。
{"title":"The Maximality Principle in Singular Control with Absorption and Its Applications to the Dividend Problem","authors":"Tiziano De Angelis, Erik Ekström, Marcus Olofsson","doi":"10.1137/22m152791x","DOIUrl":"https://doi.org/10.1137/22m152791x","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 91-117, February 2024. <br/> Abstract. Motivated by a new formulation of the classical dividend problem, we show that Peskir’s maximality principle can be transferred to singular stochastic control problems with two-dimensional degenerate dynamics and absorption along the diagonal of the state space. We construct an optimal control as a Skorokhod reflection along a moving barrier, where the barrier can be computed analytically as the smallest solution to a certain nonlinear ODE. Contrarily to the classical one-dimensional formulation of the dividend problem, our framework produces a nontrivial solution when the firm’s (predividend) equity capital evolves as a geometric Brownian motion. Such a solution is also qualitatively different from the one traditionally obtained for the arithmetic Brownian motion.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"30 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139463875","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On Converse Lyapunov Theorem for Fixed-Time Input-to-State Stability 论固定时间输入到状态稳定性的逆 Lyapunov 定理
IF 2.2 2区 数学 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-01-12 DOI: 10.1137/22m1497596
Denis Efimov, Andrey Polyakov
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 118-134, February 2024.
Abstract. Input-to-state stability is one of the most utilizable robust stability properties for nonlinear dynamical systems, while (nearly) fixed-time convergence is a kind of decay for trajectories of disturbance-free systems that is independent in initial conditions. The presence of both these features for a system can be checked by the existence of a proper Lyapunov function. The objective of this work is to provide the conditions for a converse result that (nearly) fixed-time input-to-state stable systems admit a respective Lyapunov function. Similar auxiliary results for uniform finite-time stability and uniform (nearly) fixed-time stability are obtained.
SIAM 控制与优化期刊》第 62 卷第 1 期第 118-134 页,2024 年 2 月。 摘要输入到状态稳定性是非线性动力系统最常用的鲁棒稳定性特性之一,而(近似)固定时间收敛是无扰动系统轨迹的一种衰减,与初始条件无关。系统是否具有这两个特性,可以通过是否存在适当的 Lyapunov 函数来检验。这项工作的目的是为反向结果提供条件,即(近)固定时间输入到状态稳定系统承认各自的 Lyapunov 函数。我们还得到了均匀有限时间稳定性和均匀(近)固定时间稳定性的类似辅助结果。
{"title":"On Converse Lyapunov Theorem for Fixed-Time Input-to-State Stability","authors":"Denis Efimov, Andrey Polyakov","doi":"10.1137/22m1497596","DOIUrl":"https://doi.org/10.1137/22m1497596","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 118-134, February 2024. <br/> Abstract. Input-to-state stability is one of the most utilizable robust stability properties for nonlinear dynamical systems, while (nearly) fixed-time convergence is a kind of decay for trajectories of disturbance-free systems that is independent in initial conditions. The presence of both these features for a system can be checked by the existence of a proper Lyapunov function. The objective of this work is to provide the conditions for a converse result that (nearly) fixed-time input-to-state stable systems admit a respective Lyapunov function. Similar auxiliary results for uniform finite-time stability and uniform (nearly) fixed-time stability are obtained.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"8 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139464096","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Extreme Occupation Measures in Markov Decision Processes with an Absorbing State 具有吸收状态的马尔可夫决策过程中的极值占用措施
IF 2.2 2区 数学 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-01-12 DOI: 10.1137/23m1572398
Alexey Piunovskiy, Yi Zhang
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 65-90, February 2024.
Abstract. In this paper, we consider a Markov decision process (MDP) with a Borel state space [math], where [math] is an absorbing state (cemetery), and a Borel action space [math]. We consider the space of finite occupation measures restricted on [math] and the extreme points in it. It is possible that some strategies have infinite occupation measures. Nevertheless, we prove that every finite extreme occupation measure is generated by a deterministic stationary strategy. Then, for this MDP, we consider a constrained problem with total undiscounted criteria and [math] constraints, where the cost functions are nonnegative. By assumption, the strategies inducing infinite occupation measures are not optimal. Then our second main result is that, under mild conditions, the solution to this constrained MDP is given by a mixture of no more than [math] occupation measures generated by deterministic stationary strategies.
SIAM 控制与优化期刊》第 62 卷第 1 期第 65-90 页,2024 年 2 月。 摘要本文考虑一个马尔可夫决策过程(MDP),它有一个伯尔状态空间 [math](其中 [math] 是一个吸收状态(墓地))和一个伯尔行动空间 [math]。我们考虑限制在 [math] 上的有限占优度量空间及其中的极值点。有些策略可能有无限占据度量。尽管如此,我们还是要证明,每一个有限极值占据度量都是由确定性静态策略生成的。然后,对于这个 MDP,我们考虑一个具有总未折现标准和 [math] 约束的约束问题,其中成本函数为非负。根据假设,诱导无限占用度量的策略不是最优的。我们的第二个主要结果是,在温和的条件下,这个受限 MDP 的解是由确定性静态策略产生的不超过 [math] 的占用度量的混合物给出的。
{"title":"Extreme Occupation Measures in Markov Decision Processes with an Absorbing State","authors":"Alexey Piunovskiy, Yi Zhang","doi":"10.1137/23m1572398","DOIUrl":"https://doi.org/10.1137/23m1572398","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 65-90, February 2024. <br/> Abstract. In this paper, we consider a Markov decision process (MDP) with a Borel state space [math], where [math] is an absorbing state (cemetery), and a Borel action space [math]. We consider the space of finite occupation measures restricted on [math] and the extreme points in it. It is possible that some strategies have infinite occupation measures. Nevertheless, we prove that every finite extreme occupation measure is generated by a deterministic stationary strategy. Then, for this MDP, we consider a constrained problem with total undiscounted criteria and [math] constraints, where the cost functions are nonnegative. By assumption, the strategies inducing infinite occupation measures are not optimal. Then our second main result is that, under mild conditions, the solution to this constrained MDP is given by a mixture of no more than [math] occupation measures generated by deterministic stationary strategies.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"8 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139463902","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An Irreducible Linear Switching System Whose Unique Barabanov Norm Is Not Strictly Convex 其唯一巴拉巴诺夫规范并非严格凸形的不可还原线性开关系统
IF 2.2 2区 数学 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-01-10 DOI: 10.1137/23m1551213
Ian D. Morris
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 42-64, February 2024.
Abstract. We construct a marginally stable linear switching system in continuous time, in four dimensions, and with three switching states, which is exponentially stable with respect to constant switching laws and which has a unique Barabanov norm, but such that the Barabanov norm fails to be strictly convex. This resolves a question of Chitour, Gaye, and Mason.
SIAM 控制与优化期刊》第 62 卷第 1 期第 42-64 页,2024 年 2 月。 摘要我们构造了一个连续时间、四维、有三个切换状态的边际稳定线性切换系统,该系统相对于恒定切换定律是指数稳定的,且具有唯一的巴拉巴诺夫规范,但巴拉巴诺夫规范不是严格凸的。这解决了奇图尔、盖伊和梅森的一个问题。
{"title":"An Irreducible Linear Switching System Whose Unique Barabanov Norm Is Not Strictly Convex","authors":"Ian D. Morris","doi":"10.1137/23m1551213","DOIUrl":"https://doi.org/10.1137/23m1551213","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 42-64, February 2024. <br/> Abstract. We construct a marginally stable linear switching system in continuous time, in four dimensions, and with three switching states, which is exponentially stable with respect to constant switching laws and which has a unique Barabanov norm, but such that the Barabanov norm fails to be strictly convex. This resolves a question of Chitour, Gaye, and Mason.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"1 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-01-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139415611","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Relaxed Excitation Conditions for Robust Identification and Adaptive Control Using Estimation with Memory 利用带记忆的估计实现鲁棒性识别和自适应控制的宽松激励条件
IF 2.2 2区 数学 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-01-03 DOI: 10.1137/22m1506183
Javier Gallegos, Norelys Aguila-Camacho
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 1-21, February 2024.
Abstract. In this paper, adaptive controllers are designed to track a given trajectory for linear and nonlinear systems. No condition on the tracked trajectory, other than continuity and boundedness, is needed to simultaneously ensure exponential convergence to the tracking reference, exponential convergence to the identification of the plant, and robustness to nonparametric uncertainties. To achieve this, the formulation of the excitation condition associated with the identification part of the adaptive scheme is proposed without employing closed-loop signals, allowing the use of a transient enrichment of the reference. The effect of this transient modification is attenuated by using relaxed requirements for the identification, obtained through a generalization of several estimation algorithms found in recent literature that use memory mechanisms. Consequently, no spectral content of the tracked trajectory—a classic requirement in adaptive theory—is needed to guarantee the mentioned features when the proposed scheme is used. A numerical example is given to illustrate the design aspects involved and the distinctive features of the proposed strategy.
SIAM 控制与优化期刊》第 62 卷第 1 期第 1-21 页,2024 年 2 月。 摘要本文设计了自适应控制器来跟踪线性和非线性系统的给定轨迹。除了连续性和有界性之外,跟踪轨迹不需要其他条件,就能同时确保指数收敛到跟踪参考、指数收敛到工厂识别以及对非参数不确定性的鲁棒性。为实现这一目标,我们提出了与自适应方案识别部分相关的激励条件,而不采用闭环信号,从而允许使用参考的瞬态增益。通过对近期文献中发现的几种使用记忆机制的估算算法进行概括,使用宽松的识别要求减弱了这种瞬态修改的影响。因此,在使用所提出的方案时,不需要跟踪轨迹的频谱内容--自适应理论中的经典要求--来保证上述特征。本文给出了一个数值示例,以说明所涉及的设计问题以及所提策略的显著特点。
{"title":"Relaxed Excitation Conditions for Robust Identification and Adaptive Control Using Estimation with Memory","authors":"Javier Gallegos, Norelys Aguila-Camacho","doi":"10.1137/22m1506183","DOIUrl":"https://doi.org/10.1137/22m1506183","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 1-21, February 2024. <br/> Abstract. In this paper, adaptive controllers are designed to track a given trajectory for linear and nonlinear systems. No condition on the tracked trajectory, other than continuity and boundedness, is needed to simultaneously ensure exponential convergence to the tracking reference, exponential convergence to the identification of the plant, and robustness to nonparametric uncertainties. To achieve this, the formulation of the excitation condition associated with the identification part of the adaptive scheme is proposed without employing closed-loop signals, allowing the use of a transient enrichment of the reference. The effect of this transient modification is attenuated by using relaxed requirements for the identification, obtained through a generalization of several estimation algorithms found in recent literature that use memory mechanisms. Consequently, no spectral content of the tracked trajectory—a classic requirement in adaptive theory—is needed to guarantee the mentioned features when the proposed scheme is used. A numerical example is given to illustrate the design aspects involved and the distinctive features of the proposed strategy.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"6 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139093039","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On BIBO Stability of Infinite-Dimensional Linear State-Space Systems 论无穷维线性状态空间系统的 BIBO 稳定性
IF 2.2 2区 数学 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-01-03 DOI: 10.1137/23m1563098
Felix L. Schwenninger, Alexander A. Wierzba, Hans Zwart
SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 22-41, February 2024.
Abstract. In this paper we consider bounded-input-bounded-output (BIBO) stability of systems described by infinite-dimensional linear state-space representations, filling the so far unattended gap of a formal definition and characterization of BIBO stability in this general case. Furthermore, we provide several sufficient conditions guaranteeing BIBO stability of a particular system and discuss to which extent this property is preserved under additive and multiplicative perturbations of the system.
SIAM 控制与优化期刊》第 62 卷第 1 期第 22-41 页,2024 年 2 月。 摘要本文考虑了由无限维线性状态空间表示法描述的系统的有界输入-有界输出(BIBO)稳定性,填补了迄今为止在这种一般情况下 BIBO 稳定性的正式定义和表征方面的空白。此外,我们还提供了几个保证特定系统 BIBO 稳定性的充分条件,并讨论了在系统的加法和乘法扰动下,这一特性在多大程度上得以保留。
{"title":"On BIBO Stability of Infinite-Dimensional Linear State-Space Systems","authors":"Felix L. Schwenninger, Alexander A. Wierzba, Hans Zwart","doi":"10.1137/23m1563098","DOIUrl":"https://doi.org/10.1137/23m1563098","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 1, Page 22-41, February 2024. <br/> Abstract. In this paper we consider bounded-input-bounded-output (BIBO) stability of systems described by infinite-dimensional linear state-space representations, filling the so far unattended gap of a formal definition and characterization of BIBO stability in this general case. Furthermore, we provide several sufficient conditions guaranteeing BIBO stability of a particular system and discuss to which extent this property is preserved under additive and multiplicative perturbations of the system.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"11 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139093097","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Partial Controllability of Linear Stochastic Control Systems with Terminal Constraints and Its Applications to Game-Based Control Systems with Jumps 带终点约束的线性随机控制系统的部分可控性及其在带跳跃的博弈控制系统中的应用
IF 2.2 2区 数学 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2023-12-07 DOI: 10.1137/22m1537114
Yuanzhuo Song
SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3635-3663, December 2023.
Abstract. In this paper, we consider the partial controllability of linear stochastic control systems with terminal constraints. Some necessary and sufficient conditions for this controllability are obtained with the help of backward stochastic differential equations (BSDEs). We establish the equivalence between the controllability of a game-based control system (GBCS), the controllability of a forward backward stochastic differential equation (FBSDE), and the partial controllability of a related stochastic differential equation (SDE) with terminal constraints. By applying our results, we obtain some necessary and sufficient conditions for the controllability of GBCSs with jumps. Then we embed the GBCSs driven only by Brownian motion and deterministic GBCSs into our framework with jumps. Previous results of Zhang and Guo are covered and extended.
SIAM 控制与优化期刊》,第 61 卷第 6 期,第 3635-3663 页,2023 年 12 月。 摘要本文考虑了带终端约束的线性随机控制系统的部分可控性。借助后向随机微分方程 (BSDE),我们得到了这种可控性的一些必要条件和充分条件。我们建立了基于博弈的控制系统(GBCS)的可控性、前向后向随机微分方程(FBSDE)的可控性和带终端约束的相关随机微分方程(SDE)的部分可控性之间的等价性。通过应用我们的结果,我们得到了带跳跃的 GBCS 可控性的一些必要条件和充分条件。然后,我们将仅由布朗运动驱动的 GBCS 和确定性 GBCS 嵌入到我们的带跳跃框架中。此外,我们还对张和郭之前的结果进行了覆盖和扩展。
{"title":"The Partial Controllability of Linear Stochastic Control Systems with Terminal Constraints and Its Applications to Game-Based Control Systems with Jumps","authors":"Yuanzhuo Song","doi":"10.1137/22m1537114","DOIUrl":"https://doi.org/10.1137/22m1537114","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 61, Issue 6, Page 3635-3663, December 2023. <br/> Abstract. In this paper, we consider the partial controllability of linear stochastic control systems with terminal constraints. Some necessary and sufficient conditions for this controllability are obtained with the help of backward stochastic differential equations (BSDEs). We establish the equivalence between the controllability of a game-based control system (GBCS), the controllability of a forward backward stochastic differential equation (FBSDE), and the partial controllability of a related stochastic differential equation (SDE) with terminal constraints. By applying our results, we obtain some necessary and sufficient conditions for the controllability of GBCSs with jumps. Then we embed the GBCSs driven only by Brownian motion and deterministic GBCSs into our framework with jumps. Previous results of Zhang and Guo are covered and extended.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"38 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138553796","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
SIAM Journal on Control and Optimization
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1