首页 > 最新文献

IEEE Control Systems Letters最新文献

英文 中文
Distributed State Estimation of Linear Systems With Randomly Switching Communication Graphs 具有随机切换通信图谱的线性系统分布式状态估计
IF 2.4 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-06-14 DOI: 10.1109/LCSYS.2024.3414977
Edwin Baum;Zonglin Liu;Olaf Stursberg
This letter introduces two novel methods to synthesize distributed observers for time-varying communication graphs which are modeled as continuous-time Markov processes. The first method obtains all design parameters in a centralized step by solving a system of coupled LMI, while the second method utilizes an observability decomposition to design the parameters locally by partitioning into observable and unobservable system parts. For both methods, this letter provides sufficient conditions for the existence of distributed observers which asymptotically achieve omniscience almost surely. A numerical example to compare the two methods is provided in addition.
这封信介绍了两种为时变通信图合成分布式观测器的新方法,这些通信图被建模为连续时间马尔可夫过程。第一种方法通过求解耦合 LMI 系统,在集中步骤中获得所有设计参数;第二种方法利用可观测性分解,通过将系统划分为可观测部分和不可观测部分,在局部设计参数。对于这两种方法,这封信提供了分布式观测器存在的充分条件,这些观测器几乎肯定会渐进地实现全知。此外,还提供了一个数值示例来比较这两种方法。
{"title":"Distributed State Estimation of Linear Systems With Randomly Switching Communication Graphs","authors":"Edwin Baum;Zonglin Liu;Olaf Stursberg","doi":"10.1109/LCSYS.2024.3414977","DOIUrl":"https://doi.org/10.1109/LCSYS.2024.3414977","url":null,"abstract":"This letter introduces two novel methods to synthesize distributed observers for time-varying communication graphs which are modeled as continuous-time Markov processes. The first method obtains all design parameters in a centralized step by solving a system of coupled LMI, while the second method utilizes an observability decomposition to design the parameters locally by partitioning into observable and unobservable system parts. For both methods, this letter provides sufficient conditions for the existence of distributed observers which asymptotically achieve omniscience almost surely. A numerical example to compare the two methods is provided in addition.","PeriodicalId":37235,"journal":{"name":"IEEE Control Systems Letters","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141602457","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Reachability Analysis Using Constrained Polynomial Logical Zonotopes 利用受限多项式逻辑纵切面进行可达性分析
IF 2.4 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-06-14 DOI: 10.1109/LCSYS.2024.3414972
Ahmad Hafez;Frank J. Jiang;Karl H. Johansson;Amr Alanwar
This letter presents a novel approach for reachability analysis of using constrained polynomial logical zonotopes. We perform reachability analysis to compute the set of reachable states using a recently introduced set representation called polynomial logical zonotopes, enabling computationally efficient and exact reachability analysis on logical systems. Notably, polynomial logical zonotopes address the “curse of dimensionality” when analyzing the reachability of logical systems since the set representation can represent $2^{h}$ binary vectors using h generators. After finishing the reachability analysis, the formal verification involves verifying whether the intersection of the calculated reachable set and the unsafe set is empty or not. Polynomial logical zonotopes lack closure under intersections, prompting the formulation of constrained polynomial logical zonotopes, which preserve the computational efficiency and exactness of polynomial logical zonotopes for reachability analysis while enabling exact intersections. Additionally, an extensive empirical study is presented to demonstrate and validate the advantages of constrained polynomial logical zonotopes.
这封信提出了一种使用受约束多项式逻辑众数进行可达性分析的新方法。我们使用最近推出的一种称为多项式逻辑众数的集合表示法进行可达性分析,计算可达状态集合,从而实现对逻辑系统进行高效计算和精确可达性分析。值得注意的是,由于集合表示法可以用 h 个生成器来表示 $2^{h}$ 二进制向量,因此多项式逻辑纵向图解决了逻辑系统可达性分析中的 "维度诅咒 "问题。完成可达性分析后,形式验证包括验证计算出的可达集与不安全集的交集是否为空。多项式逻辑众数在交集下缺乏闭合性,这促使人们提出了受约束的多项式逻辑众数,它既保留了多项式逻辑众数在可达性分析中的计算效率和精确性,又实现了精确的交集。此外,本文还介绍了一项广泛的实证研究,以证明和验证受约束多项式逻辑众数的优势。
{"title":"Reachability Analysis Using Constrained Polynomial Logical Zonotopes","authors":"Ahmad Hafez;Frank J. Jiang;Karl H. Johansson;Amr Alanwar","doi":"10.1109/LCSYS.2024.3414972","DOIUrl":"https://doi.org/10.1109/LCSYS.2024.3414972","url":null,"abstract":"This letter presents a novel approach for reachability analysis of using constrained polynomial logical zonotopes. We perform reachability analysis to compute the set of reachable states using a recently introduced set representation called polynomial logical zonotopes, enabling computationally efficient and exact reachability analysis on logical systems. Notably, polynomial logical zonotopes address the “curse of dimensionality” when analyzing the reachability of logical systems since the set representation can represent \u0000<inline-formula> <tex-math>$2^{h}$ </tex-math></inline-formula>\u0000 binary vectors using h generators. After finishing the reachability analysis, the formal verification involves verifying whether the intersection of the calculated reachable set and the unsafe set is empty or not. Polynomial logical zonotopes lack closure under intersections, prompting the formulation of constrained polynomial logical zonotopes, which preserve the computational efficiency and exactness of polynomial logical zonotopes for reachability analysis while enabling exact intersections. Additionally, an extensive empirical study is presented to demonstrate and validate the advantages of constrained polynomial logical zonotopes.","PeriodicalId":37235,"journal":{"name":"IEEE Control Systems Letters","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142329332","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Output-Feedback Synthesis Orbit Geometry: Quotient Manifolds and LQG Direct Policy Optimization 输出反馈合成轨道几何:矩阵和 LQG 直接策略优化
IF 2.4 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-06-14 DOI: 10.1109/LCSYS.2024.3414962
Spencer Kraisler;Mehran Mesbahi
We consider direct policy optimization for the linear-quadratic Gaussian (LQG) setting. Over the past few years, it has been recognized that the landscape of dynamic output-feedback controllers of relevance to LQG has an intricate geometry, particularly pertaining to the existence of degenerate stationary points, that hinders gradient methods. In order to address these challenges, in this letter, we adopt a system-theoretic coordinate-invariant Riemannian metric for the space of dynamic output-feedback controllers and develop a Riemannian gradient descent for direct LQG policy optimization. We then proceed to prove that the orbit space of such controllers, modulo the coordinate transformation, admits a Riemannian quotient manifold structure. This geometric structure-that is of independent interest-provides an effective approach to derive direct policy optimization algorithms for LQG with a local linear rate convergence guarantee. Subsequently, we show that the proposed approach exhibits significantly faster and more robust numerical performance as compared with ordinary gradient descent.
我们考虑了线性-二次高斯(LQG)设置的直接策略优化。在过去几年中,人们已经认识到,与 LQG 相关的动态输出反馈控制器具有错综复杂的几何形状,尤其是存在退化静止点,这阻碍了梯度方法的使用。为了应对这些挑战,我们在这封信中采用了动态输出反馈控制器空间的系统论坐标不变黎曼度量,并开发了直接优化 LQG 策略的黎曼梯度下降法。然后,我们继续证明,在坐标变换的模量下,此类控制器的轨道空间具有黎曼商流形结构。这种几何结构具有独立的意义,它提供了一种有效的方法来推导 LQG 的直接策略优化算法,该算法具有局部线性收敛率保证。随后,我们证明,与普通梯度下降法相比,所提出的方法具有更快、更稳健的数值性能。
{"title":"Output-Feedback Synthesis Orbit Geometry: Quotient Manifolds and LQG Direct Policy Optimization","authors":"Spencer Kraisler;Mehran Mesbahi","doi":"10.1109/LCSYS.2024.3414962","DOIUrl":"https://doi.org/10.1109/LCSYS.2024.3414962","url":null,"abstract":"We consider direct policy optimization for the linear-quadratic Gaussian (LQG) setting. Over the past few years, it has been recognized that the landscape of dynamic output-feedback controllers of relevance to LQG has an intricate geometry, particularly pertaining to the existence of degenerate stationary points, that hinders gradient methods. In order to address these challenges, in this letter, we adopt a system-theoretic coordinate-invariant Riemannian metric for the space of dynamic output-feedback controllers and develop a Riemannian gradient descent for direct LQG policy optimization. We then proceed to prove that the orbit space of such controllers, modulo the coordinate transformation, admits a Riemannian quotient manifold structure. This geometric structure-that is of independent interest-provides an effective approach to derive direct policy optimization algorithms for LQG with a local linear rate convergence guarantee. Subsequently, we show that the proposed approach exhibits significantly faster and more robust numerical performance as compared with ordinary gradient descent.","PeriodicalId":37235,"journal":{"name":"IEEE Control Systems Letters","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141495011","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Coherency-Aware Learning Control of Inverter-Dominated Grids: A Distributed Risk-Constrained Approach 逆变器主导电网的一致性感知学习控制:分布式风险约束方法
IF 2.4 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-06-13 DOI: 10.1109/LCSYS.2024.3413868
Kyung-Bin Kwon;Ramij Raja Hossain;Sayak Mukherjee;Kaustav Chatterjee;Soumya Kundu;Sameer Nekkalapu;Marcelo Elizondo
This letter investigates the importance of integrating the coherency knowledge for designing controllers to dampen sustained oscillations in wide-area power networks with significant penetration of inverter-interfaced resources. Coherency is a fundamental property of power systems, where time-scale separation in frequency dynamics leads to clustered behavior among generators of different groups. Large-scale penetration of inverter-driven low inertia resources replacing conventional synchronous generators (SGs) can lead to perturbation in the coherent partitioning; hence, integrating such information is of utmost importance for oscillation control designs. We present the coherency-aware design of a distributed output feedback-based reinforcement learning method that additionally incorporates risk constraints to capture the uncertainties related to net-load fluctuations. The use of domain-aware coherency information has produced improved training and oscillation performance than the coherency-agnostic control design, hence proving to be effective in controller design. Finally, we validated the proposed method with numerical experiments on the benchmark IEEE 68-bus test system.
这封信探讨了在设计控制器时整合一致性知识的重要性,以抑制广泛区域电力网络中的持续振荡。一致性是电力系统的基本属性,频率动态的时间尺度分离会导致不同组别发电机之间的集群行为。逆变器驱动的低惯性资源的大规模渗透取代了传统的同步发电机(SG),可能会导致一致性分区的扰动;因此,整合这些信息对于振荡控制设计至关重要。我们介绍了一种基于分布式输出反馈的强化学习方法的一致性感知设计,该方法还纳入了风险约束,以捕捉与净负荷波动相关的不确定性。与不考虑一致性的控制设计相比,领域感知一致性信息的使用提高了训练和振荡性能,因此在控制器设计中被证明是有效的。最后,我们在基准 IEEE 68 总线测试系统上进行了数值实验,验证了所提出的方法。
{"title":"Coherency-Aware Learning Control of Inverter-Dominated Grids: A Distributed Risk-Constrained Approach","authors":"Kyung-Bin Kwon;Ramij Raja Hossain;Sayak Mukherjee;Kaustav Chatterjee;Soumya Kundu;Sameer Nekkalapu;Marcelo Elizondo","doi":"10.1109/LCSYS.2024.3413868","DOIUrl":"https://doi.org/10.1109/LCSYS.2024.3413868","url":null,"abstract":"This letter investigates the importance of integrating the coherency knowledge for designing controllers to dampen sustained oscillations in wide-area power networks with significant penetration of inverter-interfaced resources. Coherency is a fundamental property of power systems, where time-scale separation in frequency dynamics leads to clustered behavior among generators of different groups. Large-scale penetration of inverter-driven low inertia resources replacing conventional synchronous generators (SGs) can lead to perturbation in the coherent partitioning; hence, integrating such information is of utmost importance for oscillation control designs. We present the coherency-aware design of a distributed output feedback-based reinforcement learning method that additionally incorporates risk constraints to capture the uncertainties related to net-load fluctuations. The use of domain-aware coherency information has produced improved training and oscillation performance than the coherency-agnostic control design, hence proving to be effective in controller design. Finally, we validated the proposed method with numerical experiments on the benchmark IEEE 68-bus test system.","PeriodicalId":37235,"journal":{"name":"IEEE Control Systems Letters","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142159878","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Output Feedback Tracking Control for a Class of Bilinear Systems: Application to Power Electronics Devices 一类双线性系统的输出反馈跟踪控制:电力电子设备的应用
IF 2.4 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-06-13 DOI: 10.1109/LCSYS.2024.3414349
Amir Reza Zare;Mahdi Aliyari-Shoorehdeli;Mehdi Tavan;Kamran Sabahi
This letter studies the design of state and output feedback control for a class of bilinear systems aimed at achieving global exponential tracking of (admissible, differentiable) time-varying trajectories. We demonstrate that a persistency of excitation (PE) assumption on the desired trajectories is sufficient to achieve the control objective via a simple state feedback proportional (P) controller. The controller, in conjunction with a globally stable Kalman-like observer, is further developed into a certainty-equivalent output feedback version, maintaining stability under a detectability condition that depends on the behavior of the desired control effort. The proposed algorithm is applied to control a lossless single-phase grid-connected PV inverter with an unmeasurable output current.
这封信研究了一类双线性系统的状态和输出反馈控制设计,旨在实现对(可容许、可微分)时变轨迹的全局指数跟踪。我们证明,通过一个简单的状态反馈比例(P)控制器,对所需轨迹的持续激励(PE)假设足以实现控制目标。该控制器与全局稳定的卡尔曼观测器相结合,进一步发展成确定性等效输出反馈版本,在取决于预期控制努力行为的可探测性条件下保持稳定。所提出的算法被用于控制输出电流不可测量的无损单相并网光伏逆变器。
{"title":"Output Feedback Tracking Control for a Class of Bilinear Systems: Application to Power Electronics Devices","authors":"Amir Reza Zare;Mahdi Aliyari-Shoorehdeli;Mehdi Tavan;Kamran Sabahi","doi":"10.1109/LCSYS.2024.3414349","DOIUrl":"https://doi.org/10.1109/LCSYS.2024.3414349","url":null,"abstract":"This letter studies the design of state and output feedback control for a class of bilinear systems aimed at achieving global exponential tracking of (admissible, differentiable) time-varying trajectories. We demonstrate that a persistency of excitation (PE) assumption on the desired trajectories is sufficient to achieve the control objective via a simple state feedback proportional (P) controller. The controller, in conjunction with a globally stable Kalman-like observer, is further developed into a certainty-equivalent output feedback version, maintaining stability under a detectability condition that depends on the behavior of the desired control effort. The proposed algorithm is applied to control a lossless single-phase grid-connected PV inverter with an unmeasurable output current.","PeriodicalId":37235,"journal":{"name":"IEEE Control Systems Letters","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141965910","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Event-Triggered Parameterized Control of Nonlinear Systems 非线性系统的事件触发参数化控制
IF 2.4 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-06-13 DOI: 10.1109/LCSYS.2024.3414290
Anusree Rajan;Pavankumar Tallapragada
This letter deals with event-triggered parameterized control (ETPC) of nonlinear systems with external disturbances. In this control method, between two successive events, each control input to the plant is a linear combination of a set of linearly independent scalar functions. At each event, the controller updates the coefficients of the parameterized control input so as to minimize the error in approximating a continuous time control signal and communicates the same to the actuator. We design an event-triggering rule (ETR) that guarantees global uniform ultimate boundedness of trajectories of the closed loop system. We also ensure the absence of Zeno behavior by showing the existence of a uniform positive lower bound on the inter-event times (IETs). We illustrate our results through numerical examples.
这封信讨论的是具有外部干扰的非线性系统的事件触发参数化控制(ETPC)。在这种控制方法中,在两个连续事件之间,工厂的每个控制输入都是一组线性独立标量函数的线性组合。在每个事件中,控制器都会更新参数化控制输入的系数,以最小化近似连续时间控制信号的误差,并将同样的误差传递给执行器。我们设计了一种事件触发规则 (ETR),可确保闭环系统轨迹的全局均匀终极约束性。我们还通过证明事件间时间(IETs)存在统一的正下限,确保不存在芝诺行为。我们通过数值示例来说明我们的结果。
{"title":"Event-Triggered Parameterized Control of Nonlinear Systems","authors":"Anusree Rajan;Pavankumar Tallapragada","doi":"10.1109/LCSYS.2024.3414290","DOIUrl":"https://doi.org/10.1109/LCSYS.2024.3414290","url":null,"abstract":"This letter deals with event-triggered parameterized control (ETPC) of nonlinear systems with external disturbances. In this control method, between two successive events, each control input to the plant is a linear combination of a set of linearly independent scalar functions. At each event, the controller updates the coefficients of the parameterized control input so as to minimize the error in approximating a continuous time control signal and communicates the same to the actuator. We design an event-triggering rule (ETR) that guarantees global uniform ultimate boundedness of trajectories of the closed loop system. We also ensure the absence of Zeno behavior by showing the existence of a uniform positive lower bound on the inter-event times (IETs). We illustrate our results through numerical examples.","PeriodicalId":37235,"journal":{"name":"IEEE Control Systems Letters","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141602510","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On the Set of Possible Minimizers of a Sum of Convex Functions 论凸函数之和的可能最小值集合
IF 2.4 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-06-13 DOI: 10.1109/LCSYS.2024.3414378
Moslem Zamani;François Glineur;Julien M. Hendrickx
Consider a sum of convex functions, where the only information known about each individual summand is the location of a minimizer. In this letter, we give an exact characterization of the set of possible minimizers of the sum. Our results cover several types of assumptions on the summands, such as smoothness or strong convexity. Our main tool is the use of necessary and sufficient conditions for interpolating the considered function classes, which leads to shorter and more direct proofs in comparison with previous work. We also address the setting where each summand minimizer is assumed to lie in a unit ball, and prove a tight bound on the norm of any minimizer of the sum.
考虑一个凸函数的和,其中关于每个单独和的唯一已知信息是最小值的位置。在这封信中,我们给出了和的可能最小值集合的精确特征。我们的结果涵盖了和的几种假设类型,如光滑性或强凸性。我们的主要工具是使用所考虑函数类插值的必要条件和充分条件,与之前的工作相比,这使得证明更简短、更直接。我们还讨论了假定每个和的最小化都位于单位球中的问题,并证明了和的任何最小化的规范的严格约束。
{"title":"On the Set of Possible Minimizers of a Sum of Convex Functions","authors":"Moslem Zamani;François Glineur;Julien M. Hendrickx","doi":"10.1109/LCSYS.2024.3414378","DOIUrl":"https://doi.org/10.1109/LCSYS.2024.3414378","url":null,"abstract":"Consider a sum of convex functions, where the only information known about each individual summand is the location of a minimizer. In this letter, we give an exact characterization of the set of possible minimizers of the sum. Our results cover several types of assumptions on the summands, such as smoothness or strong convexity. Our main tool is the use of necessary and sufficient conditions for interpolating the considered function classes, which leads to shorter and more direct proofs in comparison with previous work. We also address the setting where each summand minimizer is assumed to lie in a unit ball, and prove a tight bound on the norm of any minimizer of the sum.","PeriodicalId":37235,"journal":{"name":"IEEE Control Systems Letters","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141602533","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Discrete-Time Stochastic LQR via Path Integral Control and Its Sample Complexity Analysis 通过路径积分控制的离散时间随机 LQR 及其样本复杂性分析
IF 2.4 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-06-13 DOI: 10.1109/LCSYS.2024.3413869
Apurva Patil;Grani A. Hanasusanto;Takashi Tanaka
In this letter, we derive the path integral control algorithm to solve a discrete-time stochastic Linear Quadratic Regulator (LQR) problem and carry out its sample complexity analysis. While the stochastic LQR problem can be efficiently solved by the standard backward Riccati recursion, our primary focus in this letter is to establish the foundation for a sample complexity analysis of the path integral method when the analytical expressions of optimal control law and the cost are available. Specifically, we derive a bound on the error between the optimal LQR input and the input computed by the path integral method as a function of the sample size. Our analysis reveals that the sample size required exhibits a logarithmic dependence on the dimension of the control input. Lastly, we formulate a chance-constrained optimization problem whose solution quantifies the worst-case control performance of the path integral approach.
在这封信中,我们推导出了解决离散时间随机线性二次调节器(LQR)问题的路径积分控制算法,并对其进行了样本复杂度分析。虽然随机 LQR 问题可以通过标准的后向里卡蒂递推法高效求解,但我们在这封信中的主要重点是,在最佳控制律和代价的解析表达式可用的情况下,为路径积分法的样本复杂度分析奠定基础。具体来说,我们推导了最优 LQR 输入与路径积分法计算的输入之间的误差与样本量的函数关系。我们的分析表明,所需的样本量与控制输入的维度呈对数关系。最后,我们提出了一个机会约束优化问题,其解决方案可以量化路径积分法的最差控制性能。
{"title":"Discrete-Time Stochastic LQR via Path Integral Control and Its Sample Complexity Analysis","authors":"Apurva Patil;Grani A. Hanasusanto;Takashi Tanaka","doi":"10.1109/LCSYS.2024.3413869","DOIUrl":"https://doi.org/10.1109/LCSYS.2024.3413869","url":null,"abstract":"In this letter, we derive the path integral control algorithm to solve a discrete-time stochastic Linear Quadratic Regulator (LQR) problem and carry out its sample complexity analysis. While the stochastic LQR problem can be efficiently solved by the standard backward Riccati recursion, our primary focus in this letter is to establish the foundation for a sample complexity analysis of the path integral method when the analytical expressions of optimal control law and the cost are available. Specifically, we derive a bound on the error between the optimal LQR input and the input computed by the path integral method as a function of the sample size. Our analysis reveals that the sample size required exhibits a logarithmic dependence on the dimension of the control input. Lastly, we formulate a chance-constrained optimization problem whose solution quantifies the worst-case control performance of the path integral approach.","PeriodicalId":37235,"journal":{"name":"IEEE Control Systems Letters","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141495212","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On Weakly Contracting Dynamics for Convex Optimization 关于凸优化的弱契约动力学
IF 2.4 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-06-13 DOI: 10.1109/LCSYS.2024.3414348
Veronica Centorrino;Alexander Davydov;Anand Gokhale;Giovanni Russo;Francesco Bullo
We analyze the convergence behavior of globally weakly and locally strongly contracting dynamics. Such dynamics naturally arise in the context of convex optimization problems with a unique minimizer. We show that convergence to the equilibrium is linear-exponential, in the sense that the distance between each solution and the equilibrium is upper bounded by a function that first decreases linearly and then exponentially. As we show, the linear-exponential dependency arises naturally in certain dynamics with saturations. Additionally, we provide a sufficient condition for local input-to-state stability. Finally, we illustrate our results on, and propose a conjecture for, continuous-time dynamical systems solving linear programs.
我们分析了全局弱收缩和局部强收缩动力学的收敛行为。这种动力学自然出现在具有唯一最小值的凸优化问题中。我们证明,向均衡的收敛是线性-指数收敛,即每个解与均衡之间的距离都有一个函数的上限,这个函数先是线性递减,然后是指数递减。正如我们所展示的,线性-指数依赖性自然出现在某些饱和动力学中。此外,我们还提供了局部输入到状态稳定性的充分条件。最后,我们说明了我们在求解线性程序的连续时间动力系统上的结果,并提出了一个猜想。
{"title":"On Weakly Contracting Dynamics for Convex Optimization","authors":"Veronica Centorrino;Alexander Davydov;Anand Gokhale;Giovanni Russo;Francesco Bullo","doi":"10.1109/LCSYS.2024.3414348","DOIUrl":"https://doi.org/10.1109/LCSYS.2024.3414348","url":null,"abstract":"We analyze the convergence behavior of globally weakly and locally strongly contracting dynamics. Such dynamics naturally arise in the context of convex optimization problems with a unique minimizer. We show that convergence to the equilibrium is linear-exponential, in the sense that the distance between each solution and the equilibrium is upper bounded by a function that first decreases linearly and then exponentially. As we show, the linear-exponential dependency arises naturally in certain dynamics with saturations. Additionally, we provide a sufficient condition for local input-to-state stability. Finally, we illustrate our results on, and propose a conjecture for, continuous-time dynamical systems solving linear programs.","PeriodicalId":37235,"journal":{"name":"IEEE Control Systems Letters","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141602559","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Linear Quadratic Zero-Sum Differential Games With Intermittent and Costly Sensing 具有间歇性和高成本传感的线性二次零和差分博弈
IF 2.4 Q2 AUTOMATION & CONTROL SYSTEMS Pub Date : 2024-06-13 DOI: 10.1109/LCSYS.2024.3413870
Shubham Aggarwal;Tamer Başar;Dipankar Maity
In this letter, we revisit the two-player continuous-time infinite-horizon linear quadratic differential game problem, where one of the players can sample the state of the system only intermittently due to a sensing constraint while the other player can do so continuously. Under these asymmetric sensing limitations between the players, we analyze the optimal sensing and control strategies for the player at a disadvantage while the other player continues to play its security strategy. We derive an optimal sensor policy within the class of stationary randomized policies. Finally, using simulations, we show that the expected cost accrued by the first player approaches its security level as its sensing limitation is relaxed.
在这封信中,我们重新探讨了双人连续时间无限视距线性二次微分博弈问题,其中一个博弈方由于感知限制只能间歇性地对系统状态进行采样,而另一个博弈方则可以连续采样。在博弈方之间存在非对称感应限制的情况下,我们分析了处于劣势的博弈方的最优感应和控制策略,而另一方则继续执行其安全策略。我们在静态随机策略类别中推导出了最优传感策略。最后,通过模拟,我们证明当第一个棋手的感知限制放宽时,其累积的预期成本会接近其安全水平。
{"title":"Linear Quadratic Zero-Sum Differential Games With Intermittent and Costly Sensing","authors":"Shubham Aggarwal;Tamer Başar;Dipankar Maity","doi":"10.1109/LCSYS.2024.3413870","DOIUrl":"https://doi.org/10.1109/LCSYS.2024.3413870","url":null,"abstract":"In this letter, we revisit the two-player continuous-time infinite-horizon linear quadratic differential game problem, where one of the players can sample the state of the system only intermittently due to a sensing constraint while the other player can do so continuously. Under these asymmetric sensing limitations between the players, we analyze the optimal sensing and control strategies for the player at a disadvantage while the other player continues to play its security strategy. We derive an optimal sensor policy within the class of stationary randomized policies. Finally, using simulations, we show that the expected cost accrued by the first player approaches its security level as its sensing limitation is relaxed.","PeriodicalId":37235,"journal":{"name":"IEEE Control Systems Letters","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2024-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10556616","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141500256","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE Control Systems Letters
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1