Online Constraint Tightening in Stochastic Model Predictive Control: A Regression Approach

IF 7 1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS IEEE Transactions on Automatic Control Pub Date : 2024-07-26 DOI:10.1109/TAC.2024.3433988
Alexandre Capone;Tim Brüdigam;Sandra Hirche
{"title":"Online Constraint Tightening in Stochastic Model Predictive Control: A Regression Approach","authors":"Alexandre Capone;Tim Brüdigam;Sandra Hirche","doi":"10.1109/TAC.2024.3433988","DOIUrl":null,"url":null,"abstract":"Solving chance-constrained stochastic optimal control problems is a significant challenge in control. This is because no analytical solutions exist for up to a handful of special cases. A common and computationally efficient approach for tackling chance-constrained stochastic optimal control problems consists of a deterministic reformulation, where hard constraints with an additional constraint-tightening parameter are imposed on a nominal prediction that ignores stochastic disturbances. However, in such approaches, the choice of constraint-tightening parameter remains challenging, and guarantees can mostly be obtained assuming that the process noise distribution is known a priori. Moreover, the chance constraints are often not tightly satisfied, leading to unnecessarily high costs. This work proposes a data-driven approach for learning the constraint-tightening parameters online during control. To this end, we reformulate the choice of constraint-tightening parameter for the closed loop as a binary regression problem. We then leverage a highly expressive Gaussian process, model for binary regression to approximate the smallest constraint-tightening parameters that satisfy the chance constraints. By tuning the algorithm parameters appropriately, we show that the resulting constraint-tightening parameters satisfy the chance constraints up to an arbitrarily small margin with high probability. Our approach yields constraint-tightening parameters that tightly satisfy the chance constraints in numerical experiments, resulting in a lower average cost than three other state-of-the-art approaches.","PeriodicalId":13201,"journal":{"name":"IEEE Transactions on Automatic Control","volume":"70 2","pages":"736-750"},"PeriodicalIF":7.0000,"publicationDate":"2024-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10612220","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Automatic Control","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10612220/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Solving chance-constrained stochastic optimal control problems is a significant challenge in control. This is because no analytical solutions exist for up to a handful of special cases. A common and computationally efficient approach for tackling chance-constrained stochastic optimal control problems consists of a deterministic reformulation, where hard constraints with an additional constraint-tightening parameter are imposed on a nominal prediction that ignores stochastic disturbances. However, in such approaches, the choice of constraint-tightening parameter remains challenging, and guarantees can mostly be obtained assuming that the process noise distribution is known a priori. Moreover, the chance constraints are often not tightly satisfied, leading to unnecessarily high costs. This work proposes a data-driven approach for learning the constraint-tightening parameters online during control. To this end, we reformulate the choice of constraint-tightening parameter for the closed loop as a binary regression problem. We then leverage a highly expressive Gaussian process, model for binary regression to approximate the smallest constraint-tightening parameters that satisfy the chance constraints. By tuning the algorithm parameters appropriately, we show that the resulting constraint-tightening parameters satisfy the chance constraints up to an arbitrarily small margin with high probability. Our approach yields constraint-tightening parameters that tightly satisfy the chance constraints in numerical experiments, resulting in a lower average cost than three other state-of-the-art approaches.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
随机模型预测控制中的在线约束紧缩:回归方法
求解机会约束随机最优控制问题是控制领域的一个重大挑战。这是因为对于少数特殊情况不存在解析解。解决机会约束随机最优控制问题的一种常见且计算效率高的方法包括确定性重新表述,其中在忽略随机干扰的名义预测上施加带有附加约束收紧参数的硬约束。然而,在这些方法中,约束收紧参数的选择仍然具有挑战性,并且大多可以在假设过程噪声分布是先验已知的情况下获得保证。此外,机会限制常常不能得到严格满足,从而导致不必要的高成本。本文提出了一种数据驱动的方法,用于在线学习控制过程中的约束收紧参数。为此,我们将闭环约束收紧参数的选择重新表述为一个二元回归问题。然后,我们利用一个高度表达的高斯过程,二元回归模型来近似满足机会约束的最小约束收紧参数。通过适当调整算法参数,我们证明了得到的约束收紧参数以高概率满足任意小裕度的机会约束。我们的方法产生严格满足数值实验中的机会约束的约束收紧参数,导致比其他三种最先进的方法更低的平均成本。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Transactions on Automatic Control
IEEE Transactions on Automatic Control 工程技术-工程:电子与电气
CiteScore
11.30
自引率
5.90%
发文量
824
审稿时长
9 months
期刊介绍: In the IEEE Transactions on Automatic Control, the IEEE Control Systems Society publishes high-quality papers on the theory, design, and applications of control engineering. Two types of contributions are regularly considered: 1) Papers: Presentation of significant research, development, or application of control concepts. 2) Technical Notes and Correspondence: Brief technical notes, comments on published areas or established control topics, corrections to papers and notes published in the Transactions. In addition, special papers (tutorials, surveys, and perspectives on the theory and applications of control systems topics) are solicited.
期刊最新文献
Feedback Regulation for Max-Plus Linear Systems Distributed Control Lyapunov and Control Barrier Certificates for Reactive Formation Innovation-Based Stealthy Attacks on Remote State Estimators Using the Wasserstein Distance Verification of Resilient Current-State Opacity Against Dynamic Sensor Enabling Attacks Signed Angle Rigid Graphs for Network Localization and Formation Control
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1