We investigate local optimality conditions of first and second order for integer optimal control problems with total variation regularization via a finite-dimensional switching-point problem. We show the equivalence of local optimality for both problems, which will be used to derive conditions concerning the switching points of the control function. A non-local optimality condition treating back-and-forth switches will be formulated. For the numerical solution, we propose a proximal-gradient method. The emerging discretized subproblems will be solved by employing Bellman’s optimality principle, leading to an algorithm which is polynomial in the mesh size and in the admissible control levels. An adaption of this algorithm can be used to handle subproblems of the trust-region method proposed in Leyffer and Manns, ESAIM: Control Optim. Calc. Var. 28 (2022) 66. Finally, we demonstrate computational results.
通过有限维切换点问题,研究了具有全变分正则化的整数最优控制问题的一阶和二阶局部最优性条件。我们证明了这两个问题的局部最优性的等价性,这将用于导出关于控制函数的开关点的条件。一个处理来回切换的非局部最优性条件将被提出。对于数值解,我们提出了一种近似梯度法。采用Bellman最优性原理对出现的离散子问题进行求解,得到一个在网格大小和允许控制水平上都是多项式的算法。该算法的改进可用于处理Leyffer和Manns在ESAIM: Control Optim中提出的信任域方法的子问题。中国生物医学工程学报,28 (2022)最后,给出了计算结果。
{"title":"Integer optimal control problems with total variation regularization: Optimality conditions and fast solution of subproblems","authors":"Jonas Marko, Gerd Wachsmuth","doi":"10.1051/cocv/2023065","DOIUrl":"https://doi.org/10.1051/cocv/2023065","url":null,"abstract":"We investigate local optimality conditions of first and second order for integer optimal control problems with total variation regularization via a finite-dimensional switching-point problem. We show the equivalence of local optimality for both problems, which will be used to derive conditions concerning the switching points of the control function. A non-local optimality condition treating back-and-forth switches will be formulated. For the numerical solution, we propose a proximal-gradient method. The emerging discretized subproblems will be solved by employing Bellman’s optimality principle, leading to an algorithm which is polynomial in the mesh size and in the admissible control levels. An adaption of this algorithm can be used to handle subproblems of the trust-region method proposed in Leyffer and Manns, ESAIM: Control Optim. Calc. Var. 28 (2022) 66. Finally, we demonstrate computational results.","PeriodicalId":50500,"journal":{"name":"Esaim-Control Optimisation and Calculus of Variations","volume":"95 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135549380","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This manuscript aims to study finite horizon, first order Hamilton Jacobi Bellman (HJB) equations on stratified domains. This problem is related to optimal control problems with discontinuous dynamics. We use nonsmooth analysis techniques to derive a strong comparison principle as in the classical theory and deduce that the value function is the unique viscosity solution. Furthermore, we prove some stability results of the Hamilton Jacobi Bellman equation. Finally, we establish a general convergence result for monotone numerical schemes in the stratified case.
{"title":"A general comparison principle for Hamilton Jacobi Bellman equations on stratified domains 1\u0000 \u0000 \u0000 \u0000 \u0000 \u0000 \u0000 \u0000 \u0000 \u0000 \u0000 \u0000 \u0000 \u0000 \u0000 \u0000 \u0000 \u0000 \u0000 \u0000 ","authors":"H. Zidani, O. Jerhaoui","doi":"10.1051/cocv/2022089","DOIUrl":"https://doi.org/10.1051/cocv/2022089","url":null,"abstract":"This manuscript aims to study finite horizon, first order Hamilton Jacobi Bellman (HJB) equations on stratified domains. This problem is related to optimal control problems with discontinuous dynamics. We use nonsmooth analysis techniques to derive a strong comparison principle as in the classical theory and deduce that the value function is the unique viscosity solution. Furthermore, we prove some stability results of the Hamilton Jacobi Bellman equation. Finally, we establish a general convergence result for monotone numerical schemes in the stratified case.","PeriodicalId":50500,"journal":{"name":"Esaim-Control Optimisation and Calculus of Variations","volume":"31 1","pages":""},"PeriodicalIF":1.4,"publicationDate":"2022-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85857844","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}