Pub Date : 2024-04-10DOI: 10.1007/s10957-024-02419-0
Regina S. Burachik, C. Yalçın Kaya, Walaa M. Moursi
We consider optimal control problems involving two constraint sets: one comprised of linear ordinary differential equations with the initial and terminal states specified and the other defined by the control variables constrained by simple bounds. When the intersection of these two sets is empty, typically because the bounds on the control variables are too tight, the problem becomes infeasible. In this paper, we prove that, under a controllability assumption, the “best approximation” optimal control minimizing the distance (and thus finding the “gap”) between the two sets is of bang–bang type, with the “gap function” playing the role of a switching function. The critically feasible control solution (the case when one has the smallest control bound for which the problem is feasible) is also shown to be of bang–bang type. We present the full analytical solution for the critically feasible problem involving the (simple but rich enough) double integrator. We illustrate the overall results numerically on various challenging example problems.
{"title":"Infeasible and Critically Feasible Optimal Control","authors":"Regina S. Burachik, C. Yalçın Kaya, Walaa M. Moursi","doi":"10.1007/s10957-024-02419-0","DOIUrl":"https://doi.org/10.1007/s10957-024-02419-0","url":null,"abstract":"<p>We consider optimal control problems involving two constraint sets: one comprised of linear ordinary differential equations with the initial and terminal states specified and the other defined by the control variables constrained by simple bounds. When the intersection of these two sets is empty, typically because the bounds on the control variables are too tight, the problem becomes infeasible. In this paper, we prove that, under a controllability assumption, the “best approximation” optimal control minimizing the distance (and thus finding the “gap”) between the two sets is of bang–bang type, with the “gap function” playing the role of a switching function. The critically feasible control solution (the case when one has the smallest control bound for which the problem is feasible) is also shown to be of bang–bang type. We present the full analytical solution for the critically feasible problem involving the (simple but rich enough) double integrator. We illustrate the overall results numerically on various challenging example problems.</p>","PeriodicalId":50100,"journal":{"name":"Journal of Optimization Theory and Applications","volume":"185 1","pages":""},"PeriodicalIF":1.9,"publicationDate":"2024-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140579952","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-09DOI: 10.1007/s10957-024-02428-z
Mohammed Bachir, Joël Blot
We give a general Lagrange multiplier rule for mathematical programming problems in a Hausdorff locally convex space. We consider infinitely many inequality and equality constraints. Our results gives in particular a generalisation of the result of Jahn (Introduction to the theory of nonlinear optimization, Springer, Berlin, 2007), replacing Fréchet-differentiability assumptions on the functions by the Gateaux-differentiability. Moreover, the closed convex cone with a nonempty interior in the constraints is replaced by a strictly general class of closed subsets introduced in the paper and called “admissible sets”. Examples illustrating our results are given.
{"title":"Lagrange Multipliers in Locally Convex Spaces","authors":"Mohammed Bachir, Joël Blot","doi":"10.1007/s10957-024-02428-z","DOIUrl":"https://doi.org/10.1007/s10957-024-02428-z","url":null,"abstract":"<p>We give a general Lagrange multiplier rule for mathematical programming problems in a Hausdorff locally convex space. We consider infinitely many inequality and equality constraints. Our results gives in particular a generalisation of the result of Jahn (Introduction to the theory of nonlinear optimization, Springer, Berlin, 2007), replacing Fréchet-differentiability assumptions on the functions by the Gateaux-differentiability. Moreover, the closed convex cone with a nonempty interior in the constraints is replaced by a strictly general class of closed subsets introduced in the paper and called <i>“admissible sets”</i>. Examples illustrating our results are given.</p>","PeriodicalId":50100,"journal":{"name":"Journal of Optimization Theory and Applications","volume":"99 1","pages":""},"PeriodicalIF":1.9,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140579801","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-09DOI: 10.1007/s10957-024-02420-7
Li-Ming Li, Shi-Liang Wu, Ping-Fan Dai
In this paper, we introduce some constants with the tensors of special structures and present their some useful properties. Furthermore, some perturbation bounds of the tensor complementarity problem are obtained on the base of these constants.
{"title":"Some Perturbation Bounds of the Tensor Complementarity Problem","authors":"Li-Ming Li, Shi-Liang Wu, Ping-Fan Dai","doi":"10.1007/s10957-024-02420-7","DOIUrl":"https://doi.org/10.1007/s10957-024-02420-7","url":null,"abstract":"<p>In this paper, we introduce some constants with the tensors of special structures and present their some useful properties. Furthermore, some perturbation bounds of the tensor complementarity problem are obtained on the base of these constants.\u0000</p>","PeriodicalId":50100,"journal":{"name":"Journal of Optimization Theory and Applications","volume":"34 1","pages":""},"PeriodicalIF":1.9,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140579969","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-09DOI: 10.1007/s10957-024-02425-2
Bator Anne, Walter Briec
This paper considers the problem of measuring technical efficiency in some class of normed vector spaces. Specifically, the paper focuses on preordered and partially ordered vector spaces by proposing a suitable encompassing netput formulation of the production possibility set. Duality theorems extending some earlier results are established in the context of infinite dimensional spaces. The paper considers directional and normed distance functions and analyzes their relationships. Among other things, overall efficiency can be derived from technical efficiency under a suitable preordered vector space structure. More importantly, it is shown that the existence of core points in partially ordered vector spaces guarantees the comparison of production vectors using the directional distance function. Although the interior of the positive cone may be empty in infinite dimensional vector spaces, it is shown that normed distance functions can also be used to measure efficiency in such spaces by providing them with a suitable preorder structure.
{"title":"Distance Functions in Some Class of Infinite Dimensional Vector Spaces","authors":"Bator Anne, Walter Briec","doi":"10.1007/s10957-024-02425-2","DOIUrl":"https://doi.org/10.1007/s10957-024-02425-2","url":null,"abstract":"<p>This paper considers the problem of measuring technical efficiency in some class of normed vector spaces. Specifically, the paper focuses on preordered and partially ordered vector spaces by proposing a suitable encompassing netput formulation of the production possibility set. Duality theorems extending some earlier results are established in the context of infinite dimensional spaces. The paper considers directional and normed distance functions and analyzes their relationships. Among other things, overall efficiency can be derived from technical efficiency under a suitable preordered vector space structure. More importantly, it is shown that the existence of core points in partially ordered vector spaces guarantees the comparison of production vectors using the directional distance function. Although the interior of the positive cone may be empty in infinite dimensional vector spaces, it is shown that normed distance functions can also be used to measure efficiency in such spaces by providing them with a suitable preorder structure.</p>","PeriodicalId":50100,"journal":{"name":"Journal of Optimization Theory and Applications","volume":"99 1","pages":""},"PeriodicalIF":1.9,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140579786","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-09DOI: 10.1007/s10957-024-02414-5
Hu Zhang, Yi-Shuai Niu
This paper proposes a novel Difference-of-Convex (DC) decomposition for polynomials using a power-sum representation, achieved by solving a sparse linear system. We introduce the Boosted DCA with Exact Line Search ((hbox {BDCA}_text {e})) for addressing linearly constrained polynomial programs within the DC framework. Notably, we demonstrate that the exact line search equates to determining the roots of a univariate polynomial in an interval, with coefficients being computed explicitly based on the power-sum DC decompositions. The subsequential convergence of (hbox {BDCA}_text {e}) to critical points is proven, and its convergence rate under the Kurdyka–Łojasiewicz property is established. To efficiently tackle the convex subproblems, we integrate the Fast Dual Proximal Gradient method by exploiting the separable block structure of the power-sum DC decompositions. We validate our approach through numerical experiments on the Mean–Variance–Skewness–Kurtosis portfolio optimization model and box-constrained polynomial optimization problems. Comparative analysis of (hbox {BDCA}_text {e}) against DCA, BDCA with Armijo line search, UDCA, and UBDCA with projective DC decomposition, alongside standard nonlinear optimization solvers FMINCON and FILTERSD, substantiates the efficiency of our proposed approach.
本文通过求解稀疏线性系统,使用幂和表示法为多项式提出了一种新颖的凸差法(DC)分解。我们引入了带有精确线性搜索(Boosted DCA with Exact Line Search)((hbox {BDCA}_text {e}),用于在 DC 框架内解决线性约束多项式程序。值得注意的是,我们证明了精确线搜索等同于确定区间内单变量多项式的根,而系数是根据幂和 DC 分解明确计算出来的。证明了 (hbox {BDCA}_text {e}) 对临界点的后续收敛性,并建立了其在 Kurdyka-Łojasiewicz 属性下的收敛率。为了高效地解决凸子问题,我们利用幂和 DC 分解的可分离块结构,集成了快速双近似梯度法。我们通过均方差-斜度-峰度组合优化模型和箱约束多项式优化问题的数值实验验证了我们的方法。在标准非线性优化求解器 FMINCON 和 FILTERSD 的帮助下,我们对 (hbox {BDCA}_text {e}) 与 DCA、带有 Armijo 行搜索的 BDCA、UDCA 和带有投影 DC 分解的 UBDCA 进行了比较分析,从而证实了我们所提出方法的效率。
{"title":"A Boosted-DCA with Power-Sum-DC Decomposition for Linearly Constrained Polynomial Programs","authors":"Hu Zhang, Yi-Shuai Niu","doi":"10.1007/s10957-024-02414-5","DOIUrl":"https://doi.org/10.1007/s10957-024-02414-5","url":null,"abstract":"<p>This paper proposes a novel Difference-of-Convex (DC) decomposition for polynomials using a power-sum representation, achieved by solving a sparse linear system. We introduce the Boosted DCA with Exact Line Search (<span>(hbox {BDCA}_text {e})</span>) for addressing linearly constrained polynomial programs within the DC framework. Notably, we demonstrate that the exact line search equates to determining the roots of a univariate polynomial in an interval, with coefficients being computed explicitly based on the power-sum DC decompositions. The subsequential convergence of <span>(hbox {BDCA}_text {e})</span> to critical points is proven, and its convergence rate under the Kurdyka–Łojasiewicz property is established. To efficiently tackle the convex subproblems, we integrate the Fast Dual Proximal Gradient method by exploiting the separable block structure of the power-sum DC decompositions. We validate our approach through numerical experiments on the Mean–Variance–Skewness–Kurtosis portfolio optimization model and box-constrained polynomial optimization problems. Comparative analysis of <span>(hbox {BDCA}_text {e})</span> against DCA, BDCA with Armijo line search, UDCA, and UBDCA with projective DC decomposition, alongside standard nonlinear optimization solvers <span>FMINCON</span> and <span>FILTERSD</span>, substantiates the efficiency of our proposed approach.</p>","PeriodicalId":50100,"journal":{"name":"Journal of Optimization Theory and Applications","volume":"2015 1","pages":""},"PeriodicalIF":1.9,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140579792","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-09DOI: 10.1007/s10957-024-02418-1
Shixian Wang, Sheng Zhou, Cuilian You
Nowadays, environmental issues have received increasing attention from experts. The main cause is the increase of carbon emissions in the atmosphere, so it is urgent to reduce carbon emissions. In order to establish the optimal pricing strategy as well as the emission reduction effort strategy for companies who produce and sell low carbon products, this paper proposes an optimal control model for low carbon products. The reduction of the carbon emission for the product is described dynamically by a differential equation, and the analytical expressions of the optimal pricing and the emission abatement strategies are derived using the Pontryagin’s maximum principle. Finally, the numerical experiments are used to explain the results obtained. The results show that companies producing and selling low-carbon products must pay more attention to the amount of carbon emission reduction in their products, and make more efforts to reduce emissions in order to make more profits. Additionally, the parametric analysis shows that expanding market size and reducing inventory depletion can be equally helpful in shortening the sales cycle and boosting profits.
{"title":"Optimal Pricing and Abatement Effort Strategy for Low Carbon Products","authors":"Shixian Wang, Sheng Zhou, Cuilian You","doi":"10.1007/s10957-024-02418-1","DOIUrl":"https://doi.org/10.1007/s10957-024-02418-1","url":null,"abstract":"<p>Nowadays, environmental issues have received increasing attention from experts. The main cause is the increase of carbon emissions in the atmosphere, so it is urgent to reduce carbon emissions. In order to establish the optimal pricing strategy as well as the emission reduction effort strategy for companies who produce and sell low carbon products, this paper proposes an optimal control model for low carbon products. The reduction of the carbon emission for the product is described dynamically by a differential equation, and the analytical expressions of the optimal pricing and the emission abatement strategies are derived using the Pontryagin’s maximum principle. Finally, the numerical experiments are used to explain the results obtained. The results show that companies producing and selling low-carbon products must pay more attention to the amount of carbon emission reduction in their products, and make more efforts to reduce emissions in order to make more profits. Additionally, the parametric analysis shows that expanding market size and reducing inventory depletion can be equally helpful in shortening the sales cycle and boosting profits.</p>","PeriodicalId":50100,"journal":{"name":"Journal of Optimization Theory and Applications","volume":"93 1","pages":""},"PeriodicalIF":1.9,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140579950","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-09DOI: 10.1007/s10957-024-02424-3
Welington de Oliveira, Valentina Sessa, David Sossa
This paper addresses the numerical computation of critical angles between two convex cones in Euclidean spaces. We present a novel approach to computing these critical angles by reducing the problem to finding stationary points of a fractional programming problem. To efficiently compute these stationary points, we introduce a partial linearization-like algorithm that offers significant computational advantages. Solving a sequence of strictly convex subproblems with straightforward solutions in several settings gives the proposed algorithm high computational efficiency while delivering reliable results: our theoretical analysis demonstrates that the proposed algorithm asymptotically computes critical angles. Numerical experiments validate the efficiency of our approach, even when dealing with problems of relatively large dimensions: only a few seconds are necessary to compute critical angles between different types of cones in spaces of dimension 1000.
{"title":"Computing Critical Angles Between Two Convex Cones","authors":"Welington de Oliveira, Valentina Sessa, David Sossa","doi":"10.1007/s10957-024-02424-3","DOIUrl":"https://doi.org/10.1007/s10957-024-02424-3","url":null,"abstract":"<p>This paper addresses the numerical computation of critical angles between two convex cones in Euclidean spaces. We present a novel approach to computing these critical angles by reducing the problem to finding stationary points of a fractional programming problem. To efficiently compute these stationary points, we introduce a partial linearization-like algorithm that offers significant computational advantages. Solving a sequence of strictly convex subproblems with straightforward solutions in several settings gives the proposed algorithm high computational efficiency while delivering reliable results: our theoretical analysis demonstrates that the proposed algorithm asymptotically computes critical angles. Numerical experiments validate the efficiency of our approach, even when dealing with problems of relatively large dimensions: only a few seconds are necessary to compute critical angles between different types of cones in spaces of dimension 1000.</p>","PeriodicalId":50100,"journal":{"name":"Journal of Optimization Theory and Applications","volume":"1 1","pages":""},"PeriodicalIF":1.9,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140579804","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-08DOI: 10.1007/s10957-024-02427-0
C. Yalçın Kaya, Lyle Noakes, Erchuan Zhang
Riemannian cubics in tension are critical points of the linear combination of two objective functionals, namely the squared (L^2) norms of the velocity and acceleration of a curve on a Riemannian manifold. We view this variational problem of finding a curve as a multi-objective optimization problem and construct the Pareto fronts for some given instances where the manifold is a sphere and where the manifold is a torus. The Pareto front for the curves on the torus turns out to be particularly interesting: the front is disconnected and it reveals two distinct Riemannian cubics with the same boundary data, which is the first known nontrivial instance of this kind. We also discuss some convexity conditions involving the Pareto fronts for curves on general Riemannian manifolds.
{"title":"Multi-objective Variational Curves","authors":"C. Yalçın Kaya, Lyle Noakes, Erchuan Zhang","doi":"10.1007/s10957-024-02427-0","DOIUrl":"https://doi.org/10.1007/s10957-024-02427-0","url":null,"abstract":"<p>Riemannian cubics in tension are critical points of the linear combination of two objective functionals, namely the squared <span>(L^2)</span> norms of the velocity and acceleration of a curve on a Riemannian manifold. We view this variational problem of finding a curve as a multi-objective optimization problem and construct the Pareto fronts for some given instances where the manifold is a sphere and where the manifold is a torus. The Pareto front for the curves on the torus turns out to be particularly interesting: the front is disconnected and it reveals two distinct Riemannian cubics with the same boundary data, which is the first known nontrivial instance of this kind. We also discuss some convexity conditions involving the Pareto fronts for curves on general Riemannian manifolds.</p>","PeriodicalId":50100,"journal":{"name":"Journal of Optimization Theory and Applications","volume":"51 1","pages":""},"PeriodicalIF":1.9,"publicationDate":"2024-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140580196","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-07DOI: 10.1007/s10957-024-02413-6
Alberto Domínguez Corella, Nicolai Jork, Šárka Nečasová, John Sebastian H. Simon
This paper focuses on the stability of solutions for a velocity-tracking problem associated with the two-dimensional Navier–Stokes equations. The considered optimal control problem does not possess any regularizer in the cost, and hence bang-bang solutions can be expected. We investigate perturbations that account for uncertainty in the tracking data and the initial condition of the state, and analyze the convergence rate of solutions when the original problem is regularized by the Tikhonov term. The stability analysis relies on the Hölder subregularity of the optimality mapping, which stems from the necessary conditions of the problem.
{"title":"Stability analysis of the Navier–Stokes velocity tracking problem with bang-bang controls","authors":"Alberto Domínguez Corella, Nicolai Jork, Šárka Nečasová, John Sebastian H. Simon","doi":"10.1007/s10957-024-02413-6","DOIUrl":"https://doi.org/10.1007/s10957-024-02413-6","url":null,"abstract":"<p>This paper focuses on the stability of solutions for a velocity-tracking problem associated with the two-dimensional Navier–Stokes equations. The considered optimal control problem does not possess any regularizer in the cost, and hence bang-bang solutions can be expected. We investigate perturbations that account for uncertainty in the tracking data and the initial condition of the state, and analyze the convergence rate of solutions when the original problem is regularized by the Tikhonov term. The stability analysis relies on the Hölder subregularity of the optimality mapping, which stems from the necessary conditions of the problem.</p>","PeriodicalId":50100,"journal":{"name":"Journal of Optimization Theory and Applications","volume":"12 1","pages":""},"PeriodicalIF":1.9,"publicationDate":"2024-04-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140579796","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-30DOI: 10.1007/s10957-024-02412-7
Nikhil Devanathan, Stephen Boyd
In 1963 Boris Polyak suggested a particular step size for gradient descent methods, now known as the Polyak step size, that he later adapted to subgradient methods. The Polyak step size requires knowledge of the optimal value of the minimization problem, which is a strong assumption but one that holds for several important problems. In this paper we extend Polyak’s method to handle constraints and, as a generalization of subgradients, general minorants, which are convex functions that tightly lower bound the objective and constraint functions. We refer to this algorithm as the Polyak Minorant Method (PMM). It is closely related to cutting-plane and bundle methods.
1963 年,鲍里斯-波利克(Boris Polyak)为梯度下降法提出了一种特殊的步长,即现在的波利克步长,后来他又将这种步长应用于子梯度法。波利克步长要求知道最小化问题的最优值,这是一个很强的假设,但对一些重要问题来说是成立的。在本文中,我们对 Polyak 方法进行了扩展,以处理约束条件,以及作为子梯度的一般化,处理一般次梯度,即对目标函数和约束函数进行严格下限的凸函数。我们将这种算法称为波利雅克微分法(PMM)。它与切割平面法和束法密切相关。
{"title":"Polyak Minorant Method for Convex Optimization","authors":"Nikhil Devanathan, Stephen Boyd","doi":"10.1007/s10957-024-02412-7","DOIUrl":"https://doi.org/10.1007/s10957-024-02412-7","url":null,"abstract":"<p>In 1963 Boris Polyak suggested a particular step size for gradient descent methods, now known as the Polyak step size, that he later adapted to subgradient methods. The Polyak step size requires knowledge of the optimal value of the minimization problem, which is a strong assumption but one that holds for several important problems. In this paper we extend Polyak’s method to handle constraints and, as a generalization of subgradients, general minorants, which are convex functions that tightly lower bound the objective and constraint functions. We refer to this algorithm as the Polyak Minorant Method (PMM). It is closely related to cutting-plane and bundle methods.</p>","PeriodicalId":50100,"journal":{"name":"Journal of Optimization Theory and Applications","volume":"94 1","pages":""},"PeriodicalIF":1.9,"publicationDate":"2024-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140579973","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}