Pub Date : 2024-03-26DOI: 10.1007/s11590-024-02106-z
Jun Wang, Qiang Ma
In this paper, we propose a novel variant of the alternating direction method of multipliers (ADMM) approach for solving minimization of the rate of (ell _{1}) and (ell _{2}) norms for sparse recovery. We first transform the quotient of (ell _{1}) and (ell _{2}) norms into a new function of the separable variables using the least squares minimum norm solution of the linear system of equations. Subsequently, we employ the augmented Lagrangian function to formulate the corresponding ADMM method with a dynamically adjustable parameter. Additionally, each of its subproblems possesses a unique global minimum. Finally, we present some numerical experiments to demonstrate our results.
{"title":"On the implementation of ADMM with dynamically configurable parameter for the separable $$ell _{1}/ell _{2}$$ minimization","authors":"Jun Wang, Qiang Ma","doi":"10.1007/s11590-024-02106-z","DOIUrl":"https://doi.org/10.1007/s11590-024-02106-z","url":null,"abstract":"<p>In this paper, we propose a novel variant of the alternating direction method of multipliers (ADMM) approach for solving minimization of the rate of <span>(ell _{1})</span> and <span>(ell _{2})</span> norms for sparse recovery. We first transform the quotient of <span>(ell _{1})</span> and <span>(ell _{2})</span> norms into a new function of the separable variables using the least squares minimum norm solution of the linear system of equations. Subsequently, we employ the augmented Lagrangian function to formulate the corresponding ADMM method with a dynamically adjustable parameter. Additionally, each of its subproblems possesses a unique global minimum. Finally, we present some numerical experiments to demonstrate our results.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140316529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-24DOI: 10.1007/s11590-024-02104-1
Mengxiao Fan, Jicheng Li
In this paper, we develop two kinds of the projected iterative methods for the tensor complementarity problem combining two different splitting frameworks. The first method is on the basis of tensor splitting, and its monotone convergence is proved based on the ({mathcal{L}})-tensor and the strongly monotone tensor. Meanwhile, an alternative method is in the light of majorization matrix splitting, the convergence of which is given and is particularly analyzed based on the power Lipschitz tensor. Some numerical examples are tested to illustrate the proposed methods.
{"title":"The projected splitting iterative methods based on tensor splitting and its majorization matrix splitting for the tensor complementarity problem","authors":"Mengxiao Fan, Jicheng Li","doi":"10.1007/s11590-024-02104-1","DOIUrl":"https://doi.org/10.1007/s11590-024-02104-1","url":null,"abstract":"<p>In this paper, we develop two kinds of the projected iterative methods for the tensor complementarity problem combining two different splitting frameworks. The first method is on the basis of tensor splitting, and its monotone convergence is proved based on the <span>({mathcal{L}})</span>-tensor and the strongly monotone tensor. Meanwhile, an alternative method is in the light of majorization matrix splitting, the convergence of which is given and is particularly analyzed based on the power Lipschitz tensor. Some numerical examples are tested to illustrate the proposed methods.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-03-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140300401","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-21DOI: 10.1007/s11590-024-02105-0
Abstract
Subdifferentials (in the sense of convex analysis) of matrix-valued functions defined on (mathbb {R}^d) that are convex with respect to the Löwner partial order can have a complicated structure and might be very difficult to compute even in simple cases. The aim of this paper is to study subdifferential calculus for such functions and properties of their subdifferentials. We show that many standard results from convex analysis no longer hold true in the matrix-valued case. For example, in this case the subdifferential of the sum is not equal to the sum of subdifferentials, the Clarke subdifferential is not equal to the subdifferential in the sense of convex analysis, etc. Nonetheless, it is possible to provide simple rules for computing nonempty subsets of subdifferentials (in particular, individual subgradients) of convex matrix-valued functions in the general case and to completely describe subdifferentials of such functions defined on the real line. As a by-product of our analysis, we derive some interesting properties of convex matrix-valued functions, e.g. we show that if such function is nonsmooth, then its diagonal elements must be nonsmooth as well.
{"title":"Subdifferentials of convex matrix-valued functions","authors":"","doi":"10.1007/s11590-024-02105-0","DOIUrl":"https://doi.org/10.1007/s11590-024-02105-0","url":null,"abstract":"<h3>Abstract</h3> <p>Subdifferentials (in the sense of convex analysis) of matrix-valued functions defined on <span> <span>(mathbb {R}^d)</span> </span> that are convex with respect to the Löwner partial order can have a complicated structure and might be very difficult to compute even in simple cases. The aim of this paper is to study subdifferential calculus for such functions and properties of their subdifferentials. We show that many standard results from convex analysis no longer hold true in the matrix-valued case. For example, in this case the subdifferential of the sum is not equal to the sum of subdifferentials, the Clarke subdifferential is not equal to the subdifferential in the sense of convex analysis, etc. Nonetheless, it is possible to provide simple rules for computing nonempty subsets of subdifferentials (in particular, individual subgradients) of convex matrix-valued functions in the general case and to completely describe subdifferentials of such functions defined on the real line. As a by-product of our analysis, we derive some interesting properties of convex matrix-valued functions, e.g. we show that if such function is nonsmooth, then its diagonal elements must be nonsmooth as well.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140199501","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-18DOI: 10.1007/s11590-024-02100-5
Alvaro Sierra-Altamiranda, Hadi Charkhgard, Iman Dayarian, Ali Eshragh, Sorna Javadi
In this paper, we investigate the possibility of improving the performance of multi-objective optimization solution approaches using machine learning techniques. Specifically, we focus on multi-objective binary linear programs and employ one of the most effective and recently developed criterion space search algorithms, the so-called KSA, during our study. This algorithm computes all nondominated points of a problem with p objectives by searching on a projected criterion space, i.e., a ((p-1))-dimensional criterion apace. We present an effective and fast learning approach to identify on which projected space the KSA should work. We also present several generic features/variables that can be used in machine learning techniques for identifying the best projected space. Finally, we present an effective bi-objective optimization-based heuristic for selecting the subset of the features to overcome the issue of overfitting in learning. Through an extensive computational study over 2000 instances of tri-objective knapsack and assignment problems, we demonstrate that an improvement of up to 18% in time can be achieved by the proposed learning method compared to a random selection of the projected space. To show that the performance of our algorithm is not limited to instances of knapsack and assignment problems with three objective functions, we also report similar performance results when the proposed learning approach is used for solving random binary integer program instances with four objective functions.
{"title":"Learning to project in a criterion space search algorithm: an application to multi-objective binary linear programming","authors":"Alvaro Sierra-Altamiranda, Hadi Charkhgard, Iman Dayarian, Ali Eshragh, Sorna Javadi","doi":"10.1007/s11590-024-02100-5","DOIUrl":"https://doi.org/10.1007/s11590-024-02100-5","url":null,"abstract":"<p>In this paper, we investigate the possibility of improving the performance of multi-objective optimization solution approaches using machine learning techniques. Specifically, we focus on multi-objective binary linear programs and employ one of the most effective and recently developed criterion space search algorithms, the so-called KSA, during our study. This algorithm computes all nondominated points of a problem with <i>p</i> objectives by searching on a projected criterion space, i.e., a <span>((p-1))</span>-dimensional criterion apace. We present an effective and fast learning approach to identify on which projected space the KSA should work. We also present several generic features/variables that can be used in machine learning techniques for identifying the best projected space. Finally, we present an effective bi-objective optimization-based heuristic for selecting the subset of the features to overcome the issue of overfitting in learning. Through an extensive computational study over 2000 instances of tri-objective knapsack and assignment problems, we demonstrate that an improvement of up to 18% in time can be achieved by the proposed learning method compared to a random selection of the projected space. To show that the performance of our algorithm is not limited to instances of knapsack and assignment problems with three objective functions, we also report similar performance results when the proposed learning approach is used for solving random binary integer program instances with four objective functions.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-03-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140171236","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-12DOI: 10.1007/s11590-024-02103-2
Xiao-bo Li, Kai Tu, Jian Lu
In this paper, we propose the DFP algorithm with inexact line search for unconstrained optimization problems on Riemannian manifolds. Under some reasonable conditions, the global convergence result is established and the superlinear local convergence rate of the DFP algorithm is proved on Riemannian manifolds. The preliminary computational experiment is also reported to illustrate the effectiveness of the DFP algorithm.
{"title":"Convergence analysis of the DFP algorithm for unconstrained optimization problems on Riemannian manifolds","authors":"Xiao-bo Li, Kai Tu, Jian Lu","doi":"10.1007/s11590-024-02103-2","DOIUrl":"https://doi.org/10.1007/s11590-024-02103-2","url":null,"abstract":"<p>In this paper, we propose the DFP algorithm with inexact line search for unconstrained optimization problems on Riemannian manifolds. Under some reasonable conditions, the global convergence result is established and the superlinear local convergence rate of the DFP algorithm is proved on Riemannian manifolds. The preliminary computational experiment is also reported to illustrate the effectiveness of the DFP algorithm.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-03-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140114921","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-11DOI: 10.1007/s11590-024-02102-3
Manzhan Gu, Weitao Yang, Peihai Liu
This paper studies the stochastic single-machine scheduling problem with workload-dependent maintenance activities, in which the processing times of all jobs are independently subject to a common discrete distribution, and the aim is to find the optimal policy so as to minimize the expected total discounted holding cost. Based on the definition of Markov process, for each of the two cases with the discount rate being zero or a positive number, we present two dynamic programming algorithms to produce the optimal static policy and the optimal dynamic policy, respectively.
{"title":"Stochastic single-machine scheduling with workload-dependent maintenance activities","authors":"Manzhan Gu, Weitao Yang, Peihai Liu","doi":"10.1007/s11590-024-02102-3","DOIUrl":"https://doi.org/10.1007/s11590-024-02102-3","url":null,"abstract":"<p>This paper studies the stochastic single-machine scheduling problem with workload-dependent maintenance activities, in which the processing times of all jobs are independently subject to a common discrete distribution, and the aim is to find the optimal policy so as to minimize the expected total discounted holding cost. Based on the definition of Markov process, for each of the two cases with the discount rate being zero or a positive number, we present two dynamic programming algorithms to produce the optimal static policy and the optimal dynamic policy, respectively.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-03-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140099891","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-05DOI: 10.1007/s11590-023-02093-7
Abstract
We consider adjustable robust linear complementarity problems and extend the results of Biefel et al. (SIAM J Optim 32:152–172, 2022) towards convex and compact uncertainty sets. Moreover, for the case of polyhedral uncertainty sets, we prove that computing an adjustable robust solution of a given linear complementarity problem is equivalent to solving a properly chosen mixed-integer linear feasibility problem.
{"title":"On the relation between affinely adjustable robust linear complementarity and mixed-integer linear feasibility problems","authors":"","doi":"10.1007/s11590-023-02093-7","DOIUrl":"https://doi.org/10.1007/s11590-023-02093-7","url":null,"abstract":"<h3>Abstract</h3> <p>We consider adjustable robust linear complementarity problems and extend the results of Biefel et al. (SIAM J Optim 32:152–172, 2022) towards convex and compact uncertainty sets. Moreover, for the case of polyhedral uncertainty sets, we prove that computing an adjustable robust solution of a given linear complementarity problem is equivalent to solving a properly chosen mixed-integer linear feasibility problem.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140035192","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-04DOI: 10.1007/s11590-024-02097-x
Queenie Yingkun Huang, Vaithilingam Jeyakumar
We present a generalized Farkas’ Lemma for an inequality system involving distributions. This lemma establishes an equivalence between an infinite-dimensional system of moment inequalities and a semi-definite system, assuming that the support for the distributions is a spectrahedron. To the best of our knowledge, it is the first extension of Farkas’ Lemma to the distributional paradigm. Applying the new Lemma, we then establish no-gap duality results between a class of moment optimization problems and numerically tractable semi-definite programs.
{"title":"A distributional Farkas’ lemma and moment optimization problems with no-gap dual semi-definite programs","authors":"Queenie Yingkun Huang, Vaithilingam Jeyakumar","doi":"10.1007/s11590-024-02097-x","DOIUrl":"https://doi.org/10.1007/s11590-024-02097-x","url":null,"abstract":"<p>We present a generalized Farkas’ Lemma for an inequality system involving distributions. This lemma establishes an equivalence between an infinite-dimensional system of moment inequalities and a semi-definite system, assuming that the support for the distributions is a spectrahedron. To the best of our knowledge, it is the first extension of Farkas’ Lemma to the distributional paradigm. Applying the new Lemma, we then establish no-gap duality results between a class of moment optimization problems and numerically tractable semi-definite programs.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140034923","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-03DOI: 10.1007/s11590-024-02096-y
M. Locatelli
In this paper we address the multiple obnoxious facility location problem. In this problem p facilities need to be spread within the unit square in such a way that they are far enough from each other and that their minimal distance from n communities, with known positions within the unit square, is maximized. The problem has a combinatorial component, related to the key observation made in Drezner (Omega 87:105–116, 2019) about the role played by Voronoi points. We propose a new approach, which exploits both the combinatorial component of the problem and, through continuous local optimizations, also its continuous component. We also propose techniques to limit the impact on computation times of the number n of communities. The approach turns out to be quite competitive and is able to return 24 new best known solutions with respect to the best results reported in Kalczynski (Optim Lett 16:1153–1166, 2022).
在本文中,我们要解决的是多个令人讨厌的设施位置问题。在这个问题中,需要将 p 个设施分布在单位正方形内,使它们之间的距离足够远,并使它们与单位正方形内已知位置的 n 个社区的最小距离最大化。该问题具有组合成分,与 Drezner(Omega 87:105-116,2019 年)中关于 Voronoi 点作用的重要观点有关。我们提出了一种新方法,既利用了问题的组合成分,又通过连续局部优化利用了问题的连续成分。我们还提出了限制群落数 n 对计算时间影响的技术。事实证明,这种方法很有竞争力,与卡尔琴斯基(Optim Lett 16:1153-1166, 2022)报告的最佳结果相比,它能返回 24 个新的已知最佳解。
{"title":"A new approach to the multiple obnoxious facility location problem based on combinatorial and continuous tools","authors":"M. Locatelli","doi":"10.1007/s11590-024-02096-y","DOIUrl":"https://doi.org/10.1007/s11590-024-02096-y","url":null,"abstract":"<p>In this paper we address the multiple obnoxious facility location problem. In this problem <i>p</i> facilities need to be spread within the unit square in such a way that they are far enough from each other and that their minimal distance from <i>n</i> communities, with known positions within the unit square, is maximized. The problem has a combinatorial component, related to the key observation made in Drezner (Omega 87:105–116, 2019) about the role played by Voronoi points. We propose a new approach, which exploits both the combinatorial component of the problem and, through continuous local optimizations, also its continuous component. We also propose techniques to limit the impact on computation times of the number <i>n</i> of communities. The approach turns out to be quite competitive and is able to return 24 new best known solutions with respect to the best results reported in Kalczynski (Optim Lett 16:1153–1166, 2022).</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-03-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140034857","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-02-27DOI: 10.1007/s11590-024-02098-w
Lam Quoc Anh, Nguyen Huu Danh, Pham Thanh Duoc
This paper aims to study the stability in the sense of Hausdorff continuity of solution maps to equilibrium problems without assuming the solid condition of ordered cones. We first propose a generalized concavity of set-valued maps and discuss its relation with the existing concepts. Then, by using the above property and the continuity of the objective function, sufficient conditions for the Hausdorff continuity of solution maps to scalar equilibrium problems are established. Finally, we utilize the oriented distance function to obtain the Hausdorff continuity of solution maps to set-valued equilibrium problems via the corresponding results of the scalar equilibrium problems.
{"title":"Hausdorff continuity of solution maps to equilibrium problems via the oriented distance function","authors":"Lam Quoc Anh, Nguyen Huu Danh, Pham Thanh Duoc","doi":"10.1007/s11590-024-02098-w","DOIUrl":"https://doi.org/10.1007/s11590-024-02098-w","url":null,"abstract":"<p>This paper aims to study the stability in the sense of Hausdorff continuity of solution maps to equilibrium problems without assuming the solid condition of ordered cones. We first propose a generalized concavity of set-valued maps and discuss its relation with the existing concepts. Then, by using the above property and the continuity of the objective function, sufficient conditions for the Hausdorff continuity of solution maps to scalar equilibrium problems are established. Finally, we utilize the oriented distance function to obtain the Hausdorff continuity of solution maps to set-valued equilibrium problems via the corresponding results of the scalar equilibrium problems.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-02-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139980291","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}