In inverse optimization problems, we are given a feasible solution to an underlying optimization problem, and the goal is to modify the problem parameters so that the given input solution becomes optimal. In the minimum-cost setting, the underlying optimization problem is endowed with a linear cost function, and the goal is to modify the costs by a small deviation vector so that the input solution becomes optimal. The difference between the new and the original cost functions can be measured in several ways. In this paper, we focus on two objectives: the weighted bottleneck Hamming distance and the weighted -norm. We consider a general model in which the coordinates of the deviation vector are required to fall within given lower and upper bounds. For the weighted bottleneck Hamming distance objective, we present a simple, purely combinatorial algorithm that determines an optimal deviation vector in strongly polynomial time. For the weighted -norm objective, we give a min-max characterization for the optimal solution, and provide a pseudo-polynomial algorithm for finding an optimal deviation vector that runs in strongly polynomial time in the case of unit weights. For both objectives, we assume that an algorithm with the same time complexity for solving the underlying combinatorial optimization problem is available.
{"title":"<ArticleTitle xmlns:ns0=\"http://www.w3.org/1998/Math/MathML\">Newton-type algorithms for inverse optimization: weighted bottleneck Hamming distance and <ns0:math><ns0:msub><ns0:mi>ℓ</ns0:mi> <ns0:mi>∞</ns0:mi></ns0:msub> </ns0:math> -norm objectives.","authors":"Kristóf Bérczi, Lydia Mirabel Mendoza-Cadena, Kitti Varga","doi":"10.1007/s11590-024-02183-0","DOIUrl":"https://doi.org/10.1007/s11590-024-02183-0","url":null,"abstract":"<p><p>In inverse optimization problems, we are given a feasible solution to an underlying optimization problem, and the goal is to modify the problem parameters so that the given input solution becomes optimal. In the minimum-cost setting, the underlying optimization problem is endowed with a linear cost function, and the goal is to modify the costs by a small deviation vector so that the input solution becomes optimal. The difference between the new and the original cost functions can be measured in several ways. In this paper, we focus on two objectives: the weighted bottleneck Hamming distance and the weighted <math><msub><mi>ℓ</mi> <mi>∞</mi></msub> </math> -norm. We consider a general model in which the coordinates of the deviation vector are required to fall within given lower and upper bounds. For the weighted bottleneck Hamming distance objective, we present a simple, purely combinatorial algorithm that determines an optimal deviation vector in strongly polynomial time. For the weighted <math><msub><mi>ℓ</mi> <mi>∞</mi></msub> </math> -norm objective, we give a min-max characterization for the optimal solution, and provide a pseudo-polynomial algorithm for finding an optimal deviation vector that runs in strongly polynomial time in the case of unit weights. For both objectives, we assume that an algorithm with the same time complexity for solving the underlying combinatorial optimization problem is available.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"19 8","pages":"1665-1690"},"PeriodicalIF":1.1,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12532653/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145330675","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-01-01Epub Date: 2025-03-03DOI: 10.1007/s11590-025-02192-7
Kay Barshad, Yair Censor, Walaa Moursi, Tyler Weames, Henry Wolkowicz
We study a method that involves principally convex feasibility-seeking and makes secondary efforts of objective function value reduction. This is the well-known superiorization method (SM), where the iterates of an asymptotically convergent iterative feasibility-seeking algorithm are perturbed by objective function nonascent steps. We investigate the question under what conditions a sequence generated by an SM algorithm asymptotically converges to a feasible point whose objective function value is superior (meaning smaller or equal) to that of a feasible point reached by the corresponding unperturbed one (i.e., the exactly same feasibility-seeking algorithm that the SM algorithm employs.) This question is yet only partially answered in the literature. We present a condition under which an SM algorithm that uses negative gradient descent steps in its perturbations fails to yield such a superior outcome. The significance of the discovery of this "negative condition" is that it necessitates that the inverse of this condition will have to be assumed to hold in any future guarantee result for the SM. The condition is important for practitioners who use the SM because it is avoidable in experimental work with the SM, thus increasing the success rate of the method in real-world applications.
{"title":"A necessary condition for the guarantee of the superiorization method.","authors":"Kay Barshad, Yair Censor, Walaa Moursi, Tyler Weames, Henry Wolkowicz","doi":"10.1007/s11590-025-02192-7","DOIUrl":"10.1007/s11590-025-02192-7","url":null,"abstract":"<p><p>We study a method that involves principally convex feasibility-seeking and makes secondary efforts of objective function value reduction. This is the well-known superiorization method (SM), where the iterates of an asymptotically convergent iterative feasibility-seeking algorithm are perturbed by objective function nonascent steps. We investigate the question under what conditions a sequence generated by an SM algorithm asymptotically converges to a feasible point whose objective function value is superior (meaning smaller or equal) to that of a feasible point reached by the corresponding unperturbed one (i.e., the exactly same feasibility-seeking algorithm that the SM algorithm employs.) This question is yet only partially answered in the literature. We present a condition under which an SM algorithm that uses negative gradient descent steps in its perturbations fails to yield such a superior outcome. The significance of the discovery of this \"negative condition\" is that it necessitates that the inverse of this condition will have to be assumed to hold in any future guarantee result for the SM. The condition is important for practitioners who use the SM because it is avoidable in experimental work with the SM, thus increasing the success rate of the method in real-world applications.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"19 8","pages":"1699-1714"},"PeriodicalIF":1.1,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12532677/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145330642","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-13DOI: 10.1007/s11590-024-02138-5
Enrique Gerstl, Gur Mosheiov
We study a single machine scheduling problem with generalized due-dates and general position-dependent job processing times. The objective function is minimum number of tardy jobs. The problem is proved to be NP-hard in the strong sense. We introduce an efficient algorithm that solves medium size problems in reasonable running time. A simple and efficient heuristic is also introduced, which obtained the optimal solution in the vast majority of our tests.
{"title":"Minimizing the number of tardy jobs with generalized due-dates and position-dependent processing times","authors":"Enrique Gerstl, Gur Mosheiov","doi":"10.1007/s11590-024-02138-5","DOIUrl":"https://doi.org/10.1007/s11590-024-02138-5","url":null,"abstract":"<p>We study a single machine scheduling problem with generalized due-dates and general position-dependent job processing times. The objective function is minimum number of tardy jobs. The problem is proved to be NP-hard in the strong sense. We introduce an efficient algorithm that solves medium size problems in reasonable running time. A simple and efficient heuristic is also introduced, which obtained the optimal solution in the vast majority of our tests.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"35 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142183237","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-27DOI: 10.1007/s11590-024-02146-5
Shi-Liang Wu, Mei Long, Cui-Xia Li
In this paper, we consider the numerical solution of a class of vertical tensor complementarity problems. By reformulating the involved vertical tensor complementarity problem (VTCP) as an equivalent projected fixed point equation, together with the relevant properties of the power Lipschitz tensor, we propose a projected fixed point method for the involved VTCP, and discuss its convergence properties. Numerical experiments are given to illustrate the effectiveness of the proposed method.
{"title":"A projected fixed point method for a class of vertical tensor complementarity problems","authors":"Shi-Liang Wu, Mei Long, Cui-Xia Li","doi":"10.1007/s11590-024-02146-5","DOIUrl":"https://doi.org/10.1007/s11590-024-02146-5","url":null,"abstract":"<p>In this paper, we consider the numerical solution of a class of vertical tensor complementarity problems. By reformulating the involved vertical tensor complementarity problem (VTCP) as an equivalent projected fixed point equation, together with the relevant properties of the power Lipschitz tensor, we propose a projected fixed point method for the involved VTCP, and discuss its convergence properties. Numerical experiments are given to illustrate the effectiveness of the proposed method.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"59 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-08-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142183238","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-22DOI: 10.1007/s11590-024-02145-6
Bin Deng, Weidong Li
We are given a set of indivisible goods and a set of m agents where each good has a size and each agent has an additive valuation function and a budget. The budgeted maximin share allocation problem is to find a feasible allocation such that the size of the bundle allocated to each agent does not exceed its budget, and the minimum ratio of the valuation and the maximin share (MMS) value of any agent is as large as possible, where the MMS value of each agent is that he can achieve by dividing the goods into n bundles, and receiving his least desirable bundle. In this paper, we prove the existence of (frac{n}{3n-2})-approximate MMS allocation and give an instance which does not have a ((frac{3}{4}+epsilon ))-approximate MMS allocation, for any (epsilon in (0,1)). Moreover, we provide a polynomial time algorithm to find an (frac{1}{3})-MMS allocation, and prove that there is no ((frac{2}{3} + epsilon ))-approximate algorithm in polynomial time unless (mathcal{P}=mathcal{N}mathcal{P}).
我们给定了一组不可分割的商品和一组 m 个代理人,其中每个商品都有一个大小,每个代理人都有一个加法估值函数和一个预算。预算最大化份额分配问题就是要找到一个可行的分配方案,使得分配给每个代理人的捆绑物的大小不超过其预算,并且任何代理人的估值和最大化份额(MMS)值的最小比率尽可能大,其中每个代理人的最大化份额值是他将货物分成 n 个捆绑物,并得到他最不想要的捆绑物所能达到的。在本文中,我们证明了 (frac{n}{3n-2})-approximate MMS allocation 的存在,并给出了一个对于任意 (epsilon in (0,1)),不存在 ((frac{3}{4}+epsilon ))-approximate MMS allocation 的实例。此外,我们还提供了一种多项式时间算法来找到一个(frac{1}{3})-MMS分配,并证明除非(mathcal{P}=mathcal{N}mathcal{P}),否则不存在多项式时间内的((frac{2}{3}+epsilon ))-近似算法。
{"title":"The budgeted maximin share allocation problem","authors":"Bin Deng, Weidong Li","doi":"10.1007/s11590-024-02145-6","DOIUrl":"https://doi.org/10.1007/s11590-024-02145-6","url":null,"abstract":"<p>We are given a set of indivisible goods and a set of <i>m</i> agents where each good has a size and each agent has an additive valuation function and a budget. The budgeted maximin share allocation problem is to find a feasible allocation such that the size of the bundle allocated to each agent does not exceed its budget, and the minimum ratio of the valuation and the maximin share (MMS) value of any agent is as large as possible, where the MMS value of each agent is that he can achieve by dividing the goods into <i>n</i> bundles, and receiving his least desirable bundle. In this paper, we prove the existence of <span>(frac{n}{3n-2})</span>-approximate MMS allocation and give an instance which does not have a (<span>(frac{3}{4}+epsilon )</span>)-approximate MMS allocation, for any <span>(epsilon in (0,1))</span>. Moreover, we provide a polynomial time algorithm to find an <span>(frac{1}{3})</span>-MMS allocation, and prove that there is no <span>((frac{2}{3} + epsilon ))</span>-approximate algorithm in polynomial time unless <span>(mathcal{P}=mathcal{N}mathcal{P})</span>.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"19 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142183239","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-20DOI: 10.1007/s11590-024-02144-7
Truong Minh Tuyen, Nguyen Song Ha
We introduce and study some explicit iterative algorithms for solving the system of split equality problems in Hilbert spaces. The strong convergence of the proposed algorithms is proved by using some milder conditions put on control parameters than the one used in Tuyen (Bull Malays Math Sci Soc 46:44, 2023).
我们介绍并研究了一些求解希尔伯特空间中分裂相等问题系统的显式迭代算法。通过使用比 Tuyen(Bull Malays Math Sci Soc 46:44, 2023)中使用的控制参数更温和的条件,证明了所提算法的强收敛性。
{"title":"Explicit iterative algorithms for solving the split equality problems in Hilbert spaces","authors":"Truong Minh Tuyen, Nguyen Song Ha","doi":"10.1007/s11590-024-02144-7","DOIUrl":"https://doi.org/10.1007/s11590-024-02144-7","url":null,"abstract":"<p>We introduce and study some explicit iterative algorithms for solving the system of split equality problems in Hilbert spaces. The strong convergence of the proposed algorithms is proved by using some milder conditions put on control parameters than the one used in Tuyen (Bull Malays Math Sci Soc 46:44, 2023).\u0000</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"6 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142183153","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-08DOI: 10.1007/s11590-024-02142-9
Zhihan Zhu, Yanhao Zhang, Yong Xia
We establish the optimal ergodic convergence rate for the classical projected subgradient method with time-varying step-sizes. This convergence rate remains the same even if we slightly increase the weight of the most recent points, thereby relaxing the ergodic sense.
{"title":"Convergence rate of projected subgradient method with time-varying step-sizes","authors":"Zhihan Zhu, Yanhao Zhang, Yong Xia","doi":"10.1007/s11590-024-02142-9","DOIUrl":"https://doi.org/10.1007/s11590-024-02142-9","url":null,"abstract":"<p>We establish the optimal ergodic convergence rate for the classical projected subgradient method with time-varying step-sizes. This convergence rate remains the same even if we slightly increase the weight of the most recent points, thereby relaxing the ergodic sense.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"120 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141968822","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-30DOI: 10.1007/s11590-024-02141-w
G. Battur, S. Batbileg, R. Enkhbat
This work deals with a Berge equilibrium problem (BEP). Based on the existence results of Berge equilibrium of Nessah et al. (Appl Math Lett 20(8):926–932. 2007), we consider BEP with concave objective functions. The existence of Berge equilibrium has been proven. BEP reduces to nonsmooth optimization problem. Then using a regularized function, we reduce a problem of finding Berge equilibrium to a nonconvex global optimization problem with a differentiable objective functions. The later allows to apply optimization methods and algorithms to solve the original problem.
本研究涉及 Berge 平衡问题 (BEP)。基于 Nessah 等人的 Berge 平衡存在性结果(Appl Math Lett 20(8):926-932.2007)的基础上,我们考虑了具有凹目标函数的 BEP。Berge 平衡的存在已被证明。BEP 简化为非光滑优化问题。然后,利用正则化函数,我们将寻找 Berge 平衡的问题简化为具有可微目标函数的非凸全局优化问题。之后,我们就可以应用优化方法和算法来解决原始问题。
{"title":"A global optimization approach to Berge equilibrium based on a regularized function","authors":"G. Battur, S. Batbileg, R. Enkhbat","doi":"10.1007/s11590-024-02141-w","DOIUrl":"https://doi.org/10.1007/s11590-024-02141-w","url":null,"abstract":"<p>This work deals with a Berge equilibrium problem (BEP). Based on the existence results of Berge equilibrium of Nessah et al. (Appl Math Lett 20(8):926–932. 2007), we consider BEP with concave objective functions. The existence of Berge equilibrium has been proven. BEP reduces to nonsmooth optimization problem. Then using a regularized function, we reduce a problem of finding Berge equilibrium to a nonconvex global optimization problem with a differentiable objective functions. The later allows to apply optimization methods and algorithms to solve the original problem.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"213 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-07-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141870253","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-24DOI: 10.1007/s11590-024-02139-4
Tiantian Fan, Jingyong Tang
The weighted linear complementarity problem (wLCP) can be used for modelling a large class of problems from science and economics. In this paper, we introduce a new class of weighted complementarity functions and show that it is continuously differentiable everywhere. By using this function, we propose a two steps Levenberg–Marquardt-type method to solve the wLCP. Under suitable conditions, we prove that the proposed method is globally convergent and the generated iteration sequence is bounded. Moreover, we show that the proposed method has cubic convergence rate under the local error bound condition. Some numerical results are reported.
{"title":"New smooth weighted complementarity functions and a cubically convergent method for wLCP","authors":"Tiantian Fan, Jingyong Tang","doi":"10.1007/s11590-024-02139-4","DOIUrl":"https://doi.org/10.1007/s11590-024-02139-4","url":null,"abstract":"<p>The weighted linear complementarity problem (wLCP) can be used for modelling a large class of problems from science and economics. In this paper, we introduce a new class of weighted complementarity functions and show that it is continuously differentiable everywhere. By using this function, we propose a two steps Levenberg–Marquardt-type method to solve the wLCP. Under suitable conditions, we prove that the proposed method is globally convergent and the generated iteration sequence is bounded. Moreover, we show that the proposed method has cubic convergence rate under the local error bound condition. Some numerical results are reported.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"57 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141778035","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-18DOI: 10.1007/s11590-024-02140-x
Ruixue Zhao
In this paper, we present a Levenberg–Marquardt algorithm for nonlinear equations, where the exact Jacobians are unavailable, but their model approximations can be built in some random fashion. We study the complexity of the algorithm and show that the upper bound of the iteration numbers in expectation to obtain a first order stationary point is (O(epsilon ^{-3})).
{"title":"Complexity bound of a Levenberg–Marquardt algorithm based on probabilistic Jacobian models","authors":"Ruixue Zhao","doi":"10.1007/s11590-024-02140-x","DOIUrl":"https://doi.org/10.1007/s11590-024-02140-x","url":null,"abstract":"<p>In this paper, we present a Levenberg–Marquardt algorithm for nonlinear equations, where the exact Jacobians are unavailable, but their model approximations can be built in some random fashion. We study the complexity of the algorithm and show that the upper bound of the iteration numbers in expectation to obtain a first order stationary point is <span>(O(epsilon ^{-3}))</span>.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"15 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141746065","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}