首页 > 最新文献

Optimization Methods and Software最新文献

英文 中文
A Fenchel dual gradient method enabling regularization for nonsmooth distributed optimization over time-varying networks 时变网络非光滑分布优化的正则化Fenchel对偶梯度方法
Pub Date : 2023-03-28 DOI: 10.1080/10556788.2023.2189713
Xuyang Wu, K. C. Sou, Jie Lu
In this paper, we develop a regularized Fenchel dual gradient method (RFDGM), which allows nodes in a time-varying undirected network to find a common decision, in a fully distributed fashion, for minimizing the sum of their local objective functions subject to their local constraints. Different from most existing distributed optimization algorithms that also cope with time-varying networks, RFDGM is able to handle problems with general convex objective functions and distinct local constraints, and still has non-asymptotic convergence results. Specifically, under a standard network connectivity condition, we show that RFDGM is guaranteed to reach ϵ-accuracy in both optimality and feasibility within iterations. Such iteration complexity can be improved to if the local objective functions are strongly convex but not necessarily differentiable. Finally, simulation results demonstrate the competence of RFDGM in practice.
本文提出了一种正则化的Fenchel对偶梯度方法(RFDGM),该方法允许时变无向网络中的节点以完全分布的方式找到一个共同决策,以最小化受局部约束的局部目标函数的和。与现有大多数同样处理时变网络的分布式优化算法不同,RFDGM能够处理具有一般凸目标函数和不同局部约束的问题,并且仍然具有非渐近收敛的结果。具体而言,在标准网络连接条件下,我们证明了RFDGM在迭代内的最优性和可行性都保证达到ϵ-accuracy。如果局部目标函数是强凸的,但不一定是可微的,则可以将迭代复杂度提高到。最后,仿真结果验证了RFDGM在实际应用中的能力。
{"title":"A Fenchel dual gradient method enabling regularization for nonsmooth distributed optimization over time-varying networks","authors":"Xuyang Wu, K. C. Sou, Jie Lu","doi":"10.1080/10556788.2023.2189713","DOIUrl":"https://doi.org/10.1080/10556788.2023.2189713","url":null,"abstract":"In this paper, we develop a regularized Fenchel dual gradient method (RFDGM), which allows nodes in a time-varying undirected network to find a common decision, in a fully distributed fashion, for minimizing the sum of their local objective functions subject to their local constraints. Different from most existing distributed optimization algorithms that also cope with time-varying networks, RFDGM is able to handle problems with general convex objective functions and distinct local constraints, and still has non-asymptotic convergence results. Specifically, under a standard network connectivity condition, we show that RFDGM is guaranteed to reach ϵ-accuracy in both optimality and feasibility within iterations. Such iteration complexity can be improved to if the local objective functions are strongly convex but not necessarily differentiable. Finally, simulation results demonstrate the competence of RFDGM in practice.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"87 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126956561","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Projection onto the exponential cone: a univariate root-finding problem 指数锥上的投影:一个单变量求根问题
Pub Date : 2023-03-28 DOI: 10.1080/10556788.2021.2022147
Henrik A. Friberg
The exponential function and its logarithmic counterpart are essential corner stones of nonlinear mathematical modelling. In this paper, we treat their conic extensions, the exponential cone and the relative entropy cone, in primal, dual and polar form, and show that finding the nearest mapping of a point onto these convex sets all reduce to a single univariate root-finding problem. This leads to a fast projection algorithm shown numerically robust over a wide range of inputs.
指数函数及其对应的对数函数是非线性数学建模的重要基石。在本文中,我们以原始形式、对偶形式和极坐标形式处理它们的圆锥扩展,指数锥和相对熵锥,并证明在这些凸集上寻找点的最近映射都可以归结为一个单变量寻根问题。这导致了一种快速投影算法,在广泛的输入范围内显示出数值上的鲁棒性。
{"title":"Projection onto the exponential cone: a univariate root-finding problem","authors":"Henrik A. Friberg","doi":"10.1080/10556788.2021.2022147","DOIUrl":"https://doi.org/10.1080/10556788.2021.2022147","url":null,"abstract":"The exponential function and its logarithmic counterpart are essential corner stones of nonlinear mathematical modelling. In this paper, we treat their conic extensions, the exponential cone and the relative entropy cone, in primal, dual and polar form, and show that finding the nearest mapping of a point onto these convex sets all reduce to a single univariate root-finding problem. This leads to a fast projection algorithm shown numerically robust over a wide range of inputs.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"85 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124134740","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Efficient second-order optimization with predictions in differential games 微分对策预测的高效二阶优化
Pub Date : 2023-03-28 DOI: 10.1080/10556788.2023.2189715
Deliang Wei, Peng Chen, Fang Li, Xiangyun Zhang
A growing number of training methods for generative adversarial networks (GANs) are differential games. Different from convex optimization problems on single functions, gradient descent on multiple objectives may not converge to stable fixed points (SFPs). In order to improve learning dynamics in such games, many recently proposed methods utilize the second-order information of the game, such as the Hessian matrix. Unfortunately, these methods often suffer from the enormous computational cost of Hessian, which hinders their further applications. In this paper, we present efficient second-order optimization (ESO), in which only a part of Hessian is updated in each iteration, and the algorithm is derived. Furthermore, we give the local convergence of the method under reasonable assumptions. In order to further speed up the training process of GANs, we propose efficient second-order optimization with predictions (ESOP) using a novel accelerator. Basic experiments show that the proposed learning methods are faster than some state-of-art methods in GANs, while applicable to many other n-player differential games with local convergence guarantee.
越来越多的生成对抗网络(GANs)的训练方法是微分博弈。与单函数的凸优化问题不同,多目标的梯度下降问题可能不会收敛到稳定不动点(SFPs)。为了改善这种博弈中的学习动态,许多最近提出的方法利用了博弈的二阶信息,如Hessian矩阵。不幸的是,这些方法经常受到巨大的Hessian计算成本的影响,这阻碍了它们的进一步应用。本文提出了每次迭代只更新一部分Hessian的高效二阶优化算法,并推导了该算法。在合理的假设条件下,给出了该方法的局部收敛性。为了进一步加快gan的训练过程,我们提出了一种新型加速器的高效二阶预测优化算法(ESOP)。基础实验表明,所提出的学习方法比gan中一些最先进的方法更快,同时也适用于许多其他具有局部收敛保证的n人微分博弈。
{"title":"Efficient second-order optimization with predictions in differential games","authors":"Deliang Wei, Peng Chen, Fang Li, Xiangyun Zhang","doi":"10.1080/10556788.2023.2189715","DOIUrl":"https://doi.org/10.1080/10556788.2023.2189715","url":null,"abstract":"A growing number of training methods for generative adversarial networks (GANs) are differential games. Different from convex optimization problems on single functions, gradient descent on multiple objectives may not converge to stable fixed points (SFPs). In order to improve learning dynamics in such games, many recently proposed methods utilize the second-order information of the game, such as the Hessian matrix. Unfortunately, these methods often suffer from the enormous computational cost of Hessian, which hinders their further applications. In this paper, we present efficient second-order optimization (ESO), in which only a part of Hessian is updated in each iteration, and the algorithm is derived. Furthermore, we give the local convergence of the method under reasonable assumptions. In order to further speed up the training process of GANs, we propose efficient second-order optimization with predictions (ESOP) using a novel accelerator. Basic experiments show that the proposed learning methods are faster than some state-of-art methods in GANs, while applicable to many other n-player differential games with local convergence guarantee.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129685614","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Interior point methods for solving Pareto eigenvalue complementarity problems 求解Pareto特征值互补问题的内点法
Pub Date : 2023-01-16 DOI: 10.1080/10556788.2022.2152023
S. Adly, M. Haddou, Manh Hung Le
In this paper, we propose to solve Pareto eigenvalue complementarity problems by using interior-point methods. Precisely, we focus the study on an adaptation of the Mehrotra Predictor Corrector Method (MPCM) and a Non-Parametric Interior Point Method (NPIPM). We compare these two methods with two alternative methods, namely the Lattice Projection Method (LPM) and the Soft Max Method (SM). On a set of data generated from the Matrix Market, the performance profiles highlight the efficiency of MPCM and NPIPM for solving eigenvalue complementarity problems. We also consider an application to a concrete and large size situation corresponding to a geomechanical fracture problem. Finally, we discuss the extension of MPCM and NPIPM methods to solve quadratic pencil eigenvalue problems under conic constraints.
本文提出用内点法求解Pareto特征值互补问题。准确地说,我们重点研究了Mehrotra预测校正法(MPCM)和非参数内点法(NPIPM)的自适应。我们将这两种方法与两种替代方法,即点阵投影法(LPM)和软最大法(SM)进行了比较。在矩阵市场生成的一组数据上,性能概况突出了MPCM和NPIPM在解决特征值互补问题方面的效率。我们还考虑将其应用于与地质力学断裂问题相对应的混凝土和大尺寸情况。最后讨论了MPCM和NPIPM方法在二次约束下的二次铅笔特征值问题的推广。
{"title":"Interior point methods for solving Pareto eigenvalue complementarity problems","authors":"S. Adly, M. Haddou, Manh Hung Le","doi":"10.1080/10556788.2022.2152023","DOIUrl":"https://doi.org/10.1080/10556788.2022.2152023","url":null,"abstract":"In this paper, we propose to solve Pareto eigenvalue complementarity problems by using interior-point methods. Precisely, we focus the study on an adaptation of the Mehrotra Predictor Corrector Method (MPCM) and a Non-Parametric Interior Point Method (NPIPM). We compare these two methods with two alternative methods, namely the Lattice Projection Method (LPM) and the Soft Max Method (SM). On a set of data generated from the Matrix Market, the performance profiles highlight the efficiency of MPCM and NPIPM for solving eigenvalue complementarity problems. We also consider an application to a concrete and large size situation corresponding to a geomechanical fracture problem. Finally, we discuss the extension of MPCM and NPIPM methods to solve quadratic pencil eigenvalue problems under conic constraints.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123640158","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Using general triangle inequalities within quadratic convex reformulation method 利用一般三角不等式在二次凸内重新表述的方法
Pub Date : 2023-01-16 DOI: 10.1080/10556788.2022.2157002
Amélie Lambert
We consider the exact solution of Problem (P) which consists in minimizing a quadratic function subject to quadratic constraints. We start with an explicit description of new general triangle inequalities that are derived from the ranges of the variables of (P). We show that they extend the triangle inequalities, introduced for the binary case, to variables that belong to a generic interval. We also prove that these inequalities cut feasible solutions of McCormick envelopes, and we relate them to the literature. We then introduce (SDP), a strong semidefinite relaxation of (P), that we call ‘Shor's plus RLT plus Triangle’, which includes both the McCormick envelopes and the general triangle inequalities. We further show how to compute a convex relaxation whose optimal value reaches the value of (SDP). In order to handle these inequalities in the solution of (SDP), we solve it by a heuristic that also serves as a separation algorithm. We then solve (P) to global optimality with a branch-and-bound based on . Finally, we show that our method outperforms the compared solvers.
我们考虑了问题(P)的精确解,该问题是在二次约束下最小化一个二次函数。我们首先明确描述了由(P)的变量的范围导出的新的一般三角形不等式。我们证明了它们将为二元情况引入的三角形不等式扩展到属于一般区间的变量。我们还证明了这些不等式切割麦考密克包络的可行解,并将其与文献联系起来。然后,我们引入(P)的强半定松弛(SDP),我们称之为“Shor's + RLT + Triangle”,它包括McCormick包络和一般三角形不等式。我们进一步展示了如何计算一个最优值达到(SDP)的凸松弛。为了处理(SDP)解中的这些不等式,我们用启发式算法求解它,启发式算法也是一种分离算法。然后利用基于的分支定界方法求解(P)至全局最优。最后,我们证明了我们的方法优于比较的求解器。
{"title":"Using general triangle inequalities within quadratic convex reformulation method","authors":"Amélie Lambert","doi":"10.1080/10556788.2022.2157002","DOIUrl":"https://doi.org/10.1080/10556788.2022.2157002","url":null,"abstract":"We consider the exact solution of Problem (P) which consists in minimizing a quadratic function subject to quadratic constraints. We start with an explicit description of new general triangle inequalities that are derived from the ranges of the variables of (P). We show that they extend the triangle inequalities, introduced for the binary case, to variables that belong to a generic interval. We also prove that these inequalities cut feasible solutions of McCormick envelopes, and we relate them to the literature. We then introduce (SDP), a strong semidefinite relaxation of (P), that we call ‘Shor's plus RLT plus Triangle’, which includes both the McCormick envelopes and the general triangle inequalities. We further show how to compute a convex relaxation whose optimal value reaches the value of (SDP). In order to handle these inequalities in the solution of (SDP), we solve it by a heuristic that also serves as a separation algorithm. We then solve (P) to global optimality with a branch-and-bound based on . Finally, we show that our method outperforms the compared solvers.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"63 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128543266","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A linear-time algorithm for finding Hamiltonian cycles in rectangular grid graphs with two rectangular holes 在有两个矩形孔的矩形网格图中寻找哈密顿循环的线性时间算法
Pub Date : 2023-01-05 DOI: 10.1080/10556788.2022.2157001
Fatemeh Keshavarz-Kohjerdi, A. Bagheri
The Hamiltonian cycle problem is one of the most important problems in graph theory that has many applications. This problem is NP-complete for general grid graphs. For solid grid graphs, there are polynomial-time algorithms. Existence of polynomial-time algorithms for grid graphs with few holes has been asked in the literature. In this paper, we give a linear-time algorithm for rectangular grid graphs with two rectangular holes. This extends the previous result for rectangular grid graphs with one rectangular hole. We first present the forbidden conditions in which there is no Hamiltonian cycle for any grid graphs, including rectangular grid graphs with rectangular holes. We then show that if these forbidden conditions do not hold, then there exists a Hamiltonian cycle. The proof is constructive, therefore, it gives an algorithm. An application of the problem is in off-line robot exploration.
哈密顿循环问题是图论中应用广泛的重要问题之一。对于一般网格图,这个问题是np完全的。对于实体网格图,有多项式时间算法。文献中提出了求解少孔网格图的多项式时间算法的存在性问题。本文给出了两个矩形孔的矩形网格图的线性时间算法。这扩展了前面的矩形网格图的结果,其中有一个矩形孔。首先给出了所有网格图(包括带矩形孔的矩形网格图)不存在哈密顿循环的禁忌条件。然后我们证明,如果这些禁忌条件不成立,那么就存在一个哈密顿循环。该证明是建设性的,因此给出了一个算法。该问题的一个应用是离线机器人探索。
{"title":"A linear-time algorithm for finding Hamiltonian cycles in rectangular grid graphs with two rectangular holes","authors":"Fatemeh Keshavarz-Kohjerdi, A. Bagheri","doi":"10.1080/10556788.2022.2157001","DOIUrl":"https://doi.org/10.1080/10556788.2022.2157001","url":null,"abstract":"The Hamiltonian cycle problem is one of the most important problems in graph theory that has many applications. This problem is NP-complete for general grid graphs. For solid grid graphs, there are polynomial-time algorithms. Existence of polynomial-time algorithms for grid graphs with few holes has been asked in the literature. In this paper, we give a linear-time algorithm for rectangular grid graphs with two rectangular holes. This extends the previous result for rectangular grid graphs with one rectangular hole. We first present the forbidden conditions in which there is no Hamiltonian cycle for any grid graphs, including rectangular grid graphs with rectangular holes. We then show that if these forbidden conditions do not hold, then there exists a Hamiltonian cycle. The proof is constructive, therefore, it gives an algorithm. An application of the problem is in off-line robot exploration.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131374964","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exact penalization for cardinality and rank-constrained optimization problems via partial regularization 通过部分正则化对基数和秩约束优化问题进行精确惩罚
Pub Date : 2023-01-05 DOI: 10.1080/10556788.2022.2142583
Zhaosong Lu, Xiaorui Li, S. Xiang
In this paper, we consider a class of constrained optimization problems whose constraints involve a cardinality or rank constraint. The penalty formulation based on a partial regularization has recently been promoted in the literature to approximate these problems, which usually outperforms the penalty formulation based on a full regularization in terms of solution quality. Nevertheless, the relation between the penalty formulation with a partial regularizer and the original problem was not much studied yet. Under some suitable assumptions, we show that the penalty formulation based on a partial regularization is an exact reformulation of the original problem in the sense that they both share the same global minimizers. We also show that a local minimizer of the original problem is that of the penalty reformulation. These results provide some theoretical justification for the often-observed superior performance of the penalty model based on a partial regularizer over a corresponding full regularizer.
本文考虑了一类约束条件包含基数约束或秩约束的约束优化问题。基于部分正则化的惩罚公式最近在文献中得到推广,以近似这些问题,在解质量方面通常优于基于完全正则化的惩罚公式。然而,带部分正则化子的罚式与原问题之间的关系还没有得到充分的研究。在一些适当的假设下,我们证明了基于部分正则化的惩罚公式是原始问题的精确重新表述,因为它们具有相同的全局最小值。我们还证明了原问题的局部极小值是惩罚重构问题的局部极小值。这些结果为基于部分正则化器的惩罚模型优于相应的完全正则化器的性能提供了一些理论依据。
{"title":"Exact penalization for cardinality and rank-constrained optimization problems via partial regularization","authors":"Zhaosong Lu, Xiaorui Li, S. Xiang","doi":"10.1080/10556788.2022.2142583","DOIUrl":"https://doi.org/10.1080/10556788.2022.2142583","url":null,"abstract":"In this paper, we consider a class of constrained optimization problems whose constraints involve a cardinality or rank constraint. The penalty formulation based on a partial regularization has recently been promoted in the literature to approximate these problems, which usually outperforms the penalty formulation based on a full regularization in terms of solution quality. Nevertheless, the relation between the penalty formulation with a partial regularizer and the original problem was not much studied yet. Under some suitable assumptions, we show that the penalty formulation based on a partial regularization is an exact reformulation of the original problem in the sense that they both share the same global minimizers. We also show that a local minimizer of the original problem is that of the penalty reformulation. These results provide some theoretical justification for the often-observed superior performance of the penalty model based on a partial regularizer over a corresponding full regularizer.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129081174","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A descent family of the spectral Hestenes–Stiefel method by considering the quasi-Newton method 考虑拟牛顿方法的谱Hestenes-Stiefel方法的下降族
Pub Date : 2023-01-05 DOI: 10.1080/10556788.2022.2142585
Maryam Khoshsimaye-Bargard, A. Ashrafi
The prominent computational features of the Hestenes–Stiefel parameter as one of the fundamental members of conjugate gradient methods have attracted the attention of many researchers. Yet, as a weak stop, it lacks global convergence for general functions. To overcome this defect, a family of spectral version of Hestenes–Stiefel conjugate gradient methods is introduced. To compute the spectral parameter, in the account of worthy properties of quasi-Newton methods, we minimize the distance between the search direction matrix of the spectral conjugate gradient method and the BFGS (Broyden–Fletcher–Goldfarb–Shanno) update. To achieve sufficient descent property, the search direction is projected in the orthogonal subspace to the gradient of the objective function. The convergence analysis of the proposed method is carried out under standard assumptions for general functions. Finally, the practical merits of the suggested method are investigated by numerical experiments on a set of CUTEr test functions using the Dolan–Moré performance profile. The results show the computational efficiency of the proposed method.
Hestenes-Stiefel参数作为共轭梯度法的基本成员之一,其突出的计算特性引起了许多研究者的关注。然而,作为一个弱停站,它缺乏对一般函数的全局收敛性。为了克服这一缺陷,引入了一种谱版Hestenes-Stiefel共轭梯度方法。为了计算谱参数,考虑到准牛顿方法的优点,最小化谱共轭梯度法的搜索方向矩阵与BFGS (Broyden-Fletcher-Goldfarb-Shanno)更新之间的距离。为了获得充分的下降特性,将搜索方向在正交子空间中投影到目标函数的梯度上。在一般函数的标准假设下,对所提方法进行了收敛性分析。最后,利用dolan - mor性能曲线对一组CUTEr测试函数进行了数值实验,研究了该方法的实际优点。实验结果表明了该方法的计算效率。
{"title":"A descent family of the spectral Hestenes–Stiefel method by considering the quasi-Newton method","authors":"Maryam Khoshsimaye-Bargard, A. Ashrafi","doi":"10.1080/10556788.2022.2142585","DOIUrl":"https://doi.org/10.1080/10556788.2022.2142585","url":null,"abstract":"The prominent computational features of the Hestenes–Stiefel parameter as one of the fundamental members of conjugate gradient methods have attracted the attention of many researchers. Yet, as a weak stop, it lacks global convergence for general functions. To overcome this defect, a family of spectral version of Hestenes–Stiefel conjugate gradient methods is introduced. To compute the spectral parameter, in the account of worthy properties of quasi-Newton methods, we minimize the distance between the search direction matrix of the spectral conjugate gradient method and the BFGS (Broyden–Fletcher–Goldfarb–Shanno) update. To achieve sufficient descent property, the search direction is projected in the orthogonal subspace to the gradient of the objective function. The convergence analysis of the proposed method is carried out under standard assumptions for general functions. Finally, the practical merits of the suggested method are investigated by numerical experiments on a set of CUTEr test functions using the Dolan–Moré performance profile. The results show the computational efficiency of the proposed method.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"64 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131574033","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A generic optimization framework for resilient systems 弹性系统的通用优化框架
Pub Date : 2023-01-04 DOI: 10.1080/10556788.2022.2142581
M. Pfetsch, Andreas Schmitt
ABSTRACT This paper addresses the optimal design of resilient systems, in which components can fail. The system can react to failures and its behaviour is described by general mixed integer nonlinear programs, which allows for applications to many (technical) systems. This then leads to a three-level optimization problem. The upper level designs the system minimizing a cost function, the middle level represents worst-case failures of components, i.e. interdicts the system, and the lowest level operates the remaining system. We describe new inequalities that characterize the set of resilient solutions and allow to reformulate the problem. The reformulation can then be solved using a nested branch-and-cut approach. We discuss several improvements, for instance, by taking symmetry into account and strengthening cuts. We demonstrate the effectiveness of our implementation on the optimal design of water networks, robust trusses, and gas networks, in comparison to an approach in which the failure scenarios are directly included into the model.
本文讨论了弹性系统的优化设计,其中组件可能失效。系统可以对故障作出反应,其行为由一般的混合整数非线性程序描述,这允许应用于许多(技术)系统。这就导致了一个三级优化问题。上层设计使成本函数最小化的系统,中层表示组件的最坏情况故障,即阻断系统,最低层运行剩余的系统。我们描述了具有弹性解决方案特征的新不等式,并允许重新制定问题。然后可以使用嵌套的分支-切断方法来解决重新表述。我们讨论了一些改进,例如,通过考虑对称性和加强切割。与直接将故障场景包含在模型中的方法相比,我们证明了我们在水网络、坚固桁架和燃气网络优化设计方面的实现的有效性。
{"title":"A generic optimization framework for resilient systems","authors":"M. Pfetsch, Andreas Schmitt","doi":"10.1080/10556788.2022.2142581","DOIUrl":"https://doi.org/10.1080/10556788.2022.2142581","url":null,"abstract":"ABSTRACT This paper addresses the optimal design of resilient systems, in which components can fail. The system can react to failures and its behaviour is described by general mixed integer nonlinear programs, which allows for applications to many (technical) systems. This then leads to a three-level optimization problem. The upper level designs the system minimizing a cost function, the middle level represents worst-case failures of components, i.e. interdicts the system, and the lowest level operates the remaining system. We describe new inequalities that characterize the set of resilient solutions and allow to reformulate the problem. The reformulation can then be solved using a nested branch-and-cut approach. We discuss several improvements, for instance, by taking symmetry into account and strengthening cuts. We demonstrate the effectiveness of our implementation on the optimal design of water networks, robust trusses, and gas networks, in comparison to an approach in which the failure scenarios are directly included into the model.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"83 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126405604","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
On the implementation of a quasi-Newton interior-point method for PDE-constrained optimization using finite element discretizations 基于有限元离散化的准牛顿内点法求解pde约束优化问题
Pub Date : 2022-11-21 DOI: 10.1080/10556788.2022.2117354
C. Petra, M. Troya, N. Petra, Youngsoo Choi, G. Oxberry, D. Tortorelli
ABSTRACT We present a quasi-Newton interior-point method appropriate for optimization problems with pointwise inequality constraints in Hilbert function spaces. Among others, our methodology applies to optimization problems constrained by partial differential equations (PDEs) that are posed in a reduced-space formulation and have bounds or inequality constraints on the optimized parameter function. We first introduce the formalization of an infinite-dimensional quasi-Newton interior-point algorithm using secant BFGS updates and then proceed to derive a discretized interior-point method capable of working with a wide range of finite element discretization schemes. We also discuss and address mathematical and software interface issues that are pervasive when existing off-the-shelf PDE solvers are to be used with off-the-shelf nonlinear programming solvers. Finally, we elaborate on the numerical and parallel computing strengths and limitations of the proposed methodology on several classes of PDE-constrained problems.
摘要提出了一种适用于Hilbert函数空间中具有点向不等式约束的优化问题的拟牛顿内点法。其中,我们的方法适用于由偏微分方程(PDEs)约束的优化问题,这些偏微分方程(PDEs)以约化空间形式提出,并且对优化参数函数具有边界或不等式约束。我们首先介绍了一种使用割线BFGS更新的无限维准牛顿内点算法的形式化,然后推导了一种能够与广泛的有限元离散化方案一起工作的离散化内点方法。我们还讨论并解决了当现有的现成的PDE求解器与现成的非线性规划求解器一起使用时普遍存在的数学和软件接口问题。最后,我们详细阐述了所提出的方法在若干类pde约束问题上的数值和并行计算优势和局限性。
{"title":"On the implementation of a quasi-Newton interior-point method for PDE-constrained optimization using finite element discretizations","authors":"C. Petra, M. Troya, N. Petra, Youngsoo Choi, G. Oxberry, D. Tortorelli","doi":"10.1080/10556788.2022.2117354","DOIUrl":"https://doi.org/10.1080/10556788.2022.2117354","url":null,"abstract":"ABSTRACT We present a quasi-Newton interior-point method appropriate for optimization problems with pointwise inequality constraints in Hilbert function spaces. Among others, our methodology applies to optimization problems constrained by partial differential equations (PDEs) that are posed in a reduced-space formulation and have bounds or inequality constraints on the optimized parameter function. We first introduce the formalization of an infinite-dimensional quasi-Newton interior-point algorithm using secant BFGS updates and then proceed to derive a discretized interior-point method capable of working with a wide range of finite element discretization schemes. We also discuss and address mathematical and software interface issues that are pervasive when existing off-the-shelf PDE solvers are to be used with off-the-shelf nonlinear programming solvers. Finally, we elaborate on the numerical and parallel computing strengths and limitations of the proposed methodology on several classes of PDE-constrained problems.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123843479","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Optimization Methods and Software
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1