首页 > 最新文献

Optimization Methods and Software最新文献

英文 中文
Steering exact penalty DCA for nonsmooth DC optimisation problems with equality and inequality constraints 具有等式和不等式约束的非光滑DC优化问题的转向精确惩罚DCA
Pub Date : 2021-07-03 DOI: 10.1080/10556788.2023.2167992
M. V. Dolgopolik
We propose and study a version of the DCA (Difference-of-Convex functions Algorithm) using the penalty function for solving nonsmooth DC optimisation problems with nonsmooth DC equality and inequality constraints. The method employs an adaptive penalty updating strategy to improve its performance. This strategy is based on the so-called steering exact penalty methodology and relies on solving some auxiliary convex subproblems to determine a suitable value of the penalty parameter. We present a detailed convergence analysis of the method and illustrate its practical performance by applying the method to two nonsmooth discrete optimal control problem.
我们提出并研究了一种使用罚函数求解具有非光滑DC等式和不等式约束的非光滑DC优化问题的DCA(凸函数差分算法)版本。该方法采用自适应惩罚更新策略来提高其性能。该策略基于所谓的转向精确惩罚方法,并依赖于求解一些辅助凸子问题来确定合适的惩罚参数值。对该方法进行了详细的收敛性分析,并通过对两个非光滑离散最优控制问题的应用说明了该方法的实际性能。
{"title":"Steering exact penalty DCA for nonsmooth DC optimisation problems with equality and inequality constraints","authors":"M. V. Dolgopolik","doi":"10.1080/10556788.2023.2167992","DOIUrl":"https://doi.org/10.1080/10556788.2023.2167992","url":null,"abstract":"We propose and study a version of the DCA (Difference-of-Convex functions Algorithm) using the penalty function for solving nonsmooth DC optimisation problems with nonsmooth DC equality and inequality constraints. The method employs an adaptive penalty updating strategy to improve its performance. This strategy is based on the so-called steering exact penalty methodology and relies on solving some auxiliary convex subproblems to determine a suitable value of the penalty parameter. We present a detailed convergence analysis of the method and illustrate its practical performance by applying the method to two nonsmooth discrete optimal control problem.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"72 4","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"113954717","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Conic optimization-based algorithms for nonnegative matrix factorization 基于二次优化的非负矩阵分解算法
Pub Date : 2021-05-28 DOI: 10.1080/10556788.2023.2189714
V. Leplat, Y. Nesterov, Nicolas Gillis, F. Glineur
Nonnegative matrix factorization is the following problem: given a nonnegative input matrix V and a factorization rank K, compute two nonnegative matrices, W with K columns and H with K rows, such that WH approximates V as well as possible. In this paper, we propose two new approaches for computing high-quality NMF solutions using conic optimization. These approaches rely on the same two steps. First, we reformulate NMF as minimizing a concave function over a product of convex cones – one approach is based on the exponential cone and the other on the second-order cone. Then, we solve these reformulations iteratively: at each step, we minimize exactly, over the feasible set, a majorization of the objective functions obtained via linearization at the current iterate. Hence these subproblems are convex conic programs and can be solved efficiently using dedicated algorithms. We prove that our approaches reach a stationary point with an accuracy decreasing as , where i denotes the iteration number. To the best of our knowledge, our analysis is the first to provide a convergence rate to stationary points for NMF. Furthermore, in the particular cases of rank-1 factorizations (i.e. K = 1), we show that one of our formulations can be expressed as a convex optimization problem, implying that optimal rank-1 approximations can be computed efficiently. Finally, we show on several numerical examples that our approaches are able to frequently compute exact NMFs (i.e. with V = WH) and compete favourably with the state of the art.
非负矩阵分解是这样一个问题:给定一个非负输入矩阵V和一个分解秩K,计算两个非负矩阵,W有K列,H有K行,使得WH尽可能接近V。在本文中,我们提出了两种使用二次优化计算高质量NMF解的新方法。这些方法依赖于相同的两个步骤。首先,我们将NMF重新表述为在凸锥的乘积上最小化凹函数-一种方法基于指数锥,另一种方法基于二阶锥。然后,我们迭代地求解这些重新表述:在每一步,我们在可行集上精确地最小化,在当前迭代中通过线性化获得的目标函数的多数化。因此,这些子问题是凸二次规划,可以用专用算法有效地求解。我们证明了我们的方法到达一个平稳点,其精度递减为,其中i表示迭代次数。据我们所知,我们的分析是第一个提供NMF到平稳点的收敛率的分析。此外,在rank-1分解(即K = 1)的特殊情况下,我们证明了我们的一个公式可以表示为凸优化问题,这意味着最优rank-1近似可以有效地计算。最后,我们通过几个数值例子表明,我们的方法能够经常计算精确的nmf(即V = WH),并与最先进的技术竞争。
{"title":"Conic optimization-based algorithms for nonnegative matrix factorization","authors":"V. Leplat, Y. Nesterov, Nicolas Gillis, F. Glineur","doi":"10.1080/10556788.2023.2189714","DOIUrl":"https://doi.org/10.1080/10556788.2023.2189714","url":null,"abstract":"Nonnegative matrix factorization is the following problem: given a nonnegative input matrix V and a factorization rank K, compute two nonnegative matrices, W with K columns and H with K rows, such that WH approximates V as well as possible. In this paper, we propose two new approaches for computing high-quality NMF solutions using conic optimization. These approaches rely on the same two steps. First, we reformulate NMF as minimizing a concave function over a product of convex cones – one approach is based on the exponential cone and the other on the second-order cone. Then, we solve these reformulations iteratively: at each step, we minimize exactly, over the feasible set, a majorization of the objective functions obtained via linearization at the current iterate. Hence these subproblems are convex conic programs and can be solved efficiently using dedicated algorithms. We prove that our approaches reach a stationary point with an accuracy decreasing as , where i denotes the iteration number. To the best of our knowledge, our analysis is the first to provide a convergence rate to stationary points for NMF. Furthermore, in the particular cases of rank-1 factorizations (i.e. K = 1), we show that one of our formulations can be expressed as a convex optimization problem, implying that optimal rank-1 approximations can be computed efficiently. Finally, we show on several numerical examples that our approaches are able to frequently compute exact NMFs (i.e. with V = WH) and compete favourably with the state of the art.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115748319","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An incremental descent method for multi-objective optimization 多目标优化的增量下降法
Pub Date : 2021-05-25 DOI: 10.1080/10556788.2022.2124989
I. F. D. Oliveira, R. Takahashi
ABSTRACT Multi-objective steepest descent, under the assumption of lower-bounded objective functions with L-Lipschitz continuous gradients, requires gradient and function computations to produce a measure of proximity to critical conditions akin to in the single-objective setting, where m is the number of objectives considered. We reduce this to with a multi-objective incremental approach that has a computational cost that does not grow with the number of objective functions m.
在具有L-Lipschitz连续梯度的下界目标函数的假设下,多目标最陡下降需要梯度和函数计算来产生类似于单目标设置的接近临界条件的度量,其中m是考虑的目标数。我们用一种多目标增量方法来减少这种情况,这种方法的计算成本不会随着目标函数m的数量而增加。
{"title":"An incremental descent method for multi-objective optimization","authors":"I. F. D. Oliveira, R. Takahashi","doi":"10.1080/10556788.2022.2124989","DOIUrl":"https://doi.org/10.1080/10556788.2022.2124989","url":null,"abstract":"ABSTRACT Multi-objective steepest descent, under the assumption of lower-bounded objective functions with L-Lipschitz continuous gradients, requires gradient and function computations to produce a measure of proximity to critical conditions akin to in the single-objective setting, where m is the number of objectives considered. We reduce this to with a multi-objective incremental approach that has a computational cost that does not grow with the number of objective functions m.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-05-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126918810","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A majorization penalty method for SVM with sparse constraint 基于稀疏约束的支持向量机的多数化惩罚方法
Pub Date : 2021-05-15 DOI: 10.1080/10556788.2022.2142584
Si-Tong Lu, Qingna Li
Support vector machine (SVM) is an important and fundamental technique in machine learning. Soft-margin SVM models have stronger generalization performance compared with the hard-margin SVM. Most existing works use the hinge-loss function which can be regarded as an upper bound of the 0–1 loss function. However, it cannot explicitly control the number of misclassified samples. In this paper, we use the idea of soft-margin SVM and propose a new SVM model with a sparse constraint. Our model can strictly limit the number of misclassified samples, expressing the soft-margin constraint as a sparse constraint. By constructing a majorization function, a majorization penalty method can be used to solve the sparse-constrained optimization problem. We apply Conjugate-Gradient (CG) method to solve the resulting subproblem. Extensive numerical results demonstrate the impressive performance of the proposed majorization penalty method.
支持向量机(SVM)是机器学习中一项重要的基础技术。与硬边缘支持向量机模型相比,软边缘支持向量机模型具有更强的泛化性能。现有的研究大多采用铰链损失函数,它可以看作是0-1损失函数的上界。然而,它不能明确地控制误分类样本的数量。本文利用软边界支持向量机的思想,提出了一种新的带有稀疏约束的支持向量机模型。我们的模型可以严格限制误分类样本的数量,将软边界约束表示为稀疏约束。通过构造多数化函数,采用多数化惩罚法求解稀疏约束优化问题。我们应用共轭梯度(CG)方法来求解由此产生的子问题。大量的数值结果表明,所提出的多数化惩罚方法具有令人印象深刻的性能。
{"title":"A majorization penalty method for SVM with sparse constraint","authors":"Si-Tong Lu, Qingna Li","doi":"10.1080/10556788.2022.2142584","DOIUrl":"https://doi.org/10.1080/10556788.2022.2142584","url":null,"abstract":"Support vector machine (SVM) is an important and fundamental technique in machine learning. Soft-margin SVM models have stronger generalization performance compared with the hard-margin SVM. Most existing works use the hinge-loss function which can be regarded as an upper bound of the 0–1 loss function. However, it cannot explicitly control the number of misclassified samples. In this paper, we use the idea of soft-margin SVM and propose a new SVM model with a sparse constraint. Our model can strictly limit the number of misclassified samples, expressing the soft-margin constraint as a sparse constraint. By constructing a majorization function, a majorization penalty method can be used to solve the sparse-constrained optimization problem. We apply Conjugate-Gradient (CG) method to solve the resulting subproblem. Extensive numerical results demonstrate the impressive performance of the proposed majorization penalty method.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"57 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131229984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Reflected three-operator splitting method for monotone inclusion problem 单调包含问题的反射三算子分裂方法
Pub Date : 2021-05-12 DOI: 10.1080/10556788.2021.1924715
O. Iyiola, C. Enyi, Y. Shehu
In this paper, we consider reflected three-operator splitting methods for monotone inclusion problems in real Hilbert spaces. To do this, we first obtain weak convergence analysis and nonasymptotic convergence rate of the reflected Krasnosel'skiĭ-Mann iteration for finding a fixed point of nonexpansive mapping in real Hilbert spaces under some seemingly easy to implement conditions on the iterative parameters. We then apply our results to three-operator splitting for the monotone inclusion problem and consequently obtain the corresponding convergence analysis. Furthermore, we derive reflected primal-dual algorithms for highly structured monotone inclusion problems. Some numerical implementations are drawn from splitting methods to support the theoretical analysis.
本文研究了实数Hilbert空间中单调包含问题的反射三算子分裂方法。为此,在一些看似容易实现的迭代参数条件下,我们首先得到了在实数Hilbert空间中寻找非扩张映射不动点的反射Krasnosel'skiĭ-Mann迭代的弱收敛分析和非渐近收敛率。然后,我们将我们的结果应用于单调包含问题的三算子分裂,从而得到相应的收敛分析。在此基础上,推导了高结构单调包含问题的反射原对偶算法。通过划分方法给出了一些数值实现来支持理论分析。
{"title":"Reflected three-operator splitting method for monotone inclusion problem","authors":"O. Iyiola, C. Enyi, Y. Shehu","doi":"10.1080/10556788.2021.1924715","DOIUrl":"https://doi.org/10.1080/10556788.2021.1924715","url":null,"abstract":"In this paper, we consider reflected three-operator splitting methods for monotone inclusion problems in real Hilbert spaces. To do this, we first obtain weak convergence analysis and nonasymptotic convergence rate of the reflected Krasnosel'skiĭ-Mann iteration for finding a fixed point of nonexpansive mapping in real Hilbert spaces under some seemingly easy to implement conditions on the iterative parameters. We then apply our results to three-operator splitting for the monotone inclusion problem and consequently obtain the corresponding convergence analysis. Furthermore, we derive reflected primal-dual algorithms for highly structured monotone inclusion problems. Some numerical implementations are drawn from splitting methods to support the theoretical analysis.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-05-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124782867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Operator splitting for adaptive radiation therapy with nonlinear health dynamics 具有非线性健康动力学的自适应放射治疗算子分裂
Pub Date : 2021-05-04 DOI: 10.1080/10556788.2022.2078824
A. Fu, L. Xing, Stephen P. Boyd
ABSTRACT We present an optimization-based approach to radiation treatment planning over time. Our approach formulates treatment planning as an optimal control problem with nonlinear patient health dynamics derived from the standard linear-quadratic cell survival model. As the formulation is nonconvex, we propose a method for obtaining an approximate solution by solving a sequence of convex optimization problems. This method is fast, efficient, and robust to model error, adapting readily to changes in the patient's health between treatment sessions. Moreover, we show that it can be combined with the operator splitting method ADMM to produce an algorithm that is highly scalable and can handle large clinical cases. We introduce an open-source Python implementation of our algorithm, AdaRad, and demonstrate its performance on several examples.
我们提出了一种基于优化的放射治疗计划方法。我们的方法将治疗计划作为一个最优控制问题,其非线性患者健康动力学来源于标准线性二次细胞生存模型。由于该公式是非凸的,我们提出了一种通过求解一系列凸优化问题来获得近似解的方法。该方法快速、有效,对模型误差具有鲁棒性,易于适应治疗期间患者健康状况的变化。此外,我们表明,它可以与算子分割方法ADMM相结合,产生一个高度可扩展的算法,可以处理大型临床病例。我们介绍了算法的开源Python实现AdaRad,并通过几个示例演示了其性能。
{"title":"Operator splitting for adaptive radiation therapy with nonlinear health dynamics","authors":"A. Fu, L. Xing, Stephen P. Boyd","doi":"10.1080/10556788.2022.2078824","DOIUrl":"https://doi.org/10.1080/10556788.2022.2078824","url":null,"abstract":"ABSTRACT We present an optimization-based approach to radiation treatment planning over time. Our approach formulates treatment planning as an optimal control problem with nonlinear patient health dynamics derived from the standard linear-quadratic cell survival model. As the formulation is nonconvex, we propose a method for obtaining an approximate solution by solving a sequence of convex optimization problems. This method is fast, efficient, and robust to model error, adapting readily to changes in the patient's health between treatment sessions. Moreover, we show that it can be combined with the operator splitting method ADMM to produce an algorithm that is highly scalable and can handle large clinical cases. We introduce an open-source Python implementation of our algorithm, AdaRad, and demonstrate its performance on several examples.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123129233","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An inertial subgradient extragradient algorithm with adaptive stepsizes for variational inequality problems 变分不等式问题的一种自适应步长惯性次梯度外聚算法
Pub Date : 2021-04-26 DOI: 10.1080/10556788.2021.1910946
Xiaokai Chang, Sanyang Liu, Zhao Deng, Suoping Li
In this paper, we introduce an efficient subgradient extragradient (SE) based method for solving variational inequality problems with monotone operator in Hilbert space. In many existing SE methods, two values of operator are needed over each iteration and the Lipschitz constant of the operator or linesearch is required for estimating step sizes, which are usually not practical and expensive. To overcome these drawbacks, we present an inertial SE based algorithm with adaptive step sizes, estimated by using an approximation of the local Lipschitz constant without running a linesearch. Each iteration of the method only requires a projection on the feasible set and a value of the operator. The numerical experiments illustrate the efficiency of the proposed algorithm.
本文介绍了一种有效的基于次梯度外梯度(SE)的方法,用于求解Hilbert空间中单调算子的变分不等式问题。在现有的许多SE方法中,每次迭代都需要两个算子值,并且需要算子的Lipschitz常数或直线研究来估计步长,这通常是不实用且昂贵的。为了克服这些缺点,我们提出了一种基于惯性SE的自适应步长算法,该算法通过使用局部Lipschitz常数的近似值来估计,而无需进行直线研究。该方法的每次迭代只需要在可行集上的一个投影和算子的一个值。数值实验验证了该算法的有效性。
{"title":"An inertial subgradient extragradient algorithm with adaptive stepsizes for variational inequality problems","authors":"Xiaokai Chang, Sanyang Liu, Zhao Deng, Suoping Li","doi":"10.1080/10556788.2021.1910946","DOIUrl":"https://doi.org/10.1080/10556788.2021.1910946","url":null,"abstract":"In this paper, we introduce an efficient subgradient extragradient (SE) based method for solving variational inequality problems with monotone operator in Hilbert space. In many existing SE methods, two values of operator are needed over each iteration and the Lipschitz constant of the operator or linesearch is required for estimating step sizes, which are usually not practical and expensive. To overcome these drawbacks, we present an inertial SE based algorithm with adaptive step sizes, estimated by using an approximation of the local Lipschitz constant without running a linesearch. Each iteration of the method only requires a projection on the feasible set and a value of the operator. The numerical experiments illustrate the efficiency of the proposed algorithm.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-04-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131098613","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
A competitive inexact nonmonotone filter SQP method: convergence analysis and numerical results 一种竞争非精确非单调滤波SQP方法:收敛分析及数值结果
Pub Date : 2021-04-15 DOI: 10.1080/10556788.2021.1913155
Hani Ahmadzadeh, N. Mahdavi-Amiri
We propose an inexact nonmonotone successive quadratic programming (SQP) algorithm for solving nonlinear programming problems with equality constraints and bounded variables. Regarding the value of the current feasibility violation and the minimum value of its linear approximation over a trust region, several scenarios are envisaged. In one scenario, a possible infeasible stationary point is detected. In other scenarios, the search direction is computed using an inexact (truncated) solution of a feasible strictly convex quadratic program (QP). The search direction is shown to be a descent direction for the objective function or the feasibility violation in the feasible or infeasible iterations, respectively. A new penalty parameter updating formula is proposed to turn the search direction into a descent direction for an -penalty function. In certain iterations, an accelerator direction is developed to obtain a superlinear local convergence rate of the algorithm. Using a nonmonotone filter strategy, the global convergence of the algorithm and a superlinear local rate of convergence are guaranteed. The main advantage of the algorithm is that the global convergence of the algorithm is established using inexact solutions of the QPs. Furthermore, the use of inexact solutions instead of exact solutions of the subproblems enhances the robustness and efficiency of the algorithm. The algorithm is implemented using MATLAB and the program is tested on a wide range of test problems from the CUTEst library. Comparison of the obtained numerical results with those obtained by testing some similar SQP algorithms affirms the efficiency and robustness of the proposed algorithm.
提出了一种求解具有等式约束和有界变量的非线性规划问题的非精确非单调连续二次规划(SQP)算法。关于当前可行性违例值及其在信任区域上的线性近似值的最小值,设想了几种情况。在一种情况下,检测到一个可能的不可行的平稳点。在其他情况下,搜索方向是使用可行严格凸二次规划(QP)的不精确(截断)解计算的。在可行迭代和不可行的迭代中,搜索方向分别为目标函数的下降方向和可行违背方向。提出了一种新的惩罚参数更新公式,将非惩罚函数的搜索方向转化为下降方向。在一定的迭代中,建立了加速方向,得到了算法的超线性局部收敛速率。采用非单调滤波策略,保证了算法的全局收敛性和超线性局部收敛速度。该算法的主要优点是利用qp的不精确解建立了算法的全局收敛性。此外,使用非精确解代替子问题的精确解,提高了算法的鲁棒性和效率。该算法使用MATLAB实现,并在CUTEst库中对程序进行了广泛的测试问题测试。将所得到的数值结果与一些类似SQP算法的测试结果进行了比较,验证了所提算法的有效性和鲁棒性。
{"title":"A competitive inexact nonmonotone filter SQP method: convergence analysis and numerical results","authors":"Hani Ahmadzadeh, N. Mahdavi-Amiri","doi":"10.1080/10556788.2021.1913155","DOIUrl":"https://doi.org/10.1080/10556788.2021.1913155","url":null,"abstract":"We propose an inexact nonmonotone successive quadratic programming (SQP) algorithm for solving nonlinear programming problems with equality constraints and bounded variables. Regarding the value of the current feasibility violation and the minimum value of its linear approximation over a trust region, several scenarios are envisaged. In one scenario, a possible infeasible stationary point is detected. In other scenarios, the search direction is computed using an inexact (truncated) solution of a feasible strictly convex quadratic program (QP). The search direction is shown to be a descent direction for the objective function or the feasibility violation in the feasible or infeasible iterations, respectively. A new penalty parameter updating formula is proposed to turn the search direction into a descent direction for an -penalty function. In certain iterations, an accelerator direction is developed to obtain a superlinear local convergence rate of the algorithm. Using a nonmonotone filter strategy, the global convergence of the algorithm and a superlinear local rate of convergence are guaranteed. The main advantage of the algorithm is that the global convergence of the algorithm is established using inexact solutions of the QPs. Furthermore, the use of inexact solutions instead of exact solutions of the subproblems enhances the robustness and efficiency of the algorithm. The algorithm is implemented using MATLAB and the program is tested on a wide range of test problems from the CUTEst library. Comparison of the obtained numerical results with those obtained by testing some similar SQP algorithms affirms the efficiency and robustness of the proposed algorithm.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"57 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115218093","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
A globally convergent regularized interior point method for constrained optimization 约束优化的全局收敛正则内点法
Pub Date : 2021-04-05 DOI: 10.1080/10556788.2021.1908283
Songqiang Qiu
This paper proposes a globally convergent regularized interior point method that involves a specifically designed regularization strategy for constrained optimization. The main concept of the proposed algorithm is that when a proper regularization parameter is selected, the direction obtained from the regularized barrier equation is a descent direction for either the objective function or constraint violation. Accordingly, by embedding a flexible strategy of choosing a regularization parameter in a trust-funnel-like interior point scheme, we propose the new algorithm. Global convergence under the mild assumptions of relaxed constant rank constraint qualification (RCRCQ) and local consistency of the linearized active and equality constraints is shown. Preliminary numerical experiments are conducted, and the results are encouraging.
本文提出了一种全局收敛的正则化内点法,该方法包含了一种特殊设计的正则化策略,用于约束优化。该算法的主要思想是,当选择合适的正则化参数时,由正则化障碍方程得到的方向是目标函数或约束违反的下降方向。为此,在类信任漏斗内点格式中嵌入一种灵活的正则化参数选择策略,提出了一种新的算法。给出了在松弛常秩约束条件(RCRCQ)和线性化主动约束与等式约束局部一致性的温和假设下的全局收敛性。进行了初步的数值实验,结果令人鼓舞。
{"title":"A globally convergent regularized interior point method for constrained optimization","authors":"Songqiang Qiu","doi":"10.1080/10556788.2021.1908283","DOIUrl":"https://doi.org/10.1080/10556788.2021.1908283","url":null,"abstract":"This paper proposes a globally convergent regularized interior point method that involves a specifically designed regularization strategy for constrained optimization. The main concept of the proposed algorithm is that when a proper regularization parameter is selected, the direction obtained from the regularized barrier equation is a descent direction for either the objective function or constraint violation. Accordingly, by embedding a flexible strategy of choosing a regularization parameter in a trust-funnel-like interior point scheme, we propose the new algorithm. Global convergence under the mild assumptions of relaxed constant rank constraint qualification (RCRCQ) and local consistency of the linearized active and equality constraints is shown. Preliminary numerical experiments are conducted, and the results are encouraging.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-04-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130244307","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A primer on the application of neural networks to covering array generation 介绍神经网络在覆盖阵列生成中的应用
Pub Date : 2021-04-05 DOI: 10.1080/10556788.2021.1907384
Ludwig Kampel, Michael Wagner, I. Kotsireas, D. Simos
In the past, combinatorial structures have been used only to tune parameters of neural networks. In this work, we employ neural networks in the form of Boltzmann machines and Hopfield networks for the construction of a specific class of combinatorial designs, namely covering arrays (CAs). In past works, these neural networks were successfully used to solve set cover instances. For the construction of CAs, we consider the corresponding set cover instances and use neural networks to solve such instances. We adapt existing algorithms for solving general set cover instances, which are based on Boltzmann machines and Hopfield networks and apply them for CA construction. Furthermore, for the algorithm based on Boltzmann machines, we consider newly designed versions, where we deploy structural changes of the underlying Boltzmann machine, adding a feedback loop. Additionally, one variant of this algorithm employs learning techniques based on neural networks to adjust the various connections encountered in the graph representing the considered set cover instances. Culminating in a comprehensive experimental evaluation, our work presents the first study of applications of neural networks in the field of covering array generation and related discrete structures and may act as a guideline for future investigations.
过去,组合结构仅用于神经网络的参数调整。在这项工作中,我们采用玻尔兹曼机和Hopfield网络形式的神经网络来构建一类特定的组合设计,即覆盖阵列(CAs)。在过去的工作中,这些神经网络被成功地用于求解集合覆盖实例。对于ca的构造,我们考虑了相应的集合覆盖实例,并使用神经网络求解这些实例。我们采用了现有的基于Boltzmann机和Hopfield网络的求解一般集覆盖实例的算法,并将其应用于CA的构建。此外,对于基于玻尔兹曼机的算法,我们考虑了新设计的版本,其中我们部署了底层玻尔兹曼机的结构变化,增加了反馈回路。此外,该算法的一个变体采用基于神经网络的学习技术来调整表示考虑的集合覆盖实例的图中遇到的各种连接。在全面的实验评估中,我们的工作首次提出了神经网络在覆盖阵列生成和相关离散结构领域的应用研究,并可能作为未来研究的指导方针。
{"title":"A primer on the application of neural networks to covering array generation","authors":"Ludwig Kampel, Michael Wagner, I. Kotsireas, D. Simos","doi":"10.1080/10556788.2021.1907384","DOIUrl":"https://doi.org/10.1080/10556788.2021.1907384","url":null,"abstract":"In the past, combinatorial structures have been used only to tune parameters of neural networks. In this work, we employ neural networks in the form of Boltzmann machines and Hopfield networks for the construction of a specific class of combinatorial designs, namely covering arrays (CAs). In past works, these neural networks were successfully used to solve set cover instances. For the construction of CAs, we consider the corresponding set cover instances and use neural networks to solve such instances. We adapt existing algorithms for solving general set cover instances, which are based on Boltzmann machines and Hopfield networks and apply them for CA construction. Furthermore, for the algorithm based on Boltzmann machines, we consider newly designed versions, where we deploy structural changes of the underlying Boltzmann machine, adding a feedback loop. Additionally, one variant of this algorithm employs learning techniques based on neural networks to adjust the various connections encountered in the graph representing the considered set cover instances. Culminating in a comprehensive experimental evaluation, our work presents the first study of applications of neural networks in the field of covering array generation and related discrete structures and may act as a guideline for future investigations.","PeriodicalId":124811,"journal":{"name":"Optimization Methods and Software","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-04-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126629151","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Optimization Methods and Software
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1