首页 > 最新文献

Journal of Global Optimization最新文献

英文 中文
Distributed accelerated gradient methods with restart under quadratic growth condition 二次增长条件下带重启的分布式加速梯度方法
IF 1.8 3区 数学 Q1 Mathematics Pub Date : 2024-04-24 DOI: 10.1007/s10898-024-01395-z
Chhavi Sharma, Vishnu Narayanan, P. Balamurugan

We consider solving convex problems satisfying quadratic growth condition (QGC) over a distributed setting with no central server. Such problems are popular in distributed machine learning applications. When QGC growth parameter c is known, we propose distributed accelerated gradient methods with restarts, named PDACA and DACA respectively for constrained and unconstrained settings. In practical problems when c is unavailable, we design mPDACA and mDACA methods respectively for constrained and unconstrained settings, where novel distributed mechanisms are proposed to update the estimates of growth parameter c using only local quantities depending on local proximal operators or local gradients. We further derive theoretical guarantees and gradient computation and communication complexities for all four proposed algorithms. Extensive numerical experiments on logistic regression on different communication topologies showcase the utility of our algorithms in comparison with baseline methods.

我们考虑在没有中心服务器的分布式环境中解决满足二次增长条件(QGC)的凸问题。这类问题在分布式机器学习应用中很受欢迎。当 QGC 增长参数 c 已知时,我们提出了具有重启功能的分布式加速梯度方法,在有约束和无约束环境下分别命名为 PDACA 和 DACA。在 c 不可用的实际问题中,我们分别针对受限和无约束设置设计了 mPDACA 和 mDACA 方法,其中提出了新的分布式机制,仅使用取决于局部近算子或局部梯度的局部量来更新增长参数 c 的估计值。我们进一步推导了所有四种拟议算法的理论保证、梯度计算和通信复杂性。在不同通信拓扑结构上对逻辑回归进行的大量数值实验表明,与基线方法相比,我们的算法非常实用。
{"title":"Distributed accelerated gradient methods with restart under quadratic growth condition","authors":"Chhavi Sharma, Vishnu Narayanan, P. Balamurugan","doi":"10.1007/s10898-024-01395-z","DOIUrl":"https://doi.org/10.1007/s10898-024-01395-z","url":null,"abstract":"<p>We consider solving convex problems satisfying quadratic growth condition (QGC) over a distributed setting with no central server. Such problems are popular in distributed machine learning applications. When QGC growth parameter <i>c</i> is known, we propose distributed accelerated gradient methods with restarts, named PDACA and DACA respectively for constrained and unconstrained settings. In practical problems when <i>c</i> is unavailable, we design mPDACA and mDACA methods respectively for constrained and unconstrained settings, where novel distributed mechanisms are proposed to update the estimates of growth parameter <i>c</i> using only local quantities depending on local proximal operators or local gradients. We further derive theoretical guarantees and gradient computation and communication complexities for all four proposed algorithms. Extensive numerical experiments on logistic regression on different communication topologies showcase the utility of our algorithms in comparison with baseline methods.</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140803531","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Relaxations and cutting planes for linear programs with complementarity constraints 有互补约束的线性程序的松弛和切割平面
IF 1.8 3区 数学 Q1 Mathematics Pub Date : 2024-04-18 DOI: 10.1007/s10898-024-01397-x
Alberto Del Pia, Jeff Linderoth, Haoran Zhu

We study relaxations for linear programs with complementarity constraints, especially instances whose complementary pairs of variables are not independent. Our formulation is based on identifying vertex covers of the conflict graph of the instance and contains the extended formulation obtained from the ERLT introduced by Nguyen, Richard, and Tawarmalani as a special case. We demonstrate how to obtain strong cutting planes for our formulation from both the stable set polytope and the boolean quadric polytope associated with a complete bipartite graph. Through an extensive computational study for three types of practical problems, we assess the performance of our proposed linear relaxation and new cutting-planes in terms of the optimality gap closed.

我们研究了具有互补性约束的线性程序的松弛问题,尤其是变量互补对不独立的实例。我们的公式基于识别实例冲突图的顶点盖,并将 Nguyen、Richard 和 Tawarmalani 引入的 ERLT 扩展公式作为特例。我们演示了如何从与完整双方形图相关联的稳定集合多面体和布尔二次多面体中为我们的公式获取强切割平面。通过对三类实际问题进行广泛的计算研究,我们评估了我们提出的线性松弛和新切割平面的性能,即关闭的最优性差距。
{"title":"Relaxations and cutting planes for linear programs with complementarity constraints","authors":"Alberto Del Pia, Jeff Linderoth, Haoran Zhu","doi":"10.1007/s10898-024-01397-x","DOIUrl":"https://doi.org/10.1007/s10898-024-01397-x","url":null,"abstract":"<p>We study relaxations for linear programs with complementarity constraints, especially instances whose complementary pairs of variables are not independent. Our formulation is based on identifying vertex covers of the conflict graph of the instance and contains the extended formulation obtained from the ERLT introduced by Nguyen, Richard, and Tawarmalani as a special case. We demonstrate how to obtain strong cutting planes for our formulation from both the stable set polytope and the boolean quadric polytope associated with a complete bipartite graph. Through an extensive computational study for three types of practical problems, we assess the performance of our proposed linear relaxation and new cutting-planes in terms of the optimality gap closed.</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140630299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Characteristic sets and characteristic numbers of matrix two-person games 矩阵两人游戏的特征集和特征数
IF 1.8 3区 数学 Q1 Mathematics Pub Date : 2024-04-18 DOI: 10.1007/s10898-024-01394-0
D. T. K. Huyen, J.-C. Yao, N. D. Yen

Focusing on the extreme points of the solution sets of matrix two-person games, we propose the notions of characteristic sets and characteristic numbers. The characteristic sets (resp., the characteristic numbers) are the sets (resp., the numbers) of the extreme points of the solution set of the game and the optimal solution sets of the players. These concepts allow us to measure the complexity of the game. The larger the characteristic numbers, the more complex the game is. Among other things, we obtain upper bounds for the characteristic numbers and give a novel geometric construction. By the construction, we get useful descriptions of the optimal strategy set of each player of a game given by any nonsingular square matrix. Namely, the investigation of the geometry the just-mentioned sets reduces to computing or studying certain simpler sets. We also formulate several open problems.

围绕矩阵两人博弈解集的极值点,我们提出了特征集和特征数的概念。特征集(或特征数)是博弈解集的极值点集(或数),也是玩家的最优解集。通过这些概念,我们可以衡量博弈的复杂程度。特征数越大,博弈就越复杂。除其他外,我们还获得了特征数的上限,并给出了一种新颖的几何结构。通过该构造,我们可以得到由任意非正方形矩阵给出的博弈中每个玩家的最优策略集的有用描述。也就是说,对上述集合几何的研究可以简化为计算或研究某些更简单的集合。我们还提出了几个悬而未决的问题。
{"title":"Characteristic sets and characteristic numbers of matrix two-person games","authors":"D. T. K. Huyen, J.-C. Yao, N. D. Yen","doi":"10.1007/s10898-024-01394-0","DOIUrl":"https://doi.org/10.1007/s10898-024-01394-0","url":null,"abstract":"<p>Focusing on the extreme points of the solution sets of matrix two-person games, we propose the notions of characteristic sets and characteristic numbers. The characteristic sets (resp., the characteristic numbers) are the sets (resp., the numbers) of the extreme points of the solution set of the game and the optimal solution sets of the players. These concepts allow us to measure the complexity of the game. The larger the characteristic numbers, the more complex the game is. Among other things, we obtain upper bounds for the characteristic numbers and give a novel geometric construction. By the construction, we get useful descriptions of the optimal strategy set of each player of a game given by any nonsingular square matrix. Namely, the investigation of the geometry the just-mentioned sets reduces to computing or studying certain simpler sets. We also formulate several open problems.</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140626758","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The projected-type method for the extended vertical linear complementarity problem revisited 再论扩展垂直线性互补问题的投影型方法
IF 1.8 3区 数学 Q1 Mathematics Pub Date : 2024-04-18 DOI: 10.1007/s10898-024-01392-2
Cui-Xia Li, Shi-Liang Wu

In this paper, we further study the projected-type method for the extended vertical linear complementarity problem. By making use of some basic absolute value inequalities, some new convergence properties of the projected-type method are obtained. Compared with the existing results in the literature, the convergence range of the projected-type method is enlarged. By several numerical experiments, we also show the performance of the projected-type method.

本文进一步研究了扩展垂直线性互补问题的投影型方法。通过利用一些基本的绝对值不等式,得到了投影型方法的一些新的收敛特性。与现有文献结果相比,投影型方法的收敛范围有所扩大。通过几个数值实验,我们还展示了投影型方法的性能。
{"title":"The projected-type method for the extended vertical linear complementarity problem revisited","authors":"Cui-Xia Li, Shi-Liang Wu","doi":"10.1007/s10898-024-01392-2","DOIUrl":"https://doi.org/10.1007/s10898-024-01392-2","url":null,"abstract":"<p>In this paper, we further study the projected-type method for the extended vertical linear complementarity problem. By making use of some basic absolute value inequalities, some new convergence properties of the projected-type method are obtained. Compared with the existing results in the literature, the convergence range of the projected-type method is enlarged. By several numerical experiments, we also show the performance of the projected-type method.</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140623045","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Gradient projection method on the sphere, complementarity problems and copositivity 球面梯度投影法、互补问题和共正性
IF 1.8 3区 数学 Q1 Mathematics Pub Date : 2024-04-16 DOI: 10.1007/s10898-024-01390-4
Orizon Pereira Ferreira, Yingchao Gao, Sándor Zoltán Németh, Petra Renáta Rigó

By using a constant step-size, the convergence analysis of the gradient projection method on the sphere is presented for a closed spherically convex set. This algorithm is applied to discuss copositivity of operators with respect to cones. This approach can also be used to analyse solvability of nonlinear cone-complementarity problems. To our best knowledge this is the first numerical method related to the copositivity of operators with respect to the positive semidefinite cone. Numerical results concerning the copositivity of operators are also provided.

通过使用恒定步长,提出了封闭球凸集的球面梯度投影法的收敛性分析。该算法可用于讨论算子关于圆锥的共存性。这种方法也可用于分析非线性圆锥互补问题的可解性。据我们所知,这是第一种与正半定锥的算子共存性有关的数值方法。此外,还提供了有关算子共存性的数值结果。
{"title":"Gradient projection method on the sphere, complementarity problems and copositivity","authors":"Orizon Pereira Ferreira, Yingchao Gao, Sándor Zoltán Németh, Petra Renáta Rigó","doi":"10.1007/s10898-024-01390-4","DOIUrl":"https://doi.org/10.1007/s10898-024-01390-4","url":null,"abstract":"<p>By using a constant step-size, the convergence analysis of the gradient projection method on the sphere is presented for a closed spherically convex set. This algorithm is applied to discuss copositivity of operators with respect to cones. This approach can also be used to analyse solvability of nonlinear cone-complementarity problems. To our best knowledge this is the first numerical method related to the copositivity of operators with respect to the positive semidefinite cone. Numerical results concerning the copositivity of operators are also provided.</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140611808","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A new optimization approach to solving split equality problems in Hilbert spaces 解决希尔伯特空间分割相等问题的新优化方法
IF 1.8 3区 数学 Q1 Mathematics Pub Date : 2024-04-13 DOI: 10.1007/s10898-024-01389-x
Simeon Reich, Truong Minh Tuyen, Nguyen Song Ha

We introduce a new optimization approach to solving systems of split equality problems in real Hilbert spaces. We use the inertial method in order to improve the convergence rate of the proposed algorithms. Our algorithms do not depend on the norms of the bounded linear operators which appear in each split equality problem of the system under consideration. This is also a strong point of our algorithms because it is known that it is difficult to compute or estimate the norm of a linear operator in the general case.

我们引入了一种新的优化方法来求解实希尔伯特空间中的分割相等问题系统。我们使用惯性法来提高所提算法的收敛速度。我们的算法不依赖于有界线性算子的规范,这些算子出现在所考虑系统的每个分割相等问题中。这也是我们算法的一个优点,因为众所周知,在一般情况下很难计算或估计线性算子的规范。
{"title":"A new optimization approach to solving split equality problems in Hilbert spaces","authors":"Simeon Reich, Truong Minh Tuyen, Nguyen Song Ha","doi":"10.1007/s10898-024-01389-x","DOIUrl":"https://doi.org/10.1007/s10898-024-01389-x","url":null,"abstract":"<p>We introduce a new optimization approach to solving systems of split equality problems in real Hilbert spaces. We use the inertial method in order to improve the convergence rate of the proposed algorithms. Our algorithms do not depend on the norms of the bounded linear operators which appear in each split equality problem of the system under consideration. This is also a strong point of our algorithms because it is known that it is difficult to compute or estimate the norm of a linear operator in the general case.</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140562522","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Almost optimal manipulation of pairwise comparisons of alternatives 对备选方案进行成对比较的近乎最优操作
IF 1.8 3区 数学 Q1 Mathematics Pub Date : 2024-04-12 DOI: 10.1007/s10898-024-01391-3
Jacek Szybowski, Konrad Kułakowski, Sebastian Ernst

The role of an expert in the decision-making process is crucial. If we ask an expert to help us to make a decision we assume their honesty. But what if the expert is dishonest? Then, the answer on how difficult it is for an expert to provide manipulated data in a given case of decision-making process becomes essential. In the presented work, we consider manipulation of a ranking obtained by the Geometric Mean Method applied to a pairwise comparisons matrix. More specifically, we propose an algorithm for finding an almost optimal way to swap the positions of two selected alternatives in a ranking. We also define a new index which measures how difficult such manipulation is in a given case.

专家在决策过程中的作用至关重要。如果我们请专家帮助我们做决定,我们会假定他们是诚实的。但如果专家不诚实呢?那么,专家在特定的决策过程中提供受操纵数据的难度就变得至关重要。在本文介绍的工作中,我们考虑的是如何操纵通过几何平均法获得的排序,并将其应用到成对比较矩阵中。更具体地说,我们提出了一种算法,用于寻找一种几乎最优的方法来交换两个选定备选方案在排名中的位置。我们还定义了一个新的指数,用于衡量在给定情况下这种操作的难度。
{"title":"Almost optimal manipulation of pairwise comparisons of alternatives","authors":"Jacek Szybowski, Konrad Kułakowski, Sebastian Ernst","doi":"10.1007/s10898-024-01391-3","DOIUrl":"https://doi.org/10.1007/s10898-024-01391-3","url":null,"abstract":"<p>The role of an expert in the decision-making process is crucial. If we ask an expert to help us to make a decision we assume their honesty. But what if the expert is dishonest? Then, the answer on how difficult it is for an expert to provide manipulated data in a given case of decision-making process becomes essential. In the presented work, we consider manipulation of a ranking obtained by the Geometric Mean Method applied to a pairwise comparisons matrix. More specifically, we propose an algorithm for finding an almost optimal way to swap the positions of two selected alternatives in a ranking. We also define a new index which measures how difficult such manipulation is in a given case.</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140562220","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Optimality conditions and sensitivity analysis in parametric nonconvex minimax programming 参数非凸微分编程中的最优性条件和敏感性分析
IF 1.8 3区 数学 Q1 Mathematics Pub Date : 2024-04-08 DOI: 10.1007/s10898-024-01388-y
D. T. V. An, N. H. Hung, D. T. Ngoan, N. V. Tuyen

In this paper, we perform optimality conditions and sensitivity analysis for parametric nonconvex minimax programming problems. Our aim is to study the necessary optimality conditions by using the Mordukhovich (limiting) subdifferential and to give upper estimations for the Mordukhovich subdifferential of the optimal value function in the problem under consideration. The optimality conditions and sensitivity analysis are obtained by using upper estimates for Mordukhovich subdifferentials of the maximum function. The results on optimality conditions are then applied to parametric multiobjective optimization problems. An example is given to illustrate our results.

在本文中,我们将对参数非凸最小线性规划问题进行最优性条件和敏感性分析。我们的目的是利用莫尔杜霍维奇(极限)次微分来研究必要的最优性条件,并给出所考虑问题中最优值函数的莫尔杜霍维奇次微分的上估计值。通过使用最大函数的莫尔杜霍维奇子微分的上估计值,可以获得最优性条件和敏感性分析。然后将最优性条件的结果应用于参数多目标优化问题。举例说明我们的结果。
{"title":"Optimality conditions and sensitivity analysis in parametric nonconvex minimax programming","authors":"D. T. V. An, N. H. Hung, D. T. Ngoan, N. V. Tuyen","doi":"10.1007/s10898-024-01388-y","DOIUrl":"https://doi.org/10.1007/s10898-024-01388-y","url":null,"abstract":"<p>In this paper, we perform optimality conditions and sensitivity analysis for parametric nonconvex minimax programming problems. Our aim is to study the necessary optimality conditions by using the Mordukhovich (limiting) subdifferential and to give upper estimations for the Mordukhovich subdifferential of the optimal value function in the problem under consideration. The optimality conditions and sensitivity analysis are obtained by using upper estimates for Mordukhovich subdifferentials of the maximum function. The results on optimality conditions are then applied to parametric multiobjective optimization problems. An example is given to illustrate our results.\u0000</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140562224","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An approximation proximal gradient algorithm for nonconvex-linear minimax problems with nonconvex nonsmooth terms 具有非凸非光滑项的非凸线性最小问题的近似近似梯度算法
IF 1.8 3区 数学 Q1 Mathematics Pub Date : 2024-03-25 DOI: 10.1007/s10898-024-01383-3
Jiefei He, Huiling Zhang, Zi Xu

Nonconvex minimax problems have attracted significant attention in machine learning, wireless communication and many other fields. In this paper, we propose an efficient approximation proximal gradient algorithm for solving a class of nonsmooth nonconvex-linear minimax problems with a nonconvex nonsmooth term, and the number of iteration to find an (varepsilon )-stationary point is upper bounded by ({mathcal {O}}(varepsilon ^{-3})). Some numerical results on one-bit precoding problem in massive MIMO system and a distributed non-convex optimization problem demonstrate the effectiveness of the proposed algorithm.

非凸最小问题在机器学习、无线通信和许多其他领域引起了极大关注。本文提出了一种高效的近似梯度算法,用于求解一类带有非凸非光滑项的非凸线性 minimax 问题,且找到 (varepsilon )-驻点的迭代次数上界为({mathcal {O}}(varepsilon ^{-3}))。在大规模 MIMO 系统中的单比特预编码问题和分布式非凸优化问题上的一些数值结果证明了所提算法的有效性。
{"title":"An approximation proximal gradient algorithm for nonconvex-linear minimax problems with nonconvex nonsmooth terms","authors":"Jiefei He, Huiling Zhang, Zi Xu","doi":"10.1007/s10898-024-01383-3","DOIUrl":"https://doi.org/10.1007/s10898-024-01383-3","url":null,"abstract":"<p>Nonconvex minimax problems have attracted significant attention in machine learning, wireless communication and many other fields. In this paper, we propose an efficient approximation proximal gradient algorithm for solving a class of nonsmooth nonconvex-linear minimax problems with a nonconvex nonsmooth term, and the number of iteration to find an <span>(varepsilon )</span>-stationary point is upper bounded by <span>({mathcal {O}}(varepsilon ^{-3}))</span>. Some numerical results on one-bit precoding problem in massive MIMO system and a distributed non-convex optimization problem demonstrate the effectiveness of the proposed algorithm.</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140300455","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A partial Bregman ADMM with a general relaxation factor for structured nonconvex and nonsmooth optimization 针对结构化非凸和非光滑优化的带有一般松弛因子的部分布雷格曼 ADMM
IF 1.8 3区 数学 Q1 Mathematics Pub Date : 2024-03-23 DOI: 10.1007/s10898-024-01384-2
Jianghua Yin, Chunming Tang, Jinbao Jian, Qiongxuan Huang

In this paper, a partial Bregman alternating direction method of multipliers (ADMM) with a general relaxation factor (alpha in (0,frac{1+sqrt{5}}{2})) is proposed for structured nonconvex and nonsmooth optimization, where the objective function is the sum of a nonsmooth convex function and a smooth nonconvex function without coupled variables. We add a Bregman distance to alleviate the difficulty of solving the nonsmooth subproblem. For the smooth subproblem, we directly perform a gradient descent step of the augmented Lagrangian function, which makes the computational cost of each iteration of our method very cheap. To our knowledge, the nonconvex ADMM with a relaxation factor (alpha ne 1) in the literature has never been studied for the problem under consideration. Under some mild conditions, the boundedness of the generated sequence, the global convergence and the iteration complexity are established. The numerical results verify the efficiency and robustness of the proposed method.

本文提出了一种具有一般松弛因子 (α in (0,frac{1+sqrt{5}}{2})) 的部分布雷格曼乘法器交替方向法(ADMM),用于结构化非凸和非光滑优化,其中目标函数是一个非光滑凸函数和一个无耦合变量的光滑非凸函数之和。我们增加了布雷格曼距离,以减轻非光滑子问题的求解难度。对于光滑子问题,我们直接执行增强拉格朗日函数的梯度下降步骤,这使得我们方法每次迭代的计算成本非常低。据我们所知,文献中从未研究过松弛因子为(α ne 1)的非凸 ADMM。在一些温和的条件下,建立了生成序列的有界性、全局收敛性和迭代复杂性。数值结果验证了所提方法的高效性和鲁棒性。
{"title":"A partial Bregman ADMM with a general relaxation factor for structured nonconvex and nonsmooth optimization","authors":"Jianghua Yin, Chunming Tang, Jinbao Jian, Qiongxuan Huang","doi":"10.1007/s10898-024-01384-2","DOIUrl":"https://doi.org/10.1007/s10898-024-01384-2","url":null,"abstract":"<p>In this paper, a partial Bregman alternating direction method of multipliers (ADMM) with a general relaxation factor <span>(alpha in (0,frac{1+sqrt{5}}{2}))</span> is proposed for structured nonconvex and nonsmooth optimization, where the objective function is the sum of a nonsmooth convex function and a smooth nonconvex function without coupled variables. We add a Bregman distance to alleviate the difficulty of solving the nonsmooth subproblem. For the smooth subproblem, we directly perform a gradient descent step of the augmented Lagrangian function, which makes the computational cost of each iteration of our method very cheap. To our knowledge, the nonconvex ADMM with a relaxation factor <span>(alpha ne 1)</span> in the literature has never been studied for the problem under consideration. Under some mild conditions, the boundedness of the generated sequence, the global convergence and the iteration complexity are established. The numerical results verify the efficiency and robustness of the proposed method.</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-03-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140199916","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Global Optimization
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1