Pub Date : 2024-05-29DOI: 10.1007/s10898-024-01387-z
Pouya Aghaei pour, Jussi Hakanen, Kaisa Miettinen
We consider multiobjective optimization problems with at least one computationally expensive constraint function and propose a novel surrogate-assisted evolutionary algorithm that can incorporate preference information given a priori. We employ Kriging models to approximate expensive objective and constraint functions, enabling us to introduce a new selection strategy that emphasizes the generation of feasible solutions throughout the optimization process. In our innovative model management, we perform expensive function evaluations to identify feasible solutions that best reflect the decision maker’s preferences provided before the process. To assess the performance of our proposed algorithm, we utilize two distinct parameterless performance indicators and compare them against existing algorithms from the literature using various real-world engineering and benchmark problems. Furthermore, we assemble new algorithms to analyze the effects of the selection strategy and the model management on the performance of the proposed algorithm. The results show that in most cases, our algorithm has a better performance than the assembled algorithms, especially when there is a restricted budget for expensive function evaluations.
{"title":"A surrogate-assisted a priori multiobjective evolutionary algorithm for constrained multiobjective optimization problems","authors":"Pouya Aghaei pour, Jussi Hakanen, Kaisa Miettinen","doi":"10.1007/s10898-024-01387-z","DOIUrl":"https://doi.org/10.1007/s10898-024-01387-z","url":null,"abstract":"<p>We consider multiobjective optimization problems with at least one computationally expensive constraint function and propose a novel surrogate-assisted evolutionary algorithm that can incorporate preference information given a priori. We employ Kriging models to approximate expensive objective and constraint functions, enabling us to introduce a new selection strategy that emphasizes the generation of feasible solutions throughout the optimization process. In our innovative model management, we perform expensive function evaluations to identify feasible solutions that best reflect the decision maker’s preferences provided before the process. To assess the performance of our proposed algorithm, we utilize two distinct parameterless performance indicators and compare them against existing algorithms from the literature using various real-world engineering and benchmark problems. Furthermore, we assemble new algorithms to analyze the effects of the selection strategy and the model management on the performance of the proposed algorithm. The results show that in most cases, our algorithm has a better performance than the assembled algorithms, especially when there is a restricted budget for expensive function evaluations.</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141172451","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-25DOI: 10.1007/s10898-024-01403-2
Victor Reyes, Ignacio Araya
Interval-based branch & bound solvers are commonly used for solving Nonlinear Continuous global Optimization Problems (NCOPs). In each iteration, the solver strategically chooses and processes a node within the search tree. The node is bisected and the two generated offspring nodes are processed by filtering methods. For each of these nodes, the solver also searches for new feasible solutions in order to update the best candidate solution. The cost of this solution is used for pruning non-optimal branches of the search tree. Thus, node selection and finding new solutions, stands as pivotal aspects in the functionality of these kind of solvers. The ability to find close-to-optimal solutions early in the search process may discard extensive non-optimal search space regions, thereby effectively reducing the overall size of the search tree. In this work, we propose three novel node selection algorithms that use the feasible solutions obtained through a cost-effective iterative method. Upon updating the best candidate solution, these algorithms strategically choose the node containing this solution for subsequent processing. The newly introduced strategies have been incorporated as node selection methods in a state-of-the-art branch & bound solver, showing promising results in a set of 57 benchmark instances.
{"title":"Node selection through upper bounding local search methods in branch & bound solvers for NCOPs","authors":"Victor Reyes, Ignacio Araya","doi":"10.1007/s10898-024-01403-2","DOIUrl":"https://doi.org/10.1007/s10898-024-01403-2","url":null,"abstract":"<p>Interval-based branch & bound solvers are commonly used for solving Nonlinear Continuous global Optimization Problems (NCOPs). In each iteration, the solver strategically chooses and processes a node within the search tree. The node is bisected and the two generated offspring nodes are processed by filtering methods. For each of these nodes, the solver also searches for new feasible solutions in order to update the best candidate solution. The cost of this solution is used for pruning non-optimal branches of the search tree. Thus, node selection and finding new solutions, stands as pivotal aspects in the functionality of these kind of solvers. The ability to find close-to-optimal solutions early in the search process may discard extensive non-optimal search space regions, thereby effectively reducing the overall size of the search tree. In this work, we propose three novel node selection algorithms that use the feasible solutions obtained through a cost-effective iterative method. Upon updating the best candidate solution, these algorithms strategically choose the node containing this solution for subsequent processing. The newly introduced strategies have been incorporated as node selection methods in a state-of-the-art branch & bound solver, showing promising results in a set of 57 benchmark instances.\u0000</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-05-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141150599","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-21DOI: 10.1007/s10898-024-01386-0
Mercè Claverol, Andrea de las Heras Parrilla, Clemens Huemer, Alejandra Martínez-Moraian
We present an edge labeling of order-k Voronoi diagrams, (V_k(S)), of point sets S in the plane, and study properties of the regions defined by them. Among them, we show that (V_k(S)) has a small orientable cycle and path double cover, and we identify configurations that cannot appear in (V_k(S)) for small values of k. This paper also contains a systematic study of well-known and new properties of (V_k(S)), all whose proofs only rely on elementary geometric arguments in the plane. The maybe most comprehensive study of structural properties of (V_k(S)) was done by D.T. Lee (On k-nearest neighbor Voronoi diagrams in the plane) in 1982. Our work reviews and extends the list of properties of higher order Voronoi diagrams.
我们提出了平面中点集 S 的阶 k Voronoi 图((V_k(S)))的边标签,并研究了由它们定义的区域的性质。其中,我们证明了(V_k(S))有一个小的可定向循环和路径双覆盖,我们还确定了在k的小值下不能出现在(V_k(S))中的构型。本文还系统地研究了(V_k(S))众所周知的和新的性质,所有这些性质的证明都只依赖于平面中的基本几何论证。也许对 (V_k(S)) 的结构性质最全面的研究是由 D.T. Lee 在 1982 年完成的(On k-nearest neighbor Voronoi diagrams in the plane)。我们的研究回顾并扩展了高阶 Voronoi 图的属性列表。
{"title":"The edge labeling of higher order Voronoi diagrams","authors":"Mercè Claverol, Andrea de las Heras Parrilla, Clemens Huemer, Alejandra Martínez-Moraian","doi":"10.1007/s10898-024-01386-0","DOIUrl":"https://doi.org/10.1007/s10898-024-01386-0","url":null,"abstract":"<p>We present an edge labeling of order-<i>k</i> Voronoi diagrams, <span>(V_k(S))</span>, of point sets <i>S</i> in the plane, and study properties of the regions defined by them. Among them, we show that <span>(V_k(S))</span> has a small orientable cycle and path double cover, and we identify configurations that cannot appear in <span>(V_k(S))</span> for small values of <i>k</i>. This paper also contains a systematic study of well-known and new properties of <span>(V_k(S))</span>, all whose proofs only rely on elementary geometric arguments in the plane. The maybe most comprehensive study of structural properties of <span>(V_k(S))</span> was done by D.T. Lee (On k-nearest neighbor Voronoi diagrams in the plane) in 1982. Our work reviews and extends the list of properties of higher order Voronoi diagrams.</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141150560","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-16DOI: 10.1007/s10898-024-01405-0
Ignacio Araya, Víctor Reyes
{"title":"A revised monotonicity-based method for computing tight image enclosures of functions","authors":"Ignacio Araya, Víctor Reyes","doi":"10.1007/s10898-024-01405-0","DOIUrl":"https://doi.org/10.1007/s10898-024-01405-0","url":null,"abstract":"","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140966937","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-11DOI: 10.1007/s10898-024-01404-1
Mohammad Hossein Daryaei, Hossein Mohebi
The aim of this paper is to present dual optimality conditions for the difference of two extended real valued increasing co-radiant functions. We do this by first characterizing dual optimality conditions for the difference of two nonpositive increasing co-radiant functions. Finally, we present dual optimality conditions for the difference of two extended real valued increasing co-radiant functions. Our approach is based on the Toland–Singer formula.
{"title":"Dual optimality conditions for the difference of extended real valued increasing co-radiant functions","authors":"Mohammad Hossein Daryaei, Hossein Mohebi","doi":"10.1007/s10898-024-01404-1","DOIUrl":"https://doi.org/10.1007/s10898-024-01404-1","url":null,"abstract":"<p>The aim of this paper is to present dual optimality conditions for the difference of two extended real valued increasing co-radiant functions. We do this by first characterizing dual optimality conditions for the difference of two nonpositive increasing co-radiant functions. Finally, we present dual optimality conditions for the difference of two extended real valued increasing co-radiant functions. Our approach is based on the Toland–Singer formula.</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140937456","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-10DOI: 10.1007/s10898-024-01400-5
H. Rocha, J. Dias
Deterministic direct-search methods have been successfully used to address real-world challenging optimization problems, including the beam angle optimization (BAO) problem in radiation therapy treatment planning. BAO is a highly non-convex optimization problem typically treated as the optimization of an expensive multi-modal black-box function which results in a computationally time consuming procedure. For the recently available modalities of radiation therapy with protons (instead of photons) further efficiency in terms of computational time is required despite the success of the different strategies developed to accelerate BAO approaches. Introducing randomization into otherwise deterministic direct-search approaches has been shown to lead to excellent computational performance, particularly when considering a reduced number (as low as two) of random poll directions at each iteration. In this study several randomized direct-search strategies are tested considering different sets of polling directions. Results obtained using a prostate and a head-and-neck cancer cases confirmed the high-quality results obtained by deterministic direct-search methods. Randomized strategies using a reduced number of polling directions showed difficulties for the higher dimensional search space (head-and-neck) and, despite the excellent mean results for the prostate cancer case, outliers were observed, a result that is often ignored in the literature. While, for general global optimization problems, mean results (or obtaining the global optimum once) might be enough for assessing the performance of the randomized method, in real-world problems one should not disregard the worst-case scenario and beware of the possibility of poor results since, many times, it is only possible to run the optimization problem once. This is even more important in healthcare applications where the mean patient does not exist and the best treatment possible must be assured for every patient.
确定性直接搜索方法已成功用于解决现实世界中具有挑战性的优化问题,包括放射治疗规划中的射束角优化(BAO)问题。BAO 是一个高度非凸的优化问题,通常被视为昂贵的多模态黑盒函数的优化,导致计算过程耗时。对于最近推出的质子(而非光子)放射治疗模式,尽管为加速 BAO 方法而开发的不同策略取得了成功,但仍需要进一步提高计算时间方面的效率。将随机化引入其他确定性直接搜索方法已被证明能带来出色的计算性能,特别是在考虑减少每次迭代的随机轮询方向数量(低至两个)时。本研究测试了几种考虑不同轮询方向集的随机直接搜索策略。使用前列腺癌和头颈癌病例获得的结果证实了确定性直接搜索方法获得的高质量结果。使用较少轮询方向的随机策略在较高维度的搜索空间(头颈部)中表现出了困难,尽管前列腺癌案例的平均结果很好,但也观察到了异常值,这是文献中经常忽略的结果。对于一般的全局优化问题,平均结果(或一次获得全局最优)可能足以评估随机方法的性能,但在实际问题中,我们不应忽视最坏的情况,并要警惕结果不佳的可能性,因为很多时候,优化问题只能运行一次。这一点在医疗应用中更为重要,因为在医疗应用中不存在平均病人,必须确保每个病人都能得到最好的治疗。
{"title":"On polling directions for randomized direct-search approaches: application to beam angle optimization in intensity-modulated proton therapy","authors":"H. Rocha, J. Dias","doi":"10.1007/s10898-024-01400-5","DOIUrl":"https://doi.org/10.1007/s10898-024-01400-5","url":null,"abstract":"<p>Deterministic direct-search methods have been successfully used to address real-world challenging optimization problems, including the beam angle optimization (BAO) problem in radiation therapy treatment planning. BAO is a highly non-convex optimization problem typically treated as the optimization of an expensive multi-modal black-box function which results in a computationally time consuming procedure. For the recently available modalities of radiation therapy with protons (instead of photons) further efficiency in terms of computational time is required despite the success of the different strategies developed to accelerate BAO approaches. Introducing randomization into otherwise deterministic direct-search approaches has been shown to lead to excellent computational performance, particularly when considering a reduced number (as low as two) of random poll directions at each iteration. In this study several randomized direct-search strategies are tested considering different sets of polling directions. Results obtained using a prostate and a head-and-neck cancer cases confirmed the high-quality results obtained by deterministic direct-search methods. Randomized strategies using a reduced number of polling directions showed difficulties for the higher dimensional search space (head-and-neck) and, despite the excellent mean results for the prostate cancer case, outliers were observed, a result that is often ignored in the literature. While, for general global optimization problems, mean results (or obtaining the global optimum once) might be enough for assessing the performance of the randomized method, in real-world problems one should not disregard the worst-case scenario and beware of the possibility of poor results since, many times, it is only possible to run the optimization problem once. This is even more important in healthcare applications where the mean patient does not exist and the best treatment possible must be assured for every patient.</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-05-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140937382","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-04DOI: 10.1007/s10898-024-01402-3
Pablo Pérez-Lantero, Carlos Seara, Jorge Urrutia
Let P be a set of n points in (mathbb {R}^3) in general position, and let RCH(P) be the rectilinear convex hull of P. In this paper we obtain an optimal (O(nlog n)) time and O(n) space algorithm to compute RCH(P). We also obtain an efficient (O(nlog ^2 n)) time and (O(nlog n)) space algorithm to compute and maintain the set of vertices of the rectilinear convex hull of P as we rotate ({mathbb {R}}^3) around the Z-axis. We study some combinatorial properties of the rectilinear convex hulls of point sets in (mathbb {R}^3). Finally, as an application of the obtained results, we show an approximation algorithm to an optimization fitting problem in (mathbb {R}^3).
让 P 是在(mathbb {R}^3)中处于一般位置的 n 个点的集合,让 RCH(P) 是 P 的直线凸壳。在本文中,我们得到了一个最优的 (O(nlog n))时间和 (O(n) 空间算法来计算 RCH(P)。我们还得到了一种高效的(O(nlog ^2 n))时间和(O(nlog n))空间算法,当我们绕Z轴旋转({mathbb {R}}^3) 时,可以计算并维护P的直角凸壳的顶点集。我们研究了 (mathbb {R}^3) 中点集的直线凸壳的一些组合性质。最后,作为所得结果的一个应用,我们展示了一种在 (mathbb {R}^3) 中优化拟合问题的近似算法。
{"title":"Rectilinear convex hull of points in 3D and applications","authors":"Pablo Pérez-Lantero, Carlos Seara, Jorge Urrutia","doi":"10.1007/s10898-024-01402-3","DOIUrl":"https://doi.org/10.1007/s10898-024-01402-3","url":null,"abstract":"<p>Let <i>P</i> be a set of <i>n</i> points in <span>(mathbb {R}^3)</span> in general position, and let <i>RCH</i>(<i>P</i>) be the rectilinear convex hull of <i>P</i>. In this paper we obtain an optimal <span>(O(nlog n))</span> time and <i>O</i>(<i>n</i>) space algorithm to compute <i>RCH</i>(<i>P</i>). We also obtain an efficient <span>(O(nlog ^2 n))</span> time and <span>(O(nlog n))</span> space algorithm to compute and maintain the set of vertices of the rectilinear convex hull of <i>P</i> as we rotate <span>({mathbb {R}}^3)</span> around the <i>Z</i>-axis. We study some combinatorial properties of the rectilinear convex hulls of point sets in <span>(mathbb {R}^3)</span>. Finally, as an application of the obtained results, we show an approximation algorithm to an optimization fitting problem in <span>(mathbb {R}^3)</span>.</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140886962","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-29DOI: 10.1007/s10898-024-01368-2
Chiara Donnini, Armando Sacco
The aim of this paper is to investigate the problem of designing and building International Environmental Agreements (IEAs) taking into account some normative properties. We consider n asymmetric countries of the world, each one generating a quantity of pollutant emissions from the production of goods and services. We assume that individual emissions yield private benefits and negative externalities affecting all countries. To determine its own level of pollution, each state conducts a cost-benefit analysis. The absence of a supranational entity imposing emissions reduction makes IEAs based on voluntary participation. Examining the standard static non-cooperative game-theoretical model of coalition formation, we discover that the resulting emissions allocations might not be equitable à la Foley. It means that there might exist at least one player preferring to implement some other agent’s strategic plan instead of to play her own strategy. With the goal of studying whether equity, at least among coalesced countries, may be a criterion leading to social improvement, we introduce a new optimization rule. We require that members of an environmental coalition have to solve the maximization problem subject to the constraint imposing that they do not envy each other. Analyzing the particular case of two-player games, we get that, when countries are, in a sense, not too different from each other, our new mechanism endogenously induces social equity. By imposing a suitable total emission cap, the same results extend to all those games where our and standard solutions coexist and are different.
本文旨在研究在考虑某些规范属性的情况下设计和制定国际环境协议(IEAs)的问题。我们考虑了世界上 n 个不对称国家,每个国家在生产产品和提供服务时都会产生一定数量的污染物排放。我们假设单个国家的排放会产生影响所有国家的私人利益和负外部性。为了确定本国的污染水平,每个国家都要进行成本效益分析。由于没有强制减排的超国家实体,因此国际环境协定以自愿参与为基础。通过研究联盟形成的标准静态非合作博弈理论模型,我们发现由此产生的排放分配可能并不公平。这意味着可能至少有一个参与者宁愿执行其他参与者的战略计划,而不是采取自己的战略。为了研究公平(至少在联合起来的国家之间)是否是导致社会进步的标准,我们引入了一个新的优化规则。我们要求环境联盟的成员在解决最大化问题时必须遵守相互不嫉妒的约束条件。通过分析双人博弈的特殊情况,我们发现,当国家之间在某种意义上没有太大差异时,我们的新机制会内生地诱导社会公平。通过施加一个合适的排放总量上限,同样的结果可以扩展到我们的解决方案和标准解决方案共存且不同的所有博弈中。
{"title":"Social equity in international environmental agreements","authors":"Chiara Donnini, Armando Sacco","doi":"10.1007/s10898-024-01368-2","DOIUrl":"https://doi.org/10.1007/s10898-024-01368-2","url":null,"abstract":"<p>The aim of this paper is to investigate the problem of designing and building International Environmental Agreements (IEAs) taking into account some normative properties. We consider <i>n</i> asymmetric countries of the world, each one generating a quantity of pollutant emissions from the production of goods and services. We assume that individual emissions yield private benefits and negative externalities affecting all countries. To determine its own level of pollution, each state conducts a cost-benefit analysis. The absence of a supranational entity imposing emissions reduction makes IEAs based on voluntary participation. Examining the standard static non-cooperative game-theoretical model of coalition formation, we discover that the resulting emissions allocations might not be equitable à la Foley. It means that there might exist at least one player preferring to implement some other agent’s strategic plan instead of to play her own strategy. With the goal of studying whether equity, at least among coalesced countries, may be a criterion leading to social improvement, we introduce a new optimization rule. We require that members of an environmental coalition have to solve the maximization problem subject to the constraint imposing that they do not envy each other. Analyzing the particular case of two-player games, we get that, when countries are, in a sense, not too different from each other, our new mechanism endogenously induces social equity. By imposing a suitable total emission cap, the same results extend to all those games where our and standard solutions coexist and are different.\u0000</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140831343","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-29DOI: 10.1007/s10898-024-01396-y
Shichen Liao, Congying Han, Tiande Guo, Bonan Li
This paper investigates sparse optimization problems characterized by a sparse group structure, where element- and group-level sparsity are jointly taken into account. This particular optimization model has exhibited notable efficacy in tasks such as feature selection, parameter estimation, and the advancement of model interpretability. Central to our study is the scrutiny of the (ell _0) and (ell _{2,0}) norm regularization model, which, in comparison to alternative surrogate formulations, presents formidable computational challenges. We embark on our study by conducting the analysis of the optimality conditions of the sparse group optimization problem, leveraging the notion of a (gamma )-stationary point, whose linkage to local and global minimizer is established. In a subsequent facet of our study, we develop a novel subspace Newton algorithm for sparse group (ell _0) optimization problem and prove its global convergence property as well as local second-order convergence rate. Experimental results reveal the superlative performance of our algorithm in terms of both precision and computational expediency, thereby outperforming several state-of-the-art solvers.
{"title":"Subspace Newton method for sparse group $$ell _0$$ optimization problem","authors":"Shichen Liao, Congying Han, Tiande Guo, Bonan Li","doi":"10.1007/s10898-024-01396-y","DOIUrl":"https://doi.org/10.1007/s10898-024-01396-y","url":null,"abstract":"<p>This paper investigates sparse optimization problems characterized by a sparse group structure, where element- and group-level sparsity are jointly taken into account. This particular optimization model has exhibited notable efficacy in tasks such as feature selection, parameter estimation, and the advancement of model interpretability. Central to our study is the scrutiny of the <span>(ell _0)</span> and <span>(ell _{2,0})</span> norm regularization model, which, in comparison to alternative surrogate formulations, presents formidable computational challenges. We embark on our study by conducting the analysis of the optimality conditions of the sparse group optimization problem, leveraging the notion of a <span>(gamma )</span>-stationary point, whose linkage to local and global minimizer is established. In a subsequent facet of our study, we develop a novel subspace Newton algorithm for sparse group <span>(ell _0)</span> optimization problem and prove its global convergence property as well as local second-order convergence rate. Experimental results reveal the superlative performance of our algorithm in terms of both precision and computational expediency, thereby outperforming several state-of-the-art solvers.</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140831341","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-29DOI: 10.1007/s10898-024-01401-4
Shigui Li, Linzhang Lu, Xing Qiu, Zhen Chen, Delu Zeng
Bi-quadratic programming over unit spheres is a fundamental problem in quantum mechanics introduced by pioneer work of Einstein, Schrödinger, and others. It has been shown to be NP-hard; so it must be solve by efficient heuristic algorithms such as the block improvement method (BIM). This paper focuses on the maximization of bi-quadratic forms with nonnegative coefficient tensors, which leads to a rank-one approximation problem that is equivalent to computing the M-spectral radius and its corresponding eigenvectors. Specifically, we propose a tight upper bound of the M-spectral radius for nonnegative fourth-order partially symmetric (PS) tensors. This bound, serving as an improved shift parameter, significantly enhances the convergence speed of BIM while maintaining computational complexity aligned with the initial shift parameter of BIM. Moreover, we elucidate that the computation cost of such upper bound can be further simplified for certain sets and delve into the nature of these sets. Building on the insights gained from the proposed bounds, we derive the exact solutions of the M-spectral radius and its corresponding M-eigenvectors for certain classes of fourth-order PS-tensors and discuss the nature of this specific category. Lastly, as a practical application, we introduce a testable sufficient condition for the strong ellipticity in the field of solid mechanics. Numerical experiments demonstrate the utility of the proposed results.
单位球上的双二次编程是量子力学中的一个基本问题,由爱因斯坦、薛定谔等人的开创性工作引入。它已被证明是 NP-困难的,因此必须通过高效的启发式算法(如块改进法 (BIM))来解决。本文重点研究具有非负系数张量的二二次方形式的最大化,这导致了一个等价于计算 M 光谱半径及其相应特征向量的秩一逼近问题。具体来说,我们提出了非负四阶部分对称(PS)张量的 M 谱半径的严格上限。作为改进的移位参数,该约束大大提高了 BIM 的收敛速度,同时保持了与 BIM 初始移位参数一致的计算复杂度。此外,我们还阐明了对于某些集合,这种上界的计算成本可以进一步简化,并深入探讨了这些集合的性质。基于从提出的上界中获得的启示,我们推导出了四阶 PS 张量某些类别的 M 光谱半径及其相应 M 特征向量的精确解,并讨论了这一特定类别的性质。最后,作为实际应用,我们在固体力学领域引入了一个可检验的强椭圆性充分条件。数值实验证明了所提结果的实用性。
{"title":"Tighter bound estimation for efficient biquadratic optimization over unit spheres","authors":"Shigui Li, Linzhang Lu, Xing Qiu, Zhen Chen, Delu Zeng","doi":"10.1007/s10898-024-01401-4","DOIUrl":"https://doi.org/10.1007/s10898-024-01401-4","url":null,"abstract":"<p>Bi-quadratic programming over unit spheres is a fundamental problem in quantum mechanics introduced by pioneer work of Einstein, Schrödinger, and others. It has been shown to be NP-hard; so it must be solve by efficient heuristic algorithms such as the block improvement method (BIM). This paper focuses on the maximization of bi-quadratic forms with nonnegative coefficient tensors, which leads to a rank-one approximation problem that is equivalent to computing the M-spectral radius and its corresponding eigenvectors. Specifically, we propose a tight upper bound of the M-spectral radius for nonnegative fourth-order partially symmetric (PS) tensors. This bound, serving as an improved shift parameter, significantly enhances the convergence speed of BIM while maintaining computational complexity aligned with the initial shift parameter of BIM. Moreover, we elucidate that the computation cost of such upper bound can be further simplified for certain sets and delve into the nature of these sets. Building on the insights gained from the proposed bounds, we derive the exact solutions of the M-spectral radius and its corresponding M-eigenvectors for certain classes of fourth-order PS-tensors and discuss the nature of this specific category. Lastly, as a practical application, we introduce a testable sufficient condition for the strong ellipticity in the field of solid mechanics. Numerical experiments demonstrate the utility of the proposed results.</p>","PeriodicalId":15961,"journal":{"name":"Journal of Global Optimization","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2024-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140831144","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}