首页 > 最新文献

Optimization Letters最新文献

英文 中文
Optimality conditions for robust weakly efficient solutions in uncertain optimization 不确定优化中稳健弱效率解的最优条件
IF 1.6 4区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-02-13 DOI: 10.1007/s11590-023-02085-7
Yuwen Zhai, Qilin Wang, Tian Tang, Maoyuan Lv

In this paper, we find the flimsily robust weakly efficient solution to the uncertain vector optimization problem by means of the weighted sum scalarization method and strictly robust counterpart. In addition, we introduce a higher-order weak upper inner Studniarski epiderivative of set-valued maps, and obtain two properties of the new notion under the assumption of the star-shaped set. Finally, by applying the higher-order weak upper inner Studniarski epiderivative, we obtain a sufficient and necessary optimality condition of the vector-based robust weakly efficient solution to an uncertain vector optimization problem under the condition of the higher-order strictly generalized cone convexity. As applications, the corresponding optimality conditions of the robust (weakly) Pareto solutions are obtained by the current methods.

本文通过加权和标量化方法和严格鲁棒对应方法,找到了不确定矢量优化问题的微弱鲁棒弱有效解。此外,我们还引入了集值映射的高阶弱上内Studniarski表征函数,并得到了新概念在星形集假设下的两个性质。最后,通过应用高阶弱上内Studniarski表征函数,我们得到了在高阶严格广义圆锥凸性条件下,基于矢量的不确定矢量优化问题鲁棒弱有效解的充分必要最优条件。作为应用,目前的方法可以得到相应的鲁棒(弱)帕累托解的最优性条件。
{"title":"Optimality conditions for robust weakly efficient solutions in uncertain optimization","authors":"Yuwen Zhai, Qilin Wang, Tian Tang, Maoyuan Lv","doi":"10.1007/s11590-023-02085-7","DOIUrl":"https://doi.org/10.1007/s11590-023-02085-7","url":null,"abstract":"<p>In this paper, we find the flimsily robust weakly efficient solution to the uncertain vector optimization problem by means of the weighted sum scalarization method and strictly robust counterpart. In addition, we introduce a higher-order weak upper inner Studniarski epiderivative of set-valued maps, and obtain two properties of the new notion under the assumption of the star-shaped set. Finally, by applying the higher-order weak upper inner Studniarski epiderivative, we obtain a sufficient and necessary optimality condition of the vector-based robust weakly efficient solution to an uncertain vector optimization problem under the condition of the higher-order strictly generalized cone convexity. As applications, the corresponding optimality conditions of the robust (weakly) Pareto solutions are obtained by the current methods.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"88 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139760741","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Characterization of unique solvability of absolute value equations: an overview, extensions, and future directions 绝对值方程唯一可解性的特征:概述、扩展和未来方向
IF 1.6 4区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-02-09 DOI: 10.1007/s11590-024-02094-0
Shubham Kumar, Deepmala, Milan Hladík, Hossein Moosaei

This paper provides an overview of the necessary and sufficient conditions for guaranteeing the unique solvability of absolute value equations. In addition to discussing the basic form of these equations, we also address several generalizations, including generalized absolute value equations and matrix absolute value equations. Our survey encompasses known results as well as novel characterizations proposed in this study.

本文概述了保证绝对值方程唯一可解性的必要条件和充分条件。除了讨论这些方程的基本形式,我们还讨论了几种一般化形式,包括广义绝对值方程和矩阵绝对值方程。我们的研究涵盖了已知结果以及本研究提出的新特征。
{"title":"Characterization of unique solvability of absolute value equations: an overview, extensions, and future directions","authors":"Shubham Kumar, Deepmala, Milan Hladík, Hossein Moosaei","doi":"10.1007/s11590-024-02094-0","DOIUrl":"https://doi.org/10.1007/s11590-024-02094-0","url":null,"abstract":"<p>This paper provides an overview of the necessary and sufficient conditions for guaranteeing the unique solvability of absolute value equations. In addition to discussing the basic form of these equations, we also address several generalizations, including generalized absolute value equations and matrix absolute value equations. Our survey encompasses known results as well as novel characterizations proposed in this study.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"42 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-02-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139760737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A fast primal-dual algorithm via dynamical system with variable mass for linearly constrained convex optimization 通过具有可变质量的动态系统实现线性约束凸优化的快速原始双算法
IF 1.6 4区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-01-28 DOI: 10.1007/s11590-023-02091-9
Ziyi Jiang, Dan Wang, Xinwei Liu

We aim to solve the linearly constrained convex optimization problem whose objective function is the sum of a differentiable function and a non-differentiable function. We first propose an inertial continuous primal-dual dynamical system with variable mass for linearly constrained convex optimization problems with differentiable objective functions. The dynamical system is composed of a second-order differential equation with variable mass for the primal variable and a first-order differential equation for the dual variable. The fast convergence properties of the proposed dynamical system are proved by constructing a proper energy function. We then extend the results to the case where the objective function is non-differentiable, and a new accelerated primal-dual algorithm is presented. When both variable mass and time scaling satisfy certain conditions, it is proved that our new algorithm owns fast convergence rates for the objective function residual and the feasibility violation. Some preliminary numerical results on the (ell _{1})(ell _{2}) minimization problem demonstrate the validity of our algorithm.

我们的目标是解决目标函数为可微函数与不可微函数之和的线性约束凸优化问题。我们首先针对目标函数为可微函数的线性约束凸优化问题提出了一种具有可变质量的惯性连续原始二元动力学系统。该动力系统由一个主变量可变质量的二阶微分方程和一个双变量的一阶微分方程组成。通过构建适当的能量函数,证明了所提出的动力系统的快速收敛特性。然后,我们将结果扩展到目标函数不可分的情况,并提出了一种新的加速初等-二元算法。当变量质量和时间缩放都满足一定条件时,证明我们的新算法对目标函数残差和可行性违反具有快速收敛率。在 (ell _{1})-(ell _{2}) 最小化问题上的一些初步数值结果证明了我们算法的有效性。
{"title":"A fast primal-dual algorithm via dynamical system with variable mass for linearly constrained convex optimization","authors":"Ziyi Jiang, Dan Wang, Xinwei Liu","doi":"10.1007/s11590-023-02091-9","DOIUrl":"https://doi.org/10.1007/s11590-023-02091-9","url":null,"abstract":"<p>We aim to solve the linearly constrained convex optimization problem whose objective function is the sum of a differentiable function and a non-differentiable function. We first propose an inertial continuous primal-dual dynamical system with variable mass for linearly constrained convex optimization problems with differentiable objective functions. The dynamical system is composed of a second-order differential equation with variable mass for the primal variable and a first-order differential equation for the dual variable. The fast convergence properties of the proposed dynamical system are proved by constructing a proper energy function. We then extend the results to the case where the objective function is non-differentiable, and a new accelerated primal-dual algorithm is presented. When both variable mass and time scaling satisfy certain conditions, it is proved that our new algorithm owns fast convergence rates for the objective function residual and the feasibility violation. Some preliminary numerical results on the <span>(ell _{1})</span>–<span>(ell _{2})</span> minimization problem demonstrate the validity of our algorithm.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"20 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-01-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139583223","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Constrained many-to-many point matching in two dimensions 二维受限多对多点匹配
IF 1.6 4区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-01-26 DOI: 10.1007/s11590-023-02089-3
L. E. Caraballo, R. A. Castro, J. M. Díaz-Báñez, M. A. Heredia, J. Urrutia, I. Ventura, F. J. Zaragoza

In the minimum-weight many-to-many point matching problem, we are given a set R of red points and a set B of blue points in the plane, of total size N, and we want to pair up each point in R to one or more points in B and vice versa so that the sum of distances between the paired points is minimized. This problem can be solved in (O(N^3)) time by using a reduction to the minimum-weight perfect matching problem, and thus, it is not fast enough to be used for on-line systems where a large number of tunes need to be compared. Motivated by similarity problems in music theory, in this paper we study several constrained minimum-weight many-to-many point matching problems in which the allowed pairings are given by geometric restrictions, i.e., a bichromatic pair can be matched if and only if the corresponding points satisfy a specific condition of closeness. We provide algorithms to solve these constrained versions in O(N) time when the sets R and B are given ordered by abscissa.

在最小权重多对多点匹配问题中,我们给定了平面上总大小为 N 的红色点集合 R 和蓝色点集合 B,我们希望将 R 中的每个点与 B 中的一个或多个点配对,反之亦然,从而使配对点之间的距离之和最小。通过对最小权重完全匹配问题的还原,这个问题可以在(O(N^3))时间内解决,因此,对于需要比较大量曲调的在线系统来说,它的速度还不够快。受音乐理论中相似性问题的启发,我们在本文中研究了几种受限的最小权重多对多点匹配问题,其中允许的配对是由几何限制给出的,即只有当且仅当对应点满足特定的接近条件时,才能匹配一对双色点。当 R 集和 B 集按横座标排序时,我们提供了在 O(N) 时间内求解这些受限版本的算法。
{"title":"Constrained many-to-many point matching in two dimensions","authors":"L. E. Caraballo, R. A. Castro, J. M. Díaz-Báñez, M. A. Heredia, J. Urrutia, I. Ventura, F. J. Zaragoza","doi":"10.1007/s11590-023-02089-3","DOIUrl":"https://doi.org/10.1007/s11590-023-02089-3","url":null,"abstract":"<p>In the minimum-weight many-to-many point matching problem, we are given a set <i>R</i> of red points and a set <i>B</i> of blue points in the plane, of total size <i>N</i>, and we want to pair up each point in <i>R</i> to one or more points in <i>B</i> and vice versa so that the sum of distances between the paired points is minimized. This problem can be solved in <span>(O(N^3))</span> time by using a reduction to the minimum-weight perfect matching problem, and thus, it is not fast enough to be used for on-line systems where a large number of tunes need to be compared. Motivated by similarity problems in music theory, in this paper we study several constrained minimum-weight many-to-many point matching problems in which the allowed pairings are given by geometric restrictions, i.e., a bichromatic pair can be matched if and only if the corresponding points satisfy a specific condition of closeness. We provide algorithms to solve these constrained versions in <i>O</i>(<i>N</i>) time when the sets <i>R</i> and <i>B</i> are given ordered by abscissa.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"136 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-01-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139583286","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Duality in the problems of optimal control described by Darboux-type differential inclusions 达尔布型微分结论描述的最优控制问题中的对偶性
IF 1.6 4区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-01-25 DOI: 10.1007/s11590-023-02088-4
Sevilay Demir Sağlam

This paper is devoted to the optimization of the Mayer problem with hyperbolic differential inclusions of the Darboux type and duality. We use the discrete approximation method to get sufficient conditions of optimality for the convex problem given by Darboux differential inclusions and the polyhedral problem for a hyperbolic differential inclusion with state constraint. We formulate the adjoint inclusions in the Euler-Lagrange inclusion and Hamiltonian forms. Then, we construct the dual problem to optimal control problem given by Darboux differential inclusions with state constraint and prove so-called duality results. Moreover, we show that each pair of primal and dual problem solutions satisfy duality relations and that the optimal values in the primal convex and dual concave problems are equal. Finally, we establish the dual problem to the polyhedral Darboux problem and provide an example to demonstrate the main constructions of our approach.

本文主要研究具有达尔布型双曲微分夹杂和对偶性的梅耶尔问题的优化问题。我们使用离散逼近法,为达尔布微分夹杂给出的凸问题和带状态约束的双曲微分夹杂的多面体问题得到最优的充分条件。我们用欧拉-拉格朗日包含形式和哈密顿形式来表述邻接包含。然后,我们构建了由带状态约束的达尔布微分夹杂给出的最优控制问题的对偶问题,并证明了所谓的对偶结果。此外,我们还证明了每一对原始问题和对偶问题的解都满足对偶关系,并且原始凸问题和对偶凹问题中的最优值相等。最后,我们建立了多面体达尔布问题的对偶问题,并提供了一个示例来演示我们方法的主要构造。
{"title":"Duality in the problems of optimal control described by Darboux-type differential inclusions","authors":"Sevilay Demir Sağlam","doi":"10.1007/s11590-023-02088-4","DOIUrl":"https://doi.org/10.1007/s11590-023-02088-4","url":null,"abstract":"<p>This paper is devoted to the optimization of the Mayer problem with hyperbolic differential inclusions of the Darboux type and duality. We use the discrete approximation method to get sufficient conditions of optimality for the convex problem given by Darboux differential inclusions and the polyhedral problem for a hyperbolic differential inclusion with state constraint. We formulate the adjoint inclusions in the Euler-Lagrange inclusion and Hamiltonian forms. Then, we construct the dual problem to optimal control problem given by Darboux differential inclusions with state constraint and prove so-called duality results. Moreover, we show that each pair of primal and dual problem solutions satisfy duality relations and that the optimal values in the primal convex and dual concave problems are equal. Finally, we establish the dual problem to the polyhedral Darboux problem and provide an example to demonstrate the main constructions of our approach.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"138 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-01-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139583678","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Differentially private k-center problems 差分私有 K 中心问题
IF 1.6 4区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-01-25 DOI: 10.1007/s11590-023-02090-w
Fan Yuan, Dachuan Xu, Donglei Du, Min Li

Data privacy has become one of the most important concerns in the big data era. Because of its broad applications in machine learning and data analysis, many algorithms and theoretical results have been established for privacy clustering problems, such as k-means and k-median problems with privacy protection. However, there is little work on privacy protection in k-center clustering. Our research focuses on the k-center problem, its distributed variant, and the distributed k-center problem under differential privacy constraints. These problems model the concept of safeguarding the privacy of individual input elements, with the integration of differential privacy aimed at ensuring the security of individual information during data processing and analysis. We propose three approximation algorithms for these problems, respectively, and achieve a constant factor approximation ratio.

数据隐私已成为大数据时代最受关注的问题之一。由于其在机器学习和数据分析中的广泛应用,针对隐私聚类问题(如具有隐私保护功能的 k-means 和 k-median 问题)已经建立了许多算法和理论成果。然而,在 k 中心聚类中保护隐私的研究却很少。我们的研究重点是 k 中心问题及其分布式变体,以及差异隐私约束下的分布式 k 中心问题。这些问题以保护单个输入元素隐私的概念为模型,结合了旨在确保数据处理和分析过程中单个信息安全的差分隐私。我们分别针对这些问题提出了三种近似算法,并实现了恒因子近似率。
{"title":"Differentially private k-center problems","authors":"Fan Yuan, Dachuan Xu, Donglei Du, Min Li","doi":"10.1007/s11590-023-02090-w","DOIUrl":"https://doi.org/10.1007/s11590-023-02090-w","url":null,"abstract":"<p>Data privacy has become one of the most important concerns in the big data era. Because of its broad applications in machine learning and data analysis, many algorithms and theoretical results have been established for privacy clustering problems, such as <i>k</i>-means and <i>k</i>-median problems with privacy protection. However, there is little work on privacy protection in <i>k</i>-center clustering. Our research focuses on the <i>k</i>-center problem, its distributed variant, and the distributed <i>k</i>-center problem under differential privacy constraints. These problems model the concept of safeguarding the privacy of individual input elements, with the integration of differential privacy aimed at ensuring the security of individual information during data processing and analysis. We propose three approximation algorithms for these problems, respectively, and achieve a constant factor approximation ratio.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"5 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-01-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139583288","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Representation of positive polynomials on a generalized strip and its application to polynomial optimization 正多项式在广义条带上的表示及其在多项式优化中的应用
IF 1.6 4区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-01-11 DOI: 10.1007/s11590-023-02087-5

Abstract

We study the representation of nonnegative polynomials in two variables on a certain class of unbounded closed basic semi-algebraic sets (which are called generalized strips). This class includes the strip ([a,b] times {mathbb {R}}) which was studied by Marshall in (Proc Am Math Soc 138(5):1559–1567, 2010). A denominator-free Nichtnegativstellensätz holds true on a generalized strip when the width of the generalized strip is constant and fails otherwise. As a consequence, we confirm that the standard hierarchy of semidefinite programming relaxations defined for the compact case can indeed be adapted to the generalized strip with constant width. For polynomial optimization problems on the generalized strip with non-constant width, we follow Ha-Pham’s work: Solving polynomial optimization problems via the truncated tangency variety and sums of squares.

摘要 我们研究了两变量非负多项式在某类无界封闭基本半代数集合(称为广义条带)上的表示。这一类包括 Marshall 在 (Proc Am Math Soc 138(5):1559-1567, 2010) 中研究过的条([a,b] times {mathbb {R}})。当广义条带的宽度恒定时,广义条带上的无分母 Nichtnegativstellensätz 成立,反之则不成立。因此,我们证实了在紧凑情况下定义的半定式编程松弛的标准层次确实可以适用于宽度恒定的广义条带。对于宽度非恒定的广义条带上的多项式优化问题,我们遵循 Ha-Pham 的工作方法:通过截切线和平方和解决多项式优化问题。
{"title":"Representation of positive polynomials on a generalized strip and its application to polynomial optimization","authors":"","doi":"10.1007/s11590-023-02087-5","DOIUrl":"https://doi.org/10.1007/s11590-023-02087-5","url":null,"abstract":"<h3>Abstract</h3> <p>We study the representation of nonnegative polynomials in two variables on a certain class of unbounded closed basic semi-algebraic sets (which are called generalized strips). This class includes the strip <span> <span>([a,b] times {mathbb {R}})</span> </span> which was studied by Marshall in (Proc Am Math Soc 138(5):1559–1567, 2010). A denominator-free Nichtnegativstellensätz holds true on a generalized strip when the width of the generalized strip is constant and fails otherwise. As a consequence, we confirm that the standard hierarchy of semidefinite programming relaxations defined for the compact case can indeed be adapted to the generalized strip with constant width. For polynomial optimization problems on the generalized strip with non-constant width, we follow Ha-Pham’s work: Solving polynomial optimization problems via the truncated tangency variety and sums of squares. </p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"84 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139458753","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Determining optimal channel partition for 2:4 fine grained structured sparsity 确定 2:4 细粒度结构稀疏性的最佳信道分区
IF 1.6 4区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-01-11 DOI: 10.1007/s11590-023-02084-8

Abstract

Deep Neural Networks (DNNs) have demonstrated tremendous success in many applications, but incur high computational burden on the inference side. The 2:4 sparsity pruning method has recently been developed to effectively compress and accelerate DNNs with little to no loss in performance. The method comprises a training phase followed by a pruning step where 2 out of 4 consecutive weights are eliminated to obtain a pruned matrix, which is then retrained to fine-tune the remaining weights. The accuracy of the resultant sparse network is maximized by permuting the matrix along the channel dimension in a way that maximizes the total magnitude of weights preserved during pruning. While earlier works have proposed heuristic methods to generate good permutations, we formalized the problem as a discrete optimization problem. In this paper, we propose four different mathematical programs to determine the optimal permutations and compare their performance for small-sized instances using a standard solver. Further, we develop a complementary column generation scheme to solve DNNs with realistic number of channels.

摘要 深度神经网络(DNN)在许多应用中都取得了巨大成功,但在推理方面却产生了很高的计算负担。最近开发的 2:4 稀疏剪枝法能有效压缩和加速 DNN,而且性能几乎没有损失。该方法包括一个训练阶段和一个剪枝步骤,在剪枝步骤中,4 个连续权重中的 2 个被去除,从而得到一个剪枝矩阵,然后对该矩阵进行再训练,以微调剩余权重。通过沿信道维度对矩阵进行排列,使剪枝过程中保留的权重总大小最大化,从而最大限度地提高生成的稀疏网络的准确性。早期的研究提出了启发式方法来生成良好的排列,而我们则将这一问题形式化为离散优化问题。在本文中,我们提出了四种不同的数学方案来确定最优排列,并使用标准求解器对它们在小规模实例中的性能进行了比较。此外,我们还开发了一种补充列生成方案,以解决具有实际通道数的 DNN 问题。
{"title":"Determining optimal channel partition for 2:4 fine grained structured sparsity","authors":"","doi":"10.1007/s11590-023-02084-8","DOIUrl":"https://doi.org/10.1007/s11590-023-02084-8","url":null,"abstract":"<h3>Abstract</h3> <p>Deep Neural Networks (DNNs) have demonstrated tremendous success in many applications, but incur high computational burden on the inference side. The 2:4 sparsity pruning method has recently been developed to effectively compress and accelerate DNNs with little to no loss in performance. The method comprises a training phase followed by a pruning step where 2 out of 4 consecutive weights are eliminated to obtain a pruned matrix, which is then retrained to fine-tune the remaining weights. The accuracy of the resultant sparse network is maximized by permuting the matrix along the channel dimension in a way that maximizes the total magnitude of weights preserved during pruning. While earlier works have proposed heuristic methods to generate good permutations, we formalized the problem as a discrete optimization problem. In this paper, we propose four different mathematical programs to determine the optimal permutations and compare their performance for small-sized instances using a standard solver. Further, we develop a complementary column generation scheme to solve DNNs with realistic number of channels. </p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"57 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139465305","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A reduced Jacobian method with full convergence property 具有完全收敛特性的减雅各布方法
IF 1.6 4区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-01-07 DOI: 10.1007/s11590-023-02083-9
M. El Maghri, Y. Elboulqe

In this paper, we propose a variant of the reduced Jacobian method (RJM) introduced by El Maghri and Elboulqe (J Optim Theory Appl 179:917–943, 2018) for multicriteria optimization under linear constraints. Motivation is that, contrarily to RJM which has only global convergence to Pareto KKT-stationary points in the classical sense of accumulation points, this new variant possesses the full convergence property in the sense that the entire sequence converges whenever the objectives are quasiconvex. Simulations are reported showing the performance of this variant compared to RJM and the nondominated sorting genetic algorithm (NSGA-II).

在本文中,我们提出了 El Maghri 和 Elboulqe(J Optim Theory Appl 179:917-943, 2018)提出的还原雅各比方法(RJM)的变体,用于线性约束下的多标准优化。其动机在于,RJM 在经典意义上只有全局收敛到帕累托 KKT 静止点的累积点,与此相反,这种新变体具有全收敛特性,即只要目标是准凸的,整个序列都会收敛。仿真报告显示了该变体与 RJM 和非支配排序遗传算法(NSGA-II)相比的性能。
{"title":"A reduced Jacobian method with full convergence property","authors":"M. El Maghri, Y. Elboulqe","doi":"10.1007/s11590-023-02083-9","DOIUrl":"https://doi.org/10.1007/s11590-023-02083-9","url":null,"abstract":"<p>In this paper, we propose a variant of the reduced Jacobian method (RJM) introduced by El Maghri and Elboulqe (J Optim Theory Appl 179:917–943, 2018) for multicriteria optimization under linear constraints. Motivation is that, contrarily to RJM which has only global convergence to Pareto KKT-stationary points in the classical sense of accumulation points, this new variant possesses the full convergence property in the sense that the entire sequence converges whenever the objectives are quasiconvex. Simulations are reported showing the performance of this variant compared to RJM and the nondominated sorting genetic algorithm (NSGA-II).</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"7 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139396430","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Single machine scheduling to minimize maximum earliness/tardiness cost with job rejection 单机调度,最大限度降低工作拒绝的迟到/迟到成本
IF 1.6 4区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-01-05 DOI: 10.1007/s11590-023-02086-6
Matan Atsmony, Gur Mosheiov

We study a single machine due-date assignment problem with a common due-date. The objective function is minimizing the maximum earliness/tardiness cost. The scheduler may process only a subset of the jobs and the remaining jobs are rejected. Job-dependent rejection-costs are considered, and an upper bound on the total permitted rejection cost is assumed. The problem is proved to be NP-Hard. We present and test a pseudo-polynomial dynamic programming solution algorithm. An extension to the setting containing additional due-date cost component is also discussed. An efficient implementation of the algorithm is introduced, and medium size problems (containing hundreds of jobs) are shown to be solved in very reasonable running time. In addition, an intuitive heuristic is introduced, tested numerically, and is shown to produce very small optimality gaps.

我们研究的是具有共同到期日的单机到期日分配问题。目标函数是使最大迟到/迟到成本最小化。调度员只能处理一部分作业,其余作业将被拒绝。考虑了与作业相关的拒绝成本,并假设了总允许拒绝成本的上限。该问题被证明为 NP-Hard。我们提出并测试了一种伪多项式动态编程求解算法。我们还讨论了对包含额外到期日成本部分的设置的扩展。我们介绍了该算法的高效实现方法,并证明中等规模的问题(包含数百个作业)可以在非常合理的运行时间内求解。此外,还介绍了一种直观的启发式算法,并对其进行了数值测试,结果表明该算法能产生非常小的最优性差距。
{"title":"Single machine scheduling to minimize maximum earliness/tardiness cost with job rejection","authors":"Matan Atsmony, Gur Mosheiov","doi":"10.1007/s11590-023-02086-6","DOIUrl":"https://doi.org/10.1007/s11590-023-02086-6","url":null,"abstract":"<p>We study a single machine due-date assignment problem with a common due-date. The objective function is minimizing the maximum earliness/tardiness cost. The scheduler may process only a subset of the jobs and the remaining jobs are rejected. Job-dependent rejection-costs are considered, and an upper bound on the total permitted rejection cost is assumed. The problem is proved to be NP-Hard. We present and test a pseudo-polynomial dynamic programming solution algorithm. An extension to the setting containing additional due-date cost component is also discussed. An efficient implementation of the algorithm is introduced, and medium size problems (containing hundreds of jobs) are shown to be solved in very reasonable running time. In addition, an intuitive heuristic is introduced, tested numerically, and is shown to produce very small optimality gaps.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"59 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139375462","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Optimization Letters
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1