首页 > 最新文献

SIAM Journal on Matrix Analysis and Applications最新文献

英文 中文
On Semidefinite Programming Characterizations of the Numerical Radius and Its Dual Norm 论数值半径及其双规范的半有限编程特征
IF 1.5 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-07-23 DOI: 10.1137/23m160356x
Shmuel Friedland, Chi-Kwong Li
SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 3, Page 1414-1428, September 2024.
Abstract. We state and give self-contained proofs of semidefinite programming characterizations of the numerical radius and its dual norm for matrices. We show that the computation of the numerical radius and its dual norm within [math] precision are polynomially time computable in the data and [math] using either the ellipsoid method or the short step, primal interior point method. We apply our results to give a simple formula for the spectral and the nuclear norm of a [math] real tensor in terms of the numerical radius and its dual norm.
SIAM 矩阵分析与应用期刊》,第 45 卷第 3 期,第 1414-1428 页,2024 年 9 月。 摘要。我们陈述并给出了矩阵数值半径及其对偶法的半有限编程特征的自足证明。我们证明,在[math]精度范围内计算数值半径及其对偶法,在数据和[math]中使用椭球法或短步原始内点法都是多项式时间可计算的。我们应用我们的结果给出了一个简单的公式,用数值半径及其对偶法计算[数学]实张量的谱法和核规范。
{"title":"On Semidefinite Programming Characterizations of the Numerical Radius and Its Dual Norm","authors":"Shmuel Friedland, Chi-Kwong Li","doi":"10.1137/23m160356x","DOIUrl":"https://doi.org/10.1137/23m160356x","url":null,"abstract":"SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 3, Page 1414-1428, September 2024. <br/> Abstract. We state and give self-contained proofs of semidefinite programming characterizations of the numerical radius and its dual norm for matrices. We show that the computation of the numerical radius and its dual norm within [math] precision are polynomially time computable in the data and [math] using either the ellipsoid method or the short step, primal interior point method. We apply our results to give a simple formula for the spectral and the nuclear norm of a [math] real tensor in terms of the numerical radius and its dual norm.","PeriodicalId":49538,"journal":{"name":"SIAM Journal on Matrix Analysis and Applications","volume":"30 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141770667","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Spectral Transformation for the Dense Symmetric Semidefinite Generalized Eigenvalue Problem 密集对称半无限广义特征值问题的谱变换
IF 1.5 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-07-22 DOI: 10.1137/24m162916x
Michael Stewart
SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 3, Page 1392-1413, September 2024.
Abstract. The spectral transformation Lanczos method for the sparse symmetric definite generalized eigenvalue problem for matrices [math] and [math] is an iterative method that addresses the case of semidefinite or ill-conditioned [math] using a shifted and inverted formulation of the problem. This paper proposes the same approach for dense problems and shows that with a shift chosen in accordance with certain constraints, the algorithm can conditionally ensure that every computed shifted and inverted eigenvalue is close to the exact shifted and inverted eigenvalue of a pair of matrices close to [math] and [math]. Under the same assumptions on the shift, the analysis of the algorithm for the shifted and inverted problem leads to useful error bounds for the original problem, including a bound that shows how a single shift that is of moderate size in a scaled sense can be chosen so that every computed generalized eigenvalue corresponds to a generalized eigenvalue of a pair of matrices close to [math] and [math]. The computed generalized eigenvectors give a relative residual that depends on the distance between the corresponding generalized eigenvalue and the shift. If the shift is of moderate size, then relative residuals are small for generalized eigenvalues that are not much larger than the shift. Larger shifts give small relative residuals for generalized eigenvalues that are not much larger or smaller than the shift.
SIAM 矩阵分析与应用期刊》,第 45 卷,第 3 期,第 1392-1413 页,2024 年 9 月。 摘要针对矩阵[math]和[math]的稀疏对称定广义特征值问题的谱变换 Lanczos 方法是一种迭代法,它使用问题的移位和反转表述来解决半有限或条件不佳[math]的情况。本文针对密集问题提出了同样的方法,并证明在根据某些约束条件选择移位的情况下,该算法可以有条件地确保计算出的每个移位和倒置特征值都接近一对接近 [math] 和 [math] 的矩阵的精确移位和倒置特征值。在同样的移位假设下,对移位和倒置问题算法的分析可以得出原始问题的有用误差边界,其中包括一个边界,说明如何选择在比例意义上大小适中的单次移位,从而使计算出的每个广义特征值都对应于一对接近 [math] 和 [math] 的矩阵的广义特征值。计算出的广义特征向量给出的相对残差取决于相应广义特征值与偏移之间的距离。如果位移大小适中,那么对于比位移大不了多少的广义特征值来说,相对残差就很小。如果偏移量较大,则对于比偏移量大或小得多的广义特征值来说,相对残差较小。
{"title":"Spectral Transformation for the Dense Symmetric Semidefinite Generalized Eigenvalue Problem","authors":"Michael Stewart","doi":"10.1137/24m162916x","DOIUrl":"https://doi.org/10.1137/24m162916x","url":null,"abstract":"SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 3, Page 1392-1413, September 2024. <br/> Abstract. The spectral transformation Lanczos method for the sparse symmetric definite generalized eigenvalue problem for matrices [math] and [math] is an iterative method that addresses the case of semidefinite or ill-conditioned [math] using a shifted and inverted formulation of the problem. This paper proposes the same approach for dense problems and shows that with a shift chosen in accordance with certain constraints, the algorithm can conditionally ensure that every computed shifted and inverted eigenvalue is close to the exact shifted and inverted eigenvalue of a pair of matrices close to [math] and [math]. Under the same assumptions on the shift, the analysis of the algorithm for the shifted and inverted problem leads to useful error bounds for the original problem, including a bound that shows how a single shift that is of moderate size in a scaled sense can be chosen so that every computed generalized eigenvalue corresponds to a generalized eigenvalue of a pair of matrices close to [math] and [math]. The computed generalized eigenvectors give a relative residual that depends on the distance between the corresponding generalized eigenvalue and the shift. If the shift is of moderate size, then relative residuals are small for generalized eigenvalues that are not much larger than the shift. Larger shifts give small relative residuals for generalized eigenvalues that are not much larger or smaller than the shift.","PeriodicalId":49538,"journal":{"name":"SIAM Journal on Matrix Analysis and Applications","volume":"22 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141737447","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Single-Pass Nyström Approximation in Mixed Precision 混合精度下的单程尼斯特伦近似法
IF 1.5 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-07-19 DOI: 10.1137/22m154079x
Erin Carson, Ieva Daužickaitė
SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 3, Page 1361-1391, September 2024.
Abstract. Low-rank matrix approximations appear in a number of scientific computing applications. We consider the Nyström method for approximating a positive semidefinite matrix [math]. In the case that [math] is very large or its entries can only be accessed once, a single-pass version may be necessary. In this work, we perform a complete rounding error analysis of the single-pass Nyström method in two precisions, where the computation of the expensive matrix product with [math] is assumed to be performed in the lower of the two precisions. Our analysis gives insight into how the sketching matrix and shift should be chosen to ensure stability, implementation aspects which have been commented on in the literature but not yet rigorously justified. We further develop a heuristic to determine how to pick the lower precision, which confirms the general intuition that the lower the desired rank of the approximation, the lower the precision we can use without detriment. We also demonstrate that our mixed precision Nyström method can be used to inexpensively construct limited memory preconditioners for the conjugate gradient method and derive a bound on the condition number of the resulting preconditioned coefficient matrix. We present numerical experiments on a set of matrices with various spectral decays and demonstrate the utility of our mixed precision approach.
SIAM 矩阵分析与应用期刊》,第 45 卷第 3 期,第 1361-1391 页,2024 年 9 月。 摘要低秩矩阵近似出现在许多科学计算应用中。我们考虑用 Nyström 方法逼近正半有限矩阵 [math]。在 [math] 非常大或其条目只能访问一次的情况下,可能需要一个单程版本。在这项工作中,我们以两种精度对单通 Nyström 方法进行了完整的舍入误差分析,其中昂贵的矩阵与 [math] 的乘积计算假定在两种精度中较低的精度下进行。我们的分析深入揭示了应如何选择草图矩阵和移位以确保稳定性,这些实施方面的问题在文献中已有评论,但尚未得到严格论证。我们进一步开发了一种启发式方法来确定如何选择较低精度,这证实了一般的直觉,即近似所需的秩越低,我们可以使用的精度就越低,而不会造成损害。我们还证明,我们的混合精度 Nyström 方法可用于以低成本构建共轭梯度法的有限记忆预处理器,并推导出所产生的预处理系数矩阵的条件数约束。我们对一组具有不同频谱衰减的矩阵进行了数值实验,证明了混合精度方法的实用性。
{"title":"Single-Pass Nyström Approximation in Mixed Precision","authors":"Erin Carson, Ieva Daužickaitė","doi":"10.1137/22m154079x","DOIUrl":"https://doi.org/10.1137/22m154079x","url":null,"abstract":"SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 3, Page 1361-1391, September 2024. <br/> Abstract. Low-rank matrix approximations appear in a number of scientific computing applications. We consider the Nyström method for approximating a positive semidefinite matrix [math]. In the case that [math] is very large or its entries can only be accessed once, a single-pass version may be necessary. In this work, we perform a complete rounding error analysis of the single-pass Nyström method in two precisions, where the computation of the expensive matrix product with [math] is assumed to be performed in the lower of the two precisions. Our analysis gives insight into how the sketching matrix and shift should be chosen to ensure stability, implementation aspects which have been commented on in the literature but not yet rigorously justified. We further develop a heuristic to determine how to pick the lower precision, which confirms the general intuition that the lower the desired rank of the approximation, the lower the precision we can use without detriment. We also demonstrate that our mixed precision Nyström method can be used to inexpensively construct limited memory preconditioners for the conjugate gradient method and derive a bound on the condition number of the resulting preconditioned coefficient matrix. We present numerical experiments on a set of matrices with various spectral decays and demonstrate the utility of our mixed precision approach.","PeriodicalId":49538,"journal":{"name":"SIAM Journal on Matrix Analysis and Applications","volume":"15 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141770662","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Eigenstructure Perturbations for a Class of Hamiltonian Matrices and Solutions of Related Riccati Inequalities 一类哈密尔顿矩阵的特征结构扰动及相关里卡提不等式的解
IF 1.5 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-07-18 DOI: 10.1137/23m1619563
Volker Mehrmann, Hongguo Xu
SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 3, Page 1335-1360, September 2024.
Abstract. The characterization of the solution set for a class of algebraic Riccati inequalities is studied. This class arises in the passivity analysis of linear time-invariant control systems. Eigenvalue perturbation theory for the Hamiltonian matrix associated with the Riccati inequality is used to analyze the extremal points of the solution set.
SIAM 矩阵分析与应用期刊》,第 45 卷,第 3 期,第 1335-1360 页,2024 年 9 月。 摘要研究了一类代数 Riccati 不等式解集的特征。这类不等式出现在线性时不变控制系统的钝化分析中。利用与 Riccati 不等式相关的哈密顿矩阵的特征值扰动理论来分析解集的极值点。
{"title":"Eigenstructure Perturbations for a Class of Hamiltonian Matrices and Solutions of Related Riccati Inequalities","authors":"Volker Mehrmann, Hongguo Xu","doi":"10.1137/23m1619563","DOIUrl":"https://doi.org/10.1137/23m1619563","url":null,"abstract":"SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 3, Page 1335-1360, September 2024. <br/> Abstract. The characterization of the solution set for a class of algebraic Riccati inequalities is studied. This class arises in the passivity analysis of linear time-invariant control systems. Eigenvalue perturbation theory for the Hamiltonian matrix associated with the Riccati inequality is used to analyze the extremal points of the solution set.","PeriodicalId":49538,"journal":{"name":"SIAM Journal on Matrix Analysis and Applications","volume":"35 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141737449","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On the Two-Parameter Matrix Pencil Problem 关于双参数矩阵铅笔问题
IF 1.5 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-07-11 DOI: 10.1137/23m1545963
Satin K. Gungah, Fawwaz F. Alsubaie, Imad M. Jaimoukha
SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 3, Page 1318-1340, September 2024.
Abstract. The multiparameter matrix pencil problem (MPP) is a generalization of the one-parameter MPP: Given a set of [math], [math] complex matrices [math] with [math], it is required to find all complex scalars [math], not all zero, such that the matrix pencil [math] loses column rank and the corresponding nonzero complex vector [math] such that [math]. We call the [math]-tuple [math] an eigenvalue and the corresponding vector [math] an eigenvector. This problem is related to the well-known multiparameter eigenvalue problem, except that there is only one pencil and, crucially, the matrices are not necessarily square. This paper uses our preliminary investigation in F. F. Alsubaie [[math] Optimal Model Reduction for Linear Dynamic Systems and the Solution of Multiparameter Matrix Pencil Problems, PhD thesis, Imperial College London, 2019], which presents a theoretical study of the multiparameter MPP and its applications in the [math] optimal model reduction problem, to give a full solution to the two-parameter MPP. First, an inflation process is implemented to show that the two-parameter MPP is equivalent to a set of three [math] simultaneous one-parameter MPPs. These problems are given in terms of Kronecker commutator operators (involving the original matrices) that exhibit several symmetries. These symmetries are analyzed and are then used to deflate the dimensions of the one-parameter MPPs to [math], thus simplifying their numerical solution. In the case in which [math], it is shown that the two-parameter MPP has at least one solution and generically [math] solutions, and furthermore that, under a rank assumption, the Kronecker determinant operators satisfy a commutativity property. This is then used to show that the two-parameter MPP is equivalent to a set of three simultaneous eigenvalue problems of dimension [math]. A general solution algorithm is presented and numerical examples are given to outline the procedure of the proposed algorithm.
SIAM 矩阵分析与应用期刊》,第 45 卷,第 3 期,第 1318-1340 页,2024 年 9 月。 摘要多参数矩阵铅笔问题(MPP)是单参数矩阵铅笔问题的一般化:给定一组[math], [math]复数矩阵[math]与[math],要求找到所有复数标量[math](不全为零),使得矩阵铅笔[math]失去列秩,以及相应的非零复数向量[math],使得[math]。我们称[math]元组[math]为特征值,相应的向量[math]为特征向量。这个问题与众所周知的多参数特征值问题有关,只不过只有一支铅笔,而且关键的是,矩阵不一定是正方形的。本文利用我们在 F. F. Alsubaie [[math] Optimal Model Reduction for Linear Dynamic Systems and the Solution of Multiparameter Matrix Pencil Problems, PhD thesis, Imperial College London, 2019] 中的初步研究,提出了多参数 MPP 的理论研究及其在[math] optimal model reduction problem 中的应用,给出了双参数 MPP 的完整解决方案。首先,实现了一个膨胀过程,表明双参数 MPP 等价于一组三个 [math] 同步单参数 MPP。这些问题是用克朗内克换元算子(涉及原始矩阵)给出的,它们表现出几种对称性。对这些对称性进行分析后,可将单参数 MPP 的维数缩减为 [math],从而简化其数值解法。在[数学]的情况下,证明了双参数 MPP 至少有一个解,而且一般都有[数学]解,此外,在秩假设下,克朗内克行列式算子满足换元性质。然后用它来证明双参数 MPP 等价于一组维数为 [math] 的三个同时特征值问题。本文提出了一种通用求解算法,并给出了数值示例,以概述所提算法的程序。
{"title":"On the Two-Parameter Matrix Pencil Problem","authors":"Satin K. Gungah, Fawwaz F. Alsubaie, Imad M. Jaimoukha","doi":"10.1137/23m1545963","DOIUrl":"https://doi.org/10.1137/23m1545963","url":null,"abstract":"SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 3, Page 1318-1340, September 2024. <br/> Abstract. The multiparameter matrix pencil problem (MPP) is a generalization of the one-parameter MPP: Given a set of [math], [math] complex matrices [math] with [math], it is required to find all complex scalars [math], not all zero, such that the matrix pencil [math] loses column rank and the corresponding nonzero complex vector [math] such that [math]. We call the [math]-tuple [math] an eigenvalue and the corresponding vector [math] an eigenvector. This problem is related to the well-known multiparameter eigenvalue problem, except that there is only one pencil and, crucially, the matrices are not necessarily square. This paper uses our preliminary investigation in F. F. Alsubaie [[math] Optimal Model Reduction for Linear Dynamic Systems and the Solution of Multiparameter Matrix Pencil Problems, PhD thesis, Imperial College London, 2019], which presents a theoretical study of the multiparameter MPP and its applications in the [math] optimal model reduction problem, to give a full solution to the two-parameter MPP. First, an inflation process is implemented to show that the two-parameter MPP is equivalent to a set of three [math] simultaneous one-parameter MPPs. These problems are given in terms of Kronecker commutator operators (involving the original matrices) that exhibit several symmetries. These symmetries are analyzed and are then used to deflate the dimensions of the one-parameter MPPs to [math], thus simplifying their numerical solution. In the case in which [math], it is shown that the two-parameter MPP has at least one solution and generically [math] solutions, and furthermore that, under a rank assumption, the Kronecker determinant operators satisfy a commutativity property. This is then used to show that the two-parameter MPP is equivalent to a set of three simultaneous eigenvalue problems of dimension [math]. A general solution algorithm is presented and numerical examples are given to outline the procedure of the proposed algorithm.","PeriodicalId":49538,"journal":{"name":"SIAM Journal on Matrix Analysis and Applications","volume":"18 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141614677","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On Adaptive Stochastic Heavy Ball Momentum for Solving Linear Systems 论求解线性系统的自适应随机重球动量
IF 1.5 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-07-09 DOI: 10.1137/23m1575883
Yun Zeng, Deren Han, Yansheng Su, Jiaxin Xie
SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 3, Page 1259-1286, September 2024.
Abstract. The stochastic heavy ball momentum (SHBM) method has gained considerable popularity as a scalable approach for solving large-scale optimization problems. However, one limitation of this method is its reliance on prior knowledge of certain problem parameters, such as singular values of a matrix. In this paper, we propose an adaptive variant of the SHBM method for solving stochastic problems that are reformulated from linear systems using user-defined distributions. Our adaptive SHBM (ASHBM) method utilizes iterative information to update the parameters, addressing an open problem in the literature regarding the adaptive learning of momentum parameters. We prove that our method converges linearly in expectation, with a better convergence bound compared to the basic method. Notably, we demonstrate that the deterministic version of our ASHBM algorithm can be reformulated as a variant of the conjugate gradient (CG) method, inheriting many of its appealing properties, such as finite-time convergence. Consequently, the ASHBM method can be further generalized to develop a brand-new framework of the stochastic CG method for solving linear systems. Our theoretical results are supported by numerical experiments.
SIAM 矩阵分析与应用期刊》,第 45 卷第 3 期,第 1259-1286 页,2024 年 9 月。 摘要。随机重球动量(SHBM)方法作为一种解决大规模优化问题的可扩展方法,已经获得了相当高的人气。然而,这种方法的一个局限是它依赖于某些问题参数的先验知识,如矩阵的奇异值。在本文中,我们提出了一种 SHBM 方法的自适应变体,用于解决使用用户定义分布从线性系统重新表述的随机问题。我们的自适应 SHBM(ASHBM)方法利用迭代信息更新参数,解决了文献中关于动量参数自适应学习的一个未决问题。我们证明,我们的方法在期望值上线性收敛,与基本方法相比,收敛约束更好。值得注意的是,我们证明了我们的 ASHBM 算法的确定性版本可以重新表述为共轭梯度(CG)方法的变体,继承了其许多吸引人的特性,如有限时间收敛。因此,ASHBM 方法可以进一步推广,发展出一种全新的用于求解线性系统的随机共轭梯度法框架。我们的理论结果得到了数值实验的支持。
{"title":"On Adaptive Stochastic Heavy Ball Momentum for Solving Linear Systems","authors":"Yun Zeng, Deren Han, Yansheng Su, Jiaxin Xie","doi":"10.1137/23m1575883","DOIUrl":"https://doi.org/10.1137/23m1575883","url":null,"abstract":"SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 3, Page 1259-1286, September 2024. <br/> Abstract. The stochastic heavy ball momentum (SHBM) method has gained considerable popularity as a scalable approach for solving large-scale optimization problems. However, one limitation of this method is its reliance on prior knowledge of certain problem parameters, such as singular values of a matrix. In this paper, we propose an adaptive variant of the SHBM method for solving stochastic problems that are reformulated from linear systems using user-defined distributions. Our adaptive SHBM (ASHBM) method utilizes iterative information to update the parameters, addressing an open problem in the literature regarding the adaptive learning of momentum parameters. We prove that our method converges linearly in expectation, with a better convergence bound compared to the basic method. Notably, we demonstrate that the deterministic version of our ASHBM algorithm can be reformulated as a variant of the conjugate gradient (CG) method, inheriting many of its appealing properties, such as finite-time convergence. Consequently, the ASHBM method can be further generalized to develop a brand-new framework of the stochastic CG method for solving linear systems. Our theoretical results are supported by numerical experiments.","PeriodicalId":49538,"journal":{"name":"SIAM Journal on Matrix Analysis and Applications","volume":"14 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-07-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141570800","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
One-Dimensional Tensor Network Recovery 一维张量网络恢复
IF 1.5 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-07-01 DOI: 10.1137/23m159888x
Ziang Chen, Jianfeng Lu, Anru Zhang
SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 3, Page 1217-1244, September 2024.
Abstract. We study the recovery of the underlying graphs or permutations for tensors in the tensor ring or tensor train format. Our proposed algorithms compare the matricization ranks after down-sampling, whose complexity is [math] for [math]th-order tensors. We prove that our algorithms can almost surely recover the correct graph or permutation when tensor entries can be observed without noise. We further establish the robustness of our algorithms against observational noise. The theoretical results are validated by numerical experiments.
SIAM 矩阵分析与应用期刊》,第 45 卷第 3 期,第 1217-1244 页,2024 年 9 月。 摘要我们研究了张量环或张量列车格式中张量的底层图或排列的恢复。我们提出的算法比较了向下采样后的矩阵化等级,对于[math]阶张量,其复杂度为[math]。我们证明,当张量条目可以无噪声观测时,我们的算法几乎肯定能恢复正确的图或排列。我们进一步确定了我们的算法对观测噪声的鲁棒性。数值实验验证了理论结果。
{"title":"One-Dimensional Tensor Network Recovery","authors":"Ziang Chen, Jianfeng Lu, Anru Zhang","doi":"10.1137/23m159888x","DOIUrl":"https://doi.org/10.1137/23m159888x","url":null,"abstract":"SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 3, Page 1217-1244, September 2024. <br/> Abstract. We study the recovery of the underlying graphs or permutations for tensors in the tensor ring or tensor train format. Our proposed algorithms compare the matricization ranks after down-sampling, whose complexity is [math] for [math]th-order tensors. We prove that our algorithms can almost surely recover the correct graph or permutation when tensor entries can be observed without noise. We further establish the robustness of our algorithms against observational noise. The theoretical results are validated by numerical experiments.","PeriodicalId":49538,"journal":{"name":"SIAM Journal on Matrix Analysis and Applications","volume":"7 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141527080","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On Compatible Transfer Operators in Nonsymmetric Algebraic Multigrid 论非对称代数多网格中的兼容转移算子
IF 1.5 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-07-01 DOI: 10.1137/23m1586069
Ben S. Southworth, Thomas A. Manteuffel
SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 3, Page 1245-1258, September 2024.
Abstract. The standard goal for an effective algebraic multigrid (AMG) algorithm is to develop relaxation and coarse-grid correction schemes that attenuate complementary error modes. In the nonsymmetric setting, coarse-grid correction [math] will almost certainly be nonorthogonal (and divergent) in any known standard product, meaning [math]. This introduces a new consideration, that one wants coarse-grid correction to be as close to orthogonal as possible, in an appropriate norm. In addition, due to nonorthogonality, [math] may actually amplify certain error modes that are in the range of interpolation. Relaxation must then not only be complementary to interpolation, but also rapidly eliminate any error amplified by the nonorthogonal correction, or the algorithm may diverge. This paper develops analytic formulae on how to construct “compatible” transfer operators in nonsymmetric AMG such that [math] in some standard matrix-induced norm. Discussion is provided on different options for the norm in the nonsymmetric setting, the relation between “ideal” transfer operators in different norms, and insight into the convergence of nonsymmetric reduction-based AMG.
SIAM 矩阵分析与应用期刊》,第 45 卷,第 3 期,第 1245-1258 页,2024 年 9 月。 摘要。有效代数多网格(AMG)算法的标准目标是开发能减弱互补误差模式的松弛和粗网格修正方案。在非对称环境下,粗网格校正[数学]几乎肯定在任何已知标准乘积中都是非正交(和发散)的,即[数学]。这就引入了一个新的考虑因素,即我们希望粗栅校正在适当的规范下尽可能接近正交。此外,由于非正交性,[math] 实际上可能会放大插值范围内的某些误差模式。因此,松弛不仅必须与插值相辅相成,还必须迅速消除非正交校正所放大的任何误差,否则算法可能会出现偏差。本文提出了如何在非对称 AMG 中构建 "兼容 "转移算子的解析公式,使得 [math] 在某种标准矩阵诱导规范中。本文还讨论了非对称设置中的不同规范选项、不同规范中 "理想 "转移算子之间的关系,以及对基于非对称还原的 AMG 收敛性的见解。
{"title":"On Compatible Transfer Operators in Nonsymmetric Algebraic Multigrid","authors":"Ben S. Southworth, Thomas A. Manteuffel","doi":"10.1137/23m1586069","DOIUrl":"https://doi.org/10.1137/23m1586069","url":null,"abstract":"SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 3, Page 1245-1258, September 2024. <br/> Abstract. The standard goal for an effective algebraic multigrid (AMG) algorithm is to develop relaxation and coarse-grid correction schemes that attenuate complementary error modes. In the nonsymmetric setting, coarse-grid correction [math] will almost certainly be nonorthogonal (and divergent) in any known standard product, meaning [math]. This introduces a new consideration, that one wants coarse-grid correction to be as close to orthogonal as possible, in an appropriate norm. In addition, due to nonorthogonality, [math] may actually amplify certain error modes that are in the range of interpolation. Relaxation must then not only be complementary to interpolation, but also rapidly eliminate any error amplified by the nonorthogonal correction, or the algorithm may diverge. This paper develops analytic formulae on how to construct “compatible” transfer operators in nonsymmetric AMG such that [math] in some standard matrix-induced norm. Discussion is provided on different options for the norm in the nonsymmetric setting, the relation between “ideal” transfer operators in different norms, and insight into the convergence of nonsymmetric reduction-based AMG.","PeriodicalId":49538,"journal":{"name":"SIAM Journal on Matrix Analysis and Applications","volume":"21 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141509739","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Erratum: Properties of the Solution Set of Absolute Value Equations and the Related Matrix Classes 勘误:绝对值方程解集及相关矩阵类的性质
IF 1.5 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-06-26 DOI: 10.1137/24m1635715
Milan Hladík
SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 2, Page 1215-1215, June 2024.
Abstract. A typo in the paper [M. Hladík, SIAM J. Matrix Anal. Appl., 44 (2023), pp. 175–195] is corrected.
SIAM 矩阵分析与应用期刊》,第 45 卷,第 2 期,第 1215-1215 页,2024 年 6 月。 摘要。论文 [M. Hladík, SIAM J. Matrix Anal. Appl., 44 (2023), pp.
{"title":"Erratum: Properties of the Solution Set of Absolute Value Equations and the Related Matrix Classes","authors":"Milan Hladík","doi":"10.1137/24m1635715","DOIUrl":"https://doi.org/10.1137/24m1635715","url":null,"abstract":"SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 2, Page 1215-1215, June 2024. <br/> Abstract. A typo in the paper [M. Hladík, SIAM J. Matrix Anal. Appl., 44 (2023), pp. 175–195] is corrected.","PeriodicalId":49538,"journal":{"name":"SIAM Journal on Matrix Analysis and Applications","volume":"28 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141509741","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Fast and Accurate Randomized Algorithms for Linear Systems and Eigenvalue Problems 线性系统和特征值问题的快速准确随机算法
IF 1.5 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-06-20 DOI: 10.1137/23m1565413
Yuji Nakatsukasa, Joel A. Tropp
SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 2, Page 1183-1214, June 2024.
Abstract. This paper develops a class of algorithms for general linear systems and eigenvalue problems. These algorithms apply fast randomized dimension reduction (“sketching”) to accelerate standard subspace projection methods, such as GMRES and Rayleigh–Ritz. This modification makes it possible to incorporate nontraditional bases for the approximation subspace that are easier to construct. When the basis is numerically full rank, the new algorithms have accuracy similar to classic methods but run faster and may use less storage. For model problems, numerical experiments show large advantages over the optimized MATLAB routines, including a [math] speedup over [math] and a [math] speedup over [math].
SIAM 矩阵分析与应用期刊》,第 45 卷,第 2 期,第 1183-1214 页,2024 年 6 月。 摘要本文针对一般线性系统和特征值问题开发了一类算法。这些算法采用快速随机降维("勾勒")来加速标准子空间投影方法,如 GMRES 和 Rayleigh-Ritz。通过这种修改,可以为近似子空间加入更容易构建的非传统基。当基在数值上是满级时,新算法的精度与经典方法相似,但运行速度更快,使用的存储空间也更少。对于模型问题,数值实验表明,优化后的 MATLAB 例程具有很大优势,包括比[math]快[math],比[math]快[math]。
{"title":"Fast and Accurate Randomized Algorithms for Linear Systems and Eigenvalue Problems","authors":"Yuji Nakatsukasa, Joel A. Tropp","doi":"10.1137/23m1565413","DOIUrl":"https://doi.org/10.1137/23m1565413","url":null,"abstract":"SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 2, Page 1183-1214, June 2024. <br/> Abstract. This paper develops a class of algorithms for general linear systems and eigenvalue problems. These algorithms apply fast randomized dimension reduction (“sketching”) to accelerate standard subspace projection methods, such as GMRES and Rayleigh–Ritz. This modification makes it possible to incorporate nontraditional bases for the approximation subspace that are easier to construct. When the basis is numerically full rank, the new algorithms have accuracy similar to classic methods but run faster and may use less storage. For model problems, numerical experiments show large advantages over the optimized MATLAB routines, including a [math] speedup over [math] and a [math] speedup over [math].","PeriodicalId":49538,"journal":{"name":"SIAM Journal on Matrix Analysis and Applications","volume":"134 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141509740","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
SIAM Journal on Matrix Analysis and Applications
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1