首页 > 最新文献

Numerical Linear Algebra with Applications最新文献

英文 中文
Preconditioned discontinuous Galerkin method and convection-diffusion-reaction problems with guaranteed bounds to resulting spectra 预处理非连续伽勒金方法和对流-扩散-反应问题与结果谱的保证边界
IF 4.3 3区 数学 Q1 MATHEMATICS Pub Date : 2024-02-08 DOI: 10.1002/nla.2549
Liya Gaynutdinova, Martin Ladecký, Ivana Pultarová, Miloslav Vlasák, Jan Zeman
This paper focuses on the design, analysis and implementation of a new preconditioning concept for linear second order partial differential equations, including the convection-diffusion-reaction problems discretized by Galerkin or discontinuous Galerkin methods. We expand on the approach introduced by Gergelits et al. and adapt it to the more general settings, assuming that both the original and preconditioning matrices are composed of sparse matrices of very low ranks, representing local contributions to the global matrices. When applied to a symmetric problem, the method provides bounds to all individual eigenvalues of the preconditioned matrix. We show that this preconditioning strategy works not only for Galerkin discretization, but also for the discontinuous Galerkin discretization, where local contributions are associated with individual edges of the triangulation. In the case of nonsymmetric problems, the method yields guaranteed bounds to real and imaginary parts of the resulting eigenvalues. We include some numerical experiments illustrating the method and its implementation, showcasing its effectiveness for the two variants of discretized (convection-)diffusion-reaction problems.
本文重点介绍线性二阶偏微分方程新预处理概念的设计、分析和实施,包括采用 Galerkin 或非连续 Galerkin 方法离散化的对流-扩散-反应问题。我们扩展了 Gergelits 等人提出的方法,并将其应用于更一般的环境,假设原始矩阵和预处理矩阵都是由秩非常低的稀疏矩阵组成,代表对全局矩阵的局部贡献。当应用于对称问题时,该方法为预处理矩阵的所有单个特征值提供了边界。我们证明,这种预处理策略不仅适用于 Galerkin 离散化,也适用于非连续 Galerkin 离散化,其中局部贡献与三角形的各个边相关。在非对称问题的情况下,该方法能保证对所得到的特征值的实部和虚部进行约束。我们通过一些数值实验说明了该方法及其实现,展示了该方法在离散化(对流)扩散反应问题的两种变体中的有效性。
{"title":"Preconditioned discontinuous Galerkin method and convection-diffusion-reaction problems with guaranteed bounds to resulting spectra","authors":"Liya Gaynutdinova, Martin Ladecký, Ivana Pultarová, Miloslav Vlasák, Jan Zeman","doi":"10.1002/nla.2549","DOIUrl":"https://doi.org/10.1002/nla.2549","url":null,"abstract":"This paper focuses on the design, analysis and implementation of a new preconditioning concept for linear second order partial differential equations, including the convection-diffusion-reaction problems discretized by Galerkin or discontinuous Galerkin methods. We expand on the approach introduced by Gergelits et al. and adapt it to the more general settings, assuming that both the original and preconditioning matrices are composed of sparse matrices of very low ranks, representing local contributions to the global matrices. When applied to a symmetric problem, the method provides bounds to all individual eigenvalues of the preconditioned matrix. We show that this preconditioning strategy works not only for Galerkin discretization, but also for the discontinuous Galerkin discretization, where local contributions are associated with individual edges of the triangulation. In the case of nonsymmetric problems, the method yields guaranteed bounds to real and imaginary parts of the resulting eigenvalues. We include some numerical experiments illustrating the method and its implementation, showcasing its effectiveness for the two variants of discretized (convection-)diffusion-reaction problems.","PeriodicalId":49731,"journal":{"name":"Numerical Linear Algebra with Applications","volume":"276 1","pages":""},"PeriodicalIF":4.3,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139768267","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Normalized Newton method to solve generalized tensor eigenvalue problems 解决广义张量特征值问题的归一化牛顿法
IF 4.3 3区 数学 Q1 MATHEMATICS Pub Date : 2024-01-09 DOI: 10.1002/nla.2547
Mehri Pakmanesh, Hamidreza Afshin, Masoud Hajarian
The problem of generalized tensor eigenvalue is the focus of this paper. To solve the problem, we suggest using the normalized Newton generalized eigenproblem approach (NNGEM). Since the rate of convergence of the spectral gradient projection method (SGP), the generalized eigenproblem adaptive power (GEAP), and other approaches is only linear, they are significantly improved by our proposed method, which is demonstrated to be locally and cubically convergent. Additionally, the modified normalized Newton method (MNNM), which converges to symmetric tensors Z-eigenpairs under the same γ�$$ gamma $$�-Newton stability requirement, is extended by the NNGEM technique. Using a Gröbner basis, a polynomial system solver (NSolve) generates all of the real eigenvalues for us. To illustrate the efficacy of our methodology, we present a few numerical findings.
广义张量特征值问题是本文的重点。为了解决这个问题,我们建议使用归一化牛顿广义特征问题方法(NNGEM)。由于频谱梯度投影法(SGP)、广义特征问题自适应功率法(GEAP)和其他方法的收敛速度只是线性的,而我们提出的方法能显著改善它们的收敛速度,并证明其具有局部收敛性和立方收敛性。此外,改进的归一化牛顿法(MNNM)在相同的 γ$$ gamma $$-Newton 稳定性要求下收敛于对称张量 Z 特征对,该方法由 NNGEM 技术扩展而来。多项式系统求解器(NSolve)使用格罗布纳基,为我们生成所有实特征值。为了说明我们的方法的有效性,我们给出了一些数值结果。
{"title":"Normalized Newton method to solve generalized tensor eigenvalue problems","authors":"Mehri Pakmanesh, Hamidreza Afshin, Masoud Hajarian","doi":"10.1002/nla.2547","DOIUrl":"https://doi.org/10.1002/nla.2547","url":null,"abstract":"The problem of generalized tensor eigenvalue is the focus of this paper. To solve the problem, we suggest using the normalized Newton generalized eigenproblem approach (NNGEM). Since the rate of convergence of the spectral gradient projection method (SGP), the generalized eigenproblem adaptive power (GEAP), and other approaches is only linear, they are significantly improved by our proposed method, which is demonstrated to be locally and cubically convergent. Additionally, the modified normalized Newton method (MNNM), which converges to symmetric tensors Z-eigenpairs under the same <math altimg=\"urn:x-wiley:nla:media:nla2547:nla2547-math-0003\" display=\"inline\" location=\"graphic/nla2547-math-0003.png\" overflow=\"scroll\">\u0000<semantics>\u0000<mrow>\u0000<mi>γ</mi>\u0000</mrow>\u0000$$ gamma $$</annotation>\u0000</semantics></math>-Newton stability requirement, is extended by the NNGEM technique. Using a Gröbner basis, a polynomial system solver (NSolve) generates all of the real eigenvalues for us. To illustrate the efficacy of our methodology, we present a few numerical findings.","PeriodicalId":49731,"journal":{"name":"Numerical Linear Algebra with Applications","volume":"52 1","pages":""},"PeriodicalIF":4.3,"publicationDate":"2024-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139408676","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Matrix‐less methods for the spectral approximation of large non‐Hermitian Toeplitz matrices: A concise theoretical analysis and a numerical study 大型非ermitian Toeplitz 矩阵谱近似的无矩阵方法:简明理论分析与数值研究
IF 4.3 3区 数学 Q1 MATHEMATICS Pub Date : 2024-01-04 DOI: 10.1002/nla.2545
M. Bogoya, Sven-Erik Ekström, S. Serra‐Capizzano, P. Vassalos
It is known that the generating function of a sequence of Toeplitz matrices may not describe the asymptotic distribution of the eigenvalues of the considered matrix sequence in the non‐Hermitian setting. In a recent work, under the assumption that the eigenvalues are real, admitting an asymptotic expansion whose first term is the distribution function, fast algorithms computing all the spectra were proposed in different settings. In the current work, we extend this idea to non‐Hermitian Toeplitz matrices with complex eigenvalues, in the case where the range of the generating function does not disconnect the complex field or the limiting set of the spectra, as the matrix‐size tends to infinity, has one nonclosed analytic arc. For a generating function having a power singularity, we prove the existence of an asymptotic expansion, that can be used as a theoretical base for the respective numerical algorithm. Different generating functions are explored, highlighting different numerical and theoretical aspects; for example, non‐Hermitian and complex symmetric matrix sequences, the reconstruction of the generating function, a consistent eigenvalue ordering, the requirements of high‐precision data types. Several numerical experiments are reported and critically discussed, and avenues of possible future research are presented.
众所周知,托普利兹矩阵序列的生成函数可能无法描述所考虑的矩阵序列特征值在非赫米提环境下的渐近分布。在最近的一项工作中,在假设特征值为实数、允许渐近展开(其第一项为分布函数)的前提下,提出了在不同环境下计算所有频谱的快速算法。在当前的工作中,我们将这一想法扩展到了具有复特征值的非赫米梯托普利兹矩阵,即在生成函数的范围不与复数场断开或随着矩阵大小趋于无穷大,谱的极限集有一个非封闭解析弧的情况下。对于具有幂奇异性的生成函数,我们证明了渐近展开的存在,它可用作相应数值算法的理论基础。我们探讨了不同的生成函数,强调了不同的数值和理论方面;例如,非ermitian 和复杂对称矩阵序列、生成函数的重构、一致的特征值排序、高精度数据类型的要求。报告对几个数值实验进行了批判性讨论,并提出了未来可能的研究方向。
{"title":"Matrix‐less methods for the spectral approximation of large non‐Hermitian Toeplitz matrices: A concise theoretical analysis and a numerical study","authors":"M. Bogoya, Sven-Erik Ekström, S. Serra‐Capizzano, P. Vassalos","doi":"10.1002/nla.2545","DOIUrl":"https://doi.org/10.1002/nla.2545","url":null,"abstract":"It is known that the generating function of a sequence of Toeplitz matrices may not describe the asymptotic distribution of the eigenvalues of the considered matrix sequence in the non‐Hermitian setting. In a recent work, under the assumption that the eigenvalues are real, admitting an asymptotic expansion whose first term is the distribution function, fast algorithms computing all the spectra were proposed in different settings. In the current work, we extend this idea to non‐Hermitian Toeplitz matrices with complex eigenvalues, in the case where the range of the generating function does not disconnect the complex field or the limiting set of the spectra, as the matrix‐size tends to infinity, has one nonclosed analytic arc. For a generating function having a power singularity, we prove the existence of an asymptotic expansion, that can be used as a theoretical base for the respective numerical algorithm. Different generating functions are explored, highlighting different numerical and theoretical aspects; for example, non‐Hermitian and complex symmetric matrix sequences, the reconstruction of the generating function, a consistent eigenvalue ordering, the requirements of high‐precision data types. Several numerical experiments are reported and critically discussed, and avenues of possible future research are presented.","PeriodicalId":49731,"journal":{"name":"Numerical Linear Algebra with Applications","volume":"88 12","pages":""},"PeriodicalIF":4.3,"publicationDate":"2024-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139386270","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Practical sketching-based randomized tensor ring decomposition 基于草图的实用随机张量环分解
IF 4.3 3区 数学 Q1 MATHEMATICS Pub Date : 2024-01-02 DOI: 10.1002/nla.2548
Yajie Yu, Hanyu Li
Based on sketching techniques, we propose two practical randomized algorithms for tensor ring (TR) decomposition. Specifically, on the basis of defining new tensor products and investigating their properties, the two algorithms are devised by applying the Kronecker sub-sampled randomized Fourier transform and TensorSketch to the alternating least squares subproblems derived from the minimization problem of TR decomposition. From the former, we find an algorithmic framework based on random projection for randomized TR decomposition. We compare our proposals with the existing methods using both synthetic and real data. Numerical results show that they have quite decent performance in accuracy and computing time.
基于草图技术,我们提出了两种实用的张量环(TR)分解随机算法。具体地说,在定义新的张量乘积并研究其性质的基础上,将克朗内克子采样随机傅里叶变换和 TensorSketch 应用于 TR 分解最小化问题衍生出的交替最小二乘子问题,从而设计出这两种算法。从前者出发,我们找到了基于随机投影的随机 TR 分解算法框架。我们使用合成数据和真实数据将我们的建议与现有方法进行了比较。数值结果表明,它们在准确性和计算时间上都有相当不错的表现。
{"title":"Practical sketching-based randomized tensor ring decomposition","authors":"Yajie Yu, Hanyu Li","doi":"10.1002/nla.2548","DOIUrl":"https://doi.org/10.1002/nla.2548","url":null,"abstract":"Based on sketching techniques, we propose two practical randomized algorithms for tensor ring (TR) decomposition. Specifically, on the basis of defining new tensor products and investigating their properties, the two algorithms are devised by applying the Kronecker sub-sampled randomized Fourier transform and TensorSketch to the alternating least squares subproblems derived from the minimization problem of TR decomposition. From the former, we find an algorithmic framework based on random projection for randomized TR decomposition. We compare our proposals with the existing methods using both synthetic and real data. Numerical results show that they have quite decent performance in accuracy and computing time.","PeriodicalId":49731,"journal":{"name":"Numerical Linear Algebra with Applications","volume":"27 1","pages":""},"PeriodicalIF":4.3,"publicationDate":"2024-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139408905","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Robust block diagonal preconditioners for poroelastic problems with strongly heterogeneous material 强异质材料孔弹性问题的稳健分块对角线预处理器
IF 4.3 3区 数学 Q1 MATHEMATICS Pub Date : 2023-12-26 DOI: 10.1002/nla.2546
Tomáš Luber, Stanislav Sysala
This paper focuses on the analysis and the solution of the saddle-point problem arising from a three-field formulation of Biot's model of poroelasticity, discretized in time by the implicit Euler method. A block diagonal-preconditioner, based on the Schur complement, is analyzed on a functional level and compared with two other block-diagonal preconditioners having a similar structure. The problem is discretized in space using mixed finite elements and solved with appropriate iterative solvers, incorporating the investigated preconditioners. The solvers are tested on numerical examples inspired by geotechnical practice, with particular attention devoted to the solvers' robustness concerning strong heterogeneity in permeability.
本文重点分析和解决了用隐式欧拉法进行时间离散的 Biot 孔弹性模型的三场公式所产生的鞍点问题。基于舒尔补码的块对角线预处理在函数层面上进行了分析,并与其他两个具有类似结构的块对角线预处理进行了比较。使用混合有限元对问题进行空间离散化,并使用适当的迭代求解器结合所研究的预处理器进行求解。这些求解器在受岩土工程实践启发的数值示例中进行了测试,并特别关注了求解器对渗透性强异质性的鲁棒性。
{"title":"Robust block diagonal preconditioners for poroelastic problems with strongly heterogeneous material","authors":"Tomáš Luber, Stanislav Sysala","doi":"10.1002/nla.2546","DOIUrl":"https://doi.org/10.1002/nla.2546","url":null,"abstract":"This paper focuses on the analysis and the solution of the saddle-point problem arising from a three-field formulation of Biot's model of poroelasticity, discretized in time by the implicit Euler method. A block diagonal-preconditioner, based on the Schur complement, is analyzed on a functional level and compared with two other block-diagonal preconditioners having a similar structure. The problem is discretized in space using mixed finite elements and solved with appropriate iterative solvers, incorporating the investigated preconditioners. The solvers are tested on numerical examples inspired by geotechnical practice, with particular attention devoted to the solvers' robustness concerning strong heterogeneity in permeability.","PeriodicalId":49731,"journal":{"name":"Numerical Linear Algebra with Applications","volume":"26 1","pages":""},"PeriodicalIF":4.3,"publicationDate":"2023-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139052970","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Generalizing reduction-based algebraic multigrid 推广基于还原的代数多网格
IF 4.3 3区 数学 Q1 MATHEMATICS Pub Date : 2023-12-18 DOI: 10.1002/nla.2543
Tareq Zaman, Nicolas Nytko, Ali Taghibakhshi, Scott MacLachlan, Luke Olson, Matthew West
Algebraic multigrid (AMG) methods are often robust and effective solvers for solving the large and sparse linear systems that arise from discretized PDEs and other problems, relying on heuristic graph algorithms to achieve their performance. Reduction-based AMG (AMGr) algorithms attempt to formalize these heuristics by providing two-level convergence bounds that depend concretely on properties of the partitioning of the given matrix into its fine- and coarse-grid degrees of freedom. MacLachlan and Saad (SISC 2007) proved that the AMGr method yields provably robust two-level convergence for symmetric and positive-definite matrices that are diagonally dominant, with a convergence factor bounded as a function of a coarsening parameter. However, when applying AMGr algorithms to matrices that are not diagonally dominant, not only do the convergence factor bounds not hold, but measured performance is notably degraded. Here, we present modifications to the classical AMGr algorithm that improve its performance on matrices that are not diagonally dominant, making use of strength of connection, sparse approximate inverse (SPAI) techniques, and interpolation truncation and rescaling, to improve robustness while maintaining control of the algorithmic costs. We present numerical results demonstrating the robustness of this approach for both classical isotropic diffusion problems and for non-diagonally dominant systems coming from anisotropic diffusion.
代数多网格(AMG)方法通常是稳健而有效的求解器,用于求解离散化 PDE 和其他问题所产生的大型稀疏线性系统,依靠启发式图算法实现其性能。基于还原的 AMG(AMGr)算法试图将这些启发式算法正规化,提供两级收敛边界,具体取决于将给定矩阵划分为细格和粗格自由度的属性。MacLachlan 和 Saad(SISC,2007 年)证明,AMGr 方法对对称矩阵和正定矩阵产生了可证明的稳健两级收敛,这些矩阵是对角线占优的,收敛因子的边界是粗化参数的函数。然而,当将 AMGr 算法应用于非对角优势矩阵时,不仅收敛因子边界不成立,而且测得的性能也明显下降。在这里,我们提出了对经典 AMGr 算法的修改,利用连接强度、稀疏近似逆(SPAI)技术、插值截断和重缩放,在保持对算法成本控制的同时,提高了该算法在非对角占优矩阵上的性能。我们展示的数值结果表明,这种方法对于经典的各向同性扩散问题和来自各向异性扩散的非对角主导系统都具有稳健性。
{"title":"Generalizing reduction-based algebraic multigrid","authors":"Tareq Zaman, Nicolas Nytko, Ali Taghibakhshi, Scott MacLachlan, Luke Olson, Matthew West","doi":"10.1002/nla.2543","DOIUrl":"https://doi.org/10.1002/nla.2543","url":null,"abstract":"Algebraic multigrid (AMG) methods are often robust and effective solvers for solving the large and sparse linear systems that arise from discretized PDEs and other problems, relying on heuristic graph algorithms to achieve their performance. Reduction-based AMG (AMGr) algorithms attempt to formalize these heuristics by providing two-level convergence bounds that depend concretely on properties of the partitioning of the given matrix into its fine- and coarse-grid degrees of freedom. MacLachlan and Saad (SISC 2007) proved that the AMGr method yields provably robust two-level convergence for symmetric and positive-definite matrices that are diagonally dominant, with a convergence factor bounded as a function of a coarsening parameter. However, when applying AMGr algorithms to matrices that are not diagonally dominant, not only do the convergence factor bounds not hold, but measured performance is notably degraded. Here, we present modifications to the classical AMGr algorithm that improve its performance on matrices that are not diagonally dominant, making use of strength of connection, sparse approximate inverse (SPAI) techniques, and interpolation truncation and rescaling, to improve robustness while maintaining control of the algorithmic costs. We present numerical results demonstrating the robustness of this approach for both classical isotropic diffusion problems and for non-diagonally dominant systems coming from anisotropic diffusion.","PeriodicalId":49731,"journal":{"name":"Numerical Linear Algebra with Applications","volume":"13 1","pages":""},"PeriodicalIF":4.3,"publicationDate":"2023-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138824407","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An iterative algorithm for low-rank tensor completion problem with sparse noise and missing values 具有稀疏噪声和缺失值的低阶张量补全问题的迭代算法
IF 4.3 3区 数学 Q1 MATHEMATICS Pub Date : 2023-12-17 DOI: 10.1002/nla.2544
Jianheng Chen, Wen Huang
Robust low-rank tensor completion plays an important role in multidimensional data analysis against different degradations, such as sparse noise, and missing entries, and has a variety of applications in image processing and computer vision. In this paper, an optimization model for low-rank tensor completion problems is proposed and a block coordinate descent algorithm is developed to solve this model. It is shown that for one of the subproblems, the closed-form solution exists and for the other, a Riemannian conjugate gradient algorithm is used. In particular, when all elements are known, that is, no missing values, the block coordinate descent is simplified in the sense that both subproblems have closed-form solutions. The convergence analysis is established without requiring the latter subproblem to be solved exactly. Numerical experiments illustrate that the proposed model with the algorithm is feasible and effective.
稳健的低秩张量补全在多维数据分析中发挥着重要作用,可抵御稀疏噪声、缺失条目等不同劣化情况,在图像处理和计算机视觉中有着广泛的应用。本文提出了低秩张量补全问题的优化模型,并开发了一种块坐标下降算法来求解该模型。研究表明,对于其中一个子问题,存在闭式解,而对于另一个子问题,则使用黎曼共轭梯度算法。特别是,当所有元素都已知,即没有缺失值时,块坐标下降就会简化,即两个子问题都有闭式解。收敛分析的建立不需要精确求解后一个子问题。数值实验表明,所提出的模型和算法是可行和有效的。
{"title":"An iterative algorithm for low-rank tensor completion problem with sparse noise and missing values","authors":"Jianheng Chen, Wen Huang","doi":"10.1002/nla.2544","DOIUrl":"https://doi.org/10.1002/nla.2544","url":null,"abstract":"Robust low-rank tensor completion plays an important role in multidimensional data analysis against different degradations, such as sparse noise, and missing entries, and has a variety of applications in image processing and computer vision. In this paper, an optimization model for low-rank tensor completion problems is proposed and a block coordinate descent algorithm is developed to solve this model. It is shown that for one of the subproblems, the closed-form solution exists and for the other, a Riemannian conjugate gradient algorithm is used. In particular, when all elements are known, that is, no missing values, the block coordinate descent is simplified in the sense that both subproblems have closed-form solutions. The convergence analysis is established without requiring the latter subproblem to be solved exactly. Numerical experiments illustrate that the proposed model with the algorithm is feasible and effective.","PeriodicalId":49731,"journal":{"name":"Numerical Linear Algebra with Applications","volume":"38 1","pages":""},"PeriodicalIF":4.3,"publicationDate":"2023-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138716923","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Practical alternating least squares for tensor ring decomposition 张量环分解的实用交替最小二乘法
IF 4.3 3区 数学 Q1 MATHEMATICS Pub Date : 2023-12-10 DOI: 10.1002/nla.2542
Yajie Yu, Hanyu Li
Tensor ring (TR) decomposition has been widely applied as an effective approach in a variety of applications to discover the hidden low-rank patterns in multidimensional and higher-order data. A well-known method for TR decomposition is the alternating least squares (ALS). However, solving the ALS subproblems often suffers from high cost issue, especially for large-scale tensors. In this paper, we provide two strategies to tackle this issue and design three ALS-based algorithms. Specifically, the first strategy is used to simplify the calculation of the coefficient matrices of the normal equations for the ALS subproblems, which takes full advantage of the structure of the coefficient matrices of the subproblems and hence makes the corresponding algorithm perform much better than the regular ALS method in terms of computing time. The second strategy is to stabilize the ALS subproblems by QR factorizations on TR-cores, and hence the corresponding algorithms are more numerically stable compared with our first algorithm. Extensive numerical experiments on synthetic and real data are given to illustrate and confirm the above results. In addition, we also present the complexity analyses of the proposed algorithms.
张量环分解(Tensor ring, TR)作为一种发现多维高阶数据中隐藏的低秩模式的有效方法,已被广泛应用于各种应用中。一种众所周知的TR分解方法是交替最小二乘(ALS)。然而,求解ALS子问题往往面临高成本问题,特别是对于大规模张量。在本文中,我们提供了两种策略来解决这个问题,并设计了三种基于als的算法。具体而言,采用第一种策略简化了ALS子问题正规方程系数矩阵的计算,充分利用了子问题系数矩阵的结构,使得相应的算法在计算时间上大大优于常规的ALS方法。第二种策略是通过tr核上的QR分解来稳定ALS子问题,因此相应的算法比我们的第一种算法在数值上更稳定。通过大量的综合和实际数据的数值实验来说明和证实上述结果。此外,我们还对所提出的算法进行了复杂度分析。
{"title":"Practical alternating least squares for tensor ring decomposition","authors":"Yajie Yu, Hanyu Li","doi":"10.1002/nla.2542","DOIUrl":"https://doi.org/10.1002/nla.2542","url":null,"abstract":"Tensor ring (TR) decomposition has been widely applied as an effective approach in a variety of applications to discover the hidden low-rank patterns in multidimensional and higher-order data. A well-known method for TR decomposition is the alternating least squares (ALS). However, solving the ALS subproblems often suffers from high cost issue, especially for large-scale tensors. In this paper, we provide two strategies to tackle this issue and design three ALS-based algorithms. Specifically, the first strategy is used to simplify the calculation of the coefficient matrices of the normal equations for the ALS subproblems, which takes full advantage of the structure of the coefficient matrices of the subproblems and hence makes the corresponding algorithm perform much better than the regular ALS method in terms of computing time. The second strategy is to stabilize the ALS subproblems by QR factorizations on TR-cores, and hence the corresponding algorithms are more numerically stable compared with our first algorithm. Extensive numerical experiments on synthetic and real data are given to illustrate and confirm the above results. In addition, we also present the complexity analyses of the proposed algorithms.","PeriodicalId":49731,"journal":{"name":"Numerical Linear Algebra with Applications","volume":"4 1","pages":""},"PeriodicalIF":4.3,"publicationDate":"2023-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138632252","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Preconditioned weighted full orothogonalization method for solving singular linear systems from PageRank problems PageRank问题中奇异线性系统的预条件加权全正交化方法
3区 数学 Q1 MATHEMATICS Pub Date : 2023-11-10 DOI: 10.1002/nla.2541
Zhao‐Li Shen, Bruno Carpentieri, Chun Wen, Jian‐Jun Wang, Stefano Serra‐Capizzano, Shi‐Ping Du
Abstract The PageRank model, which was first proposed by Google for its web search engine application, has since become a popular computational tool in a wide range of scientific fields, including chemistry, bioinformatics, neuroscience, bibliometrics, social networks, and others. PageRank calculations necessitate the use of fast computational techniques with low algorithmic and memory complexity. In recent years, much attention has been paid to Krylov subspace algorithms for solving difficult PageRank linear systems, such as those with large damping parameters close to one. In this article, we examine the full orthogonalization method (FOM). We present a convergence study of the method that extends and clarifies part of the conclusions reached in Zhang et al. (J Comput Appl Math. 2016; 296:397–409.). Furthermore, we demonstrate that FOM is breakdown free when solving singular PageRank linear systems with index one and we investigate the effect of using weighted inner‐products instead of conventional inner‐products in the orthonormalization procedure on FOM convergence. Finally, we develop a shifted polynomial preconditioner that takes advantage of the special structure of the PageRank linear system and has a good ability to cluster most of the eigenvalues, making it a good choice for an iterative method like FOM or GMRES. Numerical experiments are presented to support the theoretical findings and to evaluate the performance of the new weighted preconditioned FOM PageRank solver in comparison to other established solvers for this class of problem, including conventional stationary methods, hybrid combinations of stationary and Krylov subspace methods, and multi‐step splitting strategies.
PageRank模型最早是由Google为其网络搜索引擎应用而提出的,现已成为广泛应用于化学、生物信息学、神经科学、文献计量学、社会网络等科学领域的一种流行计算工具。PageRank计算需要使用低算法和内存复杂度的快速计算技术。近年来,Krylov子空间算法得到了广泛的关注,用于求解复杂的PageRank线性系统,如具有接近1的大阻尼参数的系统。在本文中,我们研究了完全正交化方法(FOM)。我们对该方法进行了收敛性研究,扩展并澄清了Zhang等人得出的部分结论(J computer apple Math. 2016;296:397 - 409)。进一步,我们证明了FOM在求解索引为1的奇异PageRank线性系统时是无击穿的,并研究了在标准正交化过程中使用加权内积代替常规内积对FOM收敛性的影响。最后,我们开发了一个移位多项式预调节器,利用PageRank线性系统的特殊结构,具有很好的聚类大部分特征值的能力,使其成为FOM或GMRES等迭代方法的良好选择。通过数值实验来支持理论发现,并与其他已建立的此类问题的求解器(包括传统的平稳方法、平稳和Krylov子空间方法的混合组合以及多步分裂策略)进行了比较,评估了新的加权预条件FOM PageRank求解器的性能。
{"title":"Preconditioned weighted full orothogonalization method for solving singular linear systems from PageRank problems","authors":"Zhao‐Li Shen, Bruno Carpentieri, Chun Wen, Jian‐Jun Wang, Stefano Serra‐Capizzano, Shi‐Ping Du","doi":"10.1002/nla.2541","DOIUrl":"https://doi.org/10.1002/nla.2541","url":null,"abstract":"Abstract The PageRank model, which was first proposed by Google for its web search engine application, has since become a popular computational tool in a wide range of scientific fields, including chemistry, bioinformatics, neuroscience, bibliometrics, social networks, and others. PageRank calculations necessitate the use of fast computational techniques with low algorithmic and memory complexity. In recent years, much attention has been paid to Krylov subspace algorithms for solving difficult PageRank linear systems, such as those with large damping parameters close to one. In this article, we examine the full orthogonalization method (FOM). We present a convergence study of the method that extends and clarifies part of the conclusions reached in Zhang et al. (J Comput Appl Math. 2016; 296:397–409.). Furthermore, we demonstrate that FOM is breakdown free when solving singular PageRank linear systems with index one and we investigate the effect of using weighted inner‐products instead of conventional inner‐products in the orthonormalization procedure on FOM convergence. Finally, we develop a shifted polynomial preconditioner that takes advantage of the special structure of the PageRank linear system and has a good ability to cluster most of the eigenvalues, making it a good choice for an iterative method like FOM or GMRES. Numerical experiments are presented to support the theoretical findings and to evaluate the performance of the new weighted preconditioned FOM PageRank solver in comparison to other established solvers for this class of problem, including conventional stationary methods, hybrid combinations of stationary and Krylov subspace methods, and multi‐step splitting strategies.","PeriodicalId":49731,"journal":{"name":"Numerical Linear Algebra with Applications","volume":"114 7","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135138404","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Numerical methods for rectangular multiparameter eigenvalue problems, with applications to finding optimal ARMA and LTI models 矩形多参数特征值问题的数值方法,并应用于寻找最优ARMA和LTI模型
3区 数学 Q1 MATHEMATICS Pub Date : 2023-11-09 DOI: 10.1002/nla.2540
Michiel E. Hochstenbach, Tomaž Košir, Bor Plestenjak
Abstract Standard multiparameter eigenvalue problems (MEPs) are systems of linear ‐parameter square matrix pencils. Recently, a new form of multiparameter eigenvalue problems has emerged: a rectangular MEP (RMEP) with only one multivariate rectangular matrix pencil, where we are looking for combinations of the parameters for which the rank of the pencil is not full. Applications include finding the optimal least squares autoregressive moving average (ARMA) model and the optimal least squares realization of autonomous linear time‐invariant (LTI) dynamical system. For linear and polynomial RMEPs, we give the number of solutions and show how these problems can be solved numerically by a transformation into a standard MEP. For the transformation we provide new linearizations for quadratic multivariate matrix polynomials with a specific structure of monomials and consider mixed systems of rectangular and square multivariate matrix polynomials. This numerical approach seems computationally considerably more attractive than the block Macaulay method, the only other currently available numerical method for polynomial RMEPs.
标准多参数特征值问题(mep)是线性参数方阵铅笔系统。最近,出现了一种新的多参数特征值问题形式:一个只有一个多元矩形矩阵铅笔的矩形MEP (RMEP),我们寻找铅笔的秩不满的参数组合。应用包括寻找最优最小二乘自回归移动平均(ARMA)模型和自治线性时不变(LTI)动力系统的最优最小二乘实现。对于线性和多项式rmep,我们给出了解的数量,并展示了如何通过转换成标准的rmep来数值解决这些问题。对于变换,我们给出了具有特定单项式结构的二次多元矩阵多项式的新的线性化,并考虑了矩形和方形多元矩阵多项式的混合系统。这种数值方法在计算上似乎比block Macaulay方法更有吸引力,block Macaulay方法是目前唯一可用的多项式rmep数值方法。
{"title":"Numerical methods for rectangular multiparameter eigenvalue problems, with applications to finding optimal ARMA and LTI models","authors":"Michiel E. Hochstenbach, Tomaž Košir, Bor Plestenjak","doi":"10.1002/nla.2540","DOIUrl":"https://doi.org/10.1002/nla.2540","url":null,"abstract":"Abstract Standard multiparameter eigenvalue problems (MEPs) are systems of linear ‐parameter square matrix pencils. Recently, a new form of multiparameter eigenvalue problems has emerged: a rectangular MEP (RMEP) with only one multivariate rectangular matrix pencil, where we are looking for combinations of the parameters for which the rank of the pencil is not full. Applications include finding the optimal least squares autoregressive moving average (ARMA) model and the optimal least squares realization of autonomous linear time‐invariant (LTI) dynamical system. For linear and polynomial RMEPs, we give the number of solutions and show how these problems can be solved numerically by a transformation into a standard MEP. For the transformation we provide new linearizations for quadratic multivariate matrix polynomials with a specific structure of monomials and consider mixed systems of rectangular and square multivariate matrix polynomials. This numerical approach seems computationally considerably more attractive than the block Macaulay method, the only other currently available numerical method for polynomial RMEPs.","PeriodicalId":49731,"journal":{"name":"Numerical Linear Algebra with Applications","volume":" 17","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135242136","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Numerical Linear Algebra with Applications
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1