首页 > 最新文献

Foundations of Computational Mathematics最新文献

英文 中文
Discrete Pseudo-differential Operators and Applications to Numerical Schemes 离散伪微分算子及其在数值计算中的应用
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2024-02-15 DOI: 10.1007/s10208-024-09645-y
Erwan Faou, Benoît Grébert

We consider a class of discrete operators introduced by O. Chodosh, acting on infinite sequences and mimicking standard properties of pseudo-differential operators. By using a new approach, we extend this class to finite or periodic sequences, allowing a general representation of discrete pseudo-differential operators obtained by finite differences approximations and easily transferred to time discretizations. In particular we can define the notion of order and regularity, and we recover the fundamental property, well known in pseudo-differential calculus, that the commutator of two discrete operators gains one order of regularity. As examples of practical applications, we revisit standard error estimates for the convergence of splitting methods, obtaining in some Hamiltonian cases no loss of derivative in the error estimates, in particular for discretizations of general waves and/or water-waves equations. Moreover, we give an example of preconditioner constructions inspired by normal form analysis to deal with the similar question for more general cases.

我们考虑了由 O. Chodosh 引入的一类离散算子,它作用于无穷序列并模仿伪微分算子的标准特性。通过使用一种新方法,我们将该类算子扩展到有限序列或周期序列,从而可以对通过有限差分近似获得的离散伪微分算子进行一般表示,并轻松转移到时间离散化中。特别是,我们可以定义阶次和正则性的概念,并恢复了在伪微分学中众所周知的基本性质,即两个离散算子的换元获得一个阶次的正则性。作为实际应用的例子,我们重新审视了分裂方法收敛的标准误差估计,在某些哈密顿情况下,误差估计中没有导数损失,特别是对于一般波和/或水波方程的离散化。此外,我们还举例说明了受正则表达式分析启发的预处理构造,以解决更一般情况下的类似问题。
{"title":"Discrete Pseudo-differential Operators and Applications to Numerical Schemes","authors":"Erwan Faou, Benoît Grébert","doi":"10.1007/s10208-024-09645-y","DOIUrl":"https://doi.org/10.1007/s10208-024-09645-y","url":null,"abstract":"<p>We consider a class of discrete operators introduced by O. Chodosh, acting on infinite sequences and mimicking standard properties of pseudo-differential operators. By using a new approach, we extend this class to finite or periodic sequences, allowing a general representation of discrete pseudo-differential operators obtained by finite differences approximations and easily transferred to time discretizations. In particular we can define the notion of order and regularity, and we recover the fundamental property, well known in pseudo-differential calculus, that the commutator of two discrete operators gains one order of regularity. As examples of practical applications, we revisit standard error estimates for the convergence of splitting methods, obtaining in some Hamiltonian cases no loss of derivative in the error estimates, in particular for discretizations of general waves and/or water-waves equations. Moreover, we give an example of preconditioner constructions inspired by normal form analysis to deal with the similar question for more general cases.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"258 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139750263","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Strong Norm Error Bounds for Quasilinear Wave Equations Under Weak CFL-Type Conditions 弱 CFL 型条件下准线性波方程的强规范误差约束
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2024-02-13 DOI: 10.1007/s10208-024-09639-w
Benjamin Dörich

In the present paper, we consider a class of quasilinear wave equations on a smooth, bounded domain. We discretize it in space with isoparametric finite elements and apply a semi-implicit Euler and midpoint rule as well as the exponential Euler and midpoint rule to obtain four fully discrete schemes. We derive rigorous error bounds of optimal order for the semi-discretization in space and the fully discrete methods in norms which are stronger than the classical (H^1times L^2) energy norm under weak CFL-type conditions. To confirm our theoretical findings, we also present numerical experiments.

在本文中,我们考虑了光滑有界域上的一类准线性波方程。我们用等参数有限元对其进行空间离散化,并应用半隐式欧拉和中点规则以及指数式欧拉和中点规则得到四个全离散方案。我们为空间半离散化和完全离散方法推导出严格的最优阶误差边界,在弱 CFL 型条件下,其规范比经典的 (H^1times L^2) 能量规范更强。为了证实我们的理论发现,我们还进行了数值实验。
{"title":"Strong Norm Error Bounds for Quasilinear Wave Equations Under Weak CFL-Type Conditions","authors":"Benjamin Dörich","doi":"10.1007/s10208-024-09639-w","DOIUrl":"https://doi.org/10.1007/s10208-024-09639-w","url":null,"abstract":"<p>In the present paper, we consider a class of quasilinear wave equations on a smooth, bounded domain. We discretize it in space with isoparametric finite elements and apply a semi-implicit Euler and midpoint rule as well as the exponential Euler and midpoint rule to obtain four fully discrete schemes. We derive rigorous error bounds of optimal order for the semi-discretization in space and the fully discrete methods in norms which are stronger than the classical <span>(H^1times L^2)</span> energy norm under weak CFL-type conditions. To confirm our theoretical findings, we also present numerical experiments.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"84 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139733608","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Analysis of a Modified Regularity-Preserving Euler Scheme for Parabolic Semilinear SPDEs: Total Variation Error Bounds for the Numerical Approximation of the Invariant Distribution 抛物半线性 SPDEs 的修正正则保全欧拉方案分析:不变分布数值逼近的总变化误差边界
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2024-02-08 DOI: 10.1007/s10208-024-09644-z
Charles-Edouard Bréhier

We propose a modification of the standard linear implicit Euler integrator for the weak approximation of parabolic semilinear stochastic PDEs driven by additive space-time white noise. This new method can easily be combined with a finite difference method for the spatial discretization. The proposed method is shown to have improved qualitative properties compared with the standard method. First, for any time-step size, the spatial regularity of the solution is preserved, at all times. Second, the proposed method preserves the Gaussian invariant distribution of the infinite dimensional Ornstein–Uhlenbeck process obtained when the nonlinearity is removed, for any time-step size. The weak order of convergence of the proposed method is shown to be equal to 1/2 in a general setting, like for the standard Euler scheme. A stronger weak approximation result is obtained when considering the approximation of a Gibbs invariant distribution, when the nonlinearity is a gradient: one obtains an approximation in total variation distance of order 1/2, which does not hold for the standard method. This is the first result of this type in the literature and this is the major and most original result of this article.

我们提出了一种对标准线性隐式欧拉积分器的改进方法,用于对加性时空白噪声驱动的抛物线半线性随机 PDE 进行弱逼近。这种新方法可以很容易地与有限差分法相结合进行空间离散化。与标准方法相比,所提出的方法具有更好的质量特性。首先,对于任何时间步长,解的空间规则性在任何时候都能得到保留。其次,对于任何时间步长,建议的方法都能保留去除非线性后得到的无限维奥恩斯坦-乌伦贝克过程的高斯不变分布。在一般情况下,所提方法的弱收敛阶数等于 1/2,就像标准欧拉方案一样。当非线性为梯度时,考虑吉布斯不变分布的逼近,可以得到更强的弱逼近结果:在总变化距离中可以得到阶数为 1/2 的逼近,而标准方法则不成立。这是文献中第一个此类结果,也是本文最主要、最新颖的结果。
{"title":"Analysis of a Modified Regularity-Preserving Euler Scheme for Parabolic Semilinear SPDEs: Total Variation Error Bounds for the Numerical Approximation of the Invariant Distribution","authors":"Charles-Edouard Bréhier","doi":"10.1007/s10208-024-09644-z","DOIUrl":"https://doi.org/10.1007/s10208-024-09644-z","url":null,"abstract":"<p>We propose a modification of the standard linear implicit Euler integrator for the weak approximation of parabolic semilinear stochastic PDEs driven by additive space-time white noise. This new method can easily be combined with a finite difference method for the spatial discretization. The proposed method is shown to have improved qualitative properties compared with the standard method. First, for any time-step size, the spatial regularity of the solution is preserved, at all times. Second, the proposed method preserves the Gaussian invariant distribution of the infinite dimensional Ornstein–Uhlenbeck process obtained when the nonlinearity is removed, for any time-step size. The weak order of convergence of the proposed method is shown to be equal to 1/2 in a general setting, like for the standard Euler scheme. A stronger weak approximation result is obtained when considering the approximation of a Gibbs invariant distribution, when the nonlinearity is a gradient: one obtains an approximation in total variation distance of order 1/2, which does not hold for the standard method. This is the first result of this type in the literature and this is the major and most original result of this article.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"98 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139710666","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Phaseless Sampling on Square-Root Lattices 方根网格上的无相采样
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2024-02-08 DOI: 10.1007/s10208-024-09640-3
Philipp Grohs, Lukas Liehr

Due to its appearance in a remarkably wide field of applications, such as audio processing and coherent diffraction imaging, the short-time Fourier transform (STFT) phase retrieval problem has seen a great deal of attention in recent years. A central problem in STFT phase retrieval concerns the question for which window functions (g in {L^2({mathbb R}^d)}) and which sampling sets (Lambda subseteq {mathbb R}^{2d}) is every (f in {L^2({mathbb R}^d)}) uniquely determined (up to a global phase factor) by phaseless samples of the form

$$begin{aligned} |V_gf(Lambda )| = left{ |V_gf(lambda )|: lambda in Lambda right} , end{aligned}$$

where (V_gf) denotes the STFT of f with respect to g. The investigation of this question constitutes a key step towards making the problem computationally tractable. However, it deviates from ordinary sampling tasks in a fundamental and subtle manner: recent results demonstrate that uniqueness is unachievable if (Lambda ) is a lattice, i.e (Lambda = A{mathbb Z}^{2d}, A in textrm{GL}(2d,{mathbb R})). Driven by this discretization barrier, the present article centers around the initiation of a novel sampling scheme which allows for unique recovery of any square-integrable function via phaseless STFT-sampling. Specifically, we show that square-root lattices, i.e., sets of the form

$$begin{aligned} Lambda = A left( sqrt{{mathbb Z}} right) ^{2d}, sqrt{{mathbb Z}} = { pm sqrt{n}: n in {mathbb N}_0 }, end{aligned}$$

guarantee uniqueness of the STFT phase retrieval problem. The result holds for a large class of window functions, including Gaussians

由于短时傅里叶变换(STFT)相位检索问题在音频处理和相干衍射成像等极其广泛的应用领域中出现,近年来受到了广泛关注。STFT 相位检索中的一个核心问题是,对于哪些窗口函数(g (in {L^2({mathbb R}^^d)} )和哪些采样集(Lambda (subseteq {mathbb R}^{2d} ),每一个(f (in {L^2({mathbb R}^^d)} )都是由形式为 $$begin{aligned} 的无相采样唯一确定的(直到全局相位因子)。|V_gf(Lambda )| = left{ |V_gf(lambda )|:lambda in Lambda right} , end{aligned}.end{aligned}$ 其中 (V_gf) 表示 f 相对于 g 的 STFT。然而,它以一种基本而微妙的方式偏离了普通的采样任务:最近的结果表明,如果 (Lambda ) 是一个晶格,即 (Lambda = A{mathbb Z}^{2d}, A in textrm{GL}(2d,{mathbb R})),唯一性是无法实现的。在这一离散化障碍的驱动下,本文围绕一种新颖的采样方案展开,该方案允许通过无相 STFT 采样唯一地恢复任何平方可积分函数。具体来说,我们证明了方根网格,即形式为 $$begin{aligned} 的集合Lambda = A left( sqrt{{mathbb Z}} right) ^{2d}, sqrt{{mathbb Z}} = { pm sqrt{n}: n in {mathbb N}_0 }, end{aligned}$$保证了STFT相位检索问题的唯一性。该结果对包括高斯在内的一大类窗函数都成立
{"title":"Phaseless Sampling on Square-Root Lattices","authors":"Philipp Grohs, Lukas Liehr","doi":"10.1007/s10208-024-09640-3","DOIUrl":"https://doi.org/10.1007/s10208-024-09640-3","url":null,"abstract":"<p>Due to its appearance in a remarkably wide field of applications, such as audio processing and coherent diffraction imaging, the short-time Fourier transform (STFT) phase retrieval problem has seen a great deal of attention in recent years. A central problem in STFT phase retrieval concerns the question for which window functions <span>(g in {L^2({mathbb R}^d)})</span> and which sampling sets <span>(Lambda subseteq {mathbb R}^{2d})</span> is every <span>(f in {L^2({mathbb R}^d)})</span> uniquely determined (up to a global phase factor) by phaseless samples of the form </p><span>$$begin{aligned} |V_gf(Lambda )| = left{ |V_gf(lambda )|: lambda in Lambda right} , end{aligned}$$</span><p>where <span>(V_gf)</span> denotes the STFT of <i>f</i> with respect to <i>g</i>. The investigation of this question constitutes a key step towards making the problem computationally tractable. However, it deviates from ordinary sampling tasks in a fundamental and subtle manner: recent results demonstrate that uniqueness is unachievable if <span>(Lambda )</span> is a lattice, i.e <span>(Lambda = A{mathbb Z}^{2d}, A in textrm{GL}(2d,{mathbb R}))</span>. Driven by this discretization barrier, the present article centers around the initiation of a novel sampling scheme which allows for unique recovery of any square-integrable function via phaseless STFT-sampling. Specifically, we show that square-root lattices, i.e., sets of the form </p><span>$$begin{aligned} Lambda = A left( sqrt{{mathbb Z}} right) ^{2d}, sqrt{{mathbb Z}} = { pm sqrt{n}: n in {mathbb N}_0 }, end{aligned}$$</span><p>guarantee uniqueness of the STFT phase retrieval problem. The result holds for a large class of window functions, including Gaussians</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"38 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139710668","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Low-Dimensional Invariant Embeddings for Universal Geometric Learning 通用几何学习的低维不变嵌入
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2024-02-08 DOI: 10.1007/s10208-024-09641-2
Nadav Dym, Steven J. Gortler

This paper studies separating invariants: mappings on D-dimensional domains which are invariant to an appropriate group action and which separate orbits. The motivation for this study comes from the usefulness of separating invariants in proving universality of equivariant neural network architectures. We observe that in several cases the cardinality of separating invariants proposed in the machine learning literature is much larger than the dimension D. As a result, the theoretical universal constructions based on these separating invariants are unrealistically large. Our goal in this paper is to resolve this issue. We show that when a continuous family of semi-algebraic separating invariants is available, separation can be obtained by randomly selecting (2D+1 ) of these invariants. We apply this methodology to obtain an efficient scheme for computing separating invariants for several classical group actions which have been studied in the invariant learning literature. Examples include matrix multiplication actions on point clouds by permutations, rotations, and various other linear groups. Often the requirement of invariant separation is relaxed and only generic separation is required. In this case, we show that only (D+1) invariants are required. More importantly, generic invariants are often significantly easier to compute, as we illustrate by discussing generic and full separation for weighted graphs. Finally we outline an approach for proving that separating invariants can be constructed also when the random parameters have finite precision.

本文研究分离不变式:D 维域上的映射,这些映射对适当的群作用是不变的,并且分离了轨道。这项研究的动机来自于分离不变式在证明等变神经网络架构普遍性方面的有用性。我们注意到,在一些情况下,机器学习文献中提出的分离不变式的万有性远远大于维数 D。我们在本文中的目标就是解决这个问题。我们证明,当半代数分离不变式的连续族可用时,可以通过随机选择这些不变式中的(2D+1 )来获得分离。我们应用这种方法获得了一种高效的方案,用于计算不变式学习文献中已经研究过的几种经典群作用的分离不变式。例如,通过排列、旋转和其他各种线性群对点云进行矩阵乘法运算。通常情况下,不变量分离的要求会被放宽,只要求通用分离。在这种情况下,我们证明只需要(D+1)个不变式。更重要的是,泛函不变式通常更容易计算,我们通过讨论加权图的泛函分离和完全分离来说明这一点。最后,我们概述了一种方法,用于证明当随机参数具有有限精度时,也可以构造分离不变式。
{"title":"Low-Dimensional Invariant Embeddings for Universal Geometric Learning","authors":"Nadav Dym, Steven J. Gortler","doi":"10.1007/s10208-024-09641-2","DOIUrl":"https://doi.org/10.1007/s10208-024-09641-2","url":null,"abstract":"<p>This paper studies separating invariants: mappings on <i>D</i>-dimensional domains which are invariant to an appropriate group action and which separate orbits. The motivation for this study comes from the usefulness of separating invariants in proving universality of equivariant neural network architectures. We observe that in several cases the cardinality of separating invariants proposed in the machine learning literature is much larger than the dimension <i>D</i>. As a result, the theoretical universal constructions based on these separating invariants are unrealistically large. Our goal in this paper is to resolve this issue. We show that when a continuous family of semi-algebraic separating invariants is available, separation can be obtained by randomly selecting <span>(2D+1 )</span> of these invariants. We apply this methodology to obtain an efficient scheme for computing separating invariants for several classical group actions which have been studied in the invariant learning literature. Examples include matrix multiplication actions on point clouds by permutations, rotations, and various other linear groups. Often the requirement of invariant separation is relaxed and only generic separation is required. In this case, we show that only <span>(D+1)</span> invariants are required. More importantly, generic invariants are often significantly easier to compute, as we illustrate by discussing generic and full separation for weighted graphs. Finally we outline an approach for proving that separating invariants can be constructed also when the random parameters have finite precision.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"25 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139710669","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exotic B-Series and S-Series: Algebraic Structures and Order Conditions for Invariant Measure Sampling 奇异的 B 序列和 S 序列:代数结构和不变度量采样的阶次条件
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2024-01-19 DOI: 10.1007/s10208-023-09638-3
Eugen Bronasco

B-Series and generalizations are a powerful tool for the analysis of numerical integrators. An extension named exotic aromatic B-Series was introduced to study the order conditions for sampling the invariant measure of ergodic SDEs. Introducing a new symmetry normalization coefficient, we analyze the algebraic structures related to exotic B-Series and S-Series. Precisely, we prove the relationship between the Grossman–Larson algebras over exotic and grafted forests and the corresponding duals to the Connes–Kreimer coalgebras and use it to study the natural composition laws on exotic S-Series. Applying this algebraic framework to the derivation of order conditions for a class of stochastic Runge–Kutta methods, we present a multiplicative property that ensures some order conditions to be satisfied automatically.

B序列和广义B序列是分析数值积分的有力工具。我们引入了一种名为奇异芳香 B 系列的扩展,以研究对遍历性 SDE 的不变度量进行采样的阶次条件。通过引入新的对称归一化系数,我们分析了与外来 B 系列和 S 系列相关的代数结构。准确地说,我们证明了奇异森林和嫁接森林上的格罗斯曼-拉森(Grossman-Larson)代数与康涅斯-克里默(Connes-Kreimer)煤层的相应对偶之间的关系,并用它来研究奇异 S 序列的自然组成规律。将这一代数框架应用于推导一类随机 Runge-Kutta 方法的阶次条件时,我们提出了一个乘法性质,可确保自动满足某些阶次条件。
{"title":"Exotic B-Series and S-Series: Algebraic Structures and Order Conditions for Invariant Measure Sampling","authors":"Eugen Bronasco","doi":"10.1007/s10208-023-09638-3","DOIUrl":"https://doi.org/10.1007/s10208-023-09638-3","url":null,"abstract":"<p>B-Series and generalizations are a powerful tool for the analysis of numerical integrators. An extension named exotic aromatic B-Series was introduced to study the order conditions for sampling the invariant measure of ergodic SDEs. Introducing a new symmetry normalization coefficient, we analyze the algebraic structures related to exotic B-Series and S-Series. Precisely, we prove the relationship between the Grossman–Larson algebras over exotic and grafted forests and the corresponding duals to the Connes–Kreimer coalgebras and use it to study the natural composition laws on exotic S-Series. Applying this algebraic framework to the derivation of order conditions for a class of stochastic Runge–Kutta methods, we present a multiplicative property that ensures some order conditions to be satisfied automatically.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"6 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139505892","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Extremal Points and Sparse Optimization for Generalized Kantorovich–Rubinstein Norms 广义康托洛维奇-鲁宾斯坦规范的极值点和稀疏优化
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2023-12-11 DOI: 10.1007/s10208-023-09634-7
Marcello Carioni, José A. Iglesias, Daniel Walter

A precise characterization of the extremal points of sublevel sets of nonsmooth penalties provides both detailed information about minimizers, and optimality conditions in general classes of minimization problems involving them. Moreover, it enables the application of fully corrective generalized conditional gradient methods for their efficient solution. In this manuscript, this program is adapted to the minimization of a smooth convex fidelity term which is augmented with an unbalanced transport regularization term given in the form of a generalized Kantorovich–Rubinstein norm for Radon measures. More precisely, we show that the extremal points associated to the latter are given by all Dirac delta functionals supported in the spatial domain as well as certain dipoles, i.e., pairs of Diracs with the same mass but with different signs. Subsequently, this characterization is used to derive precise first-order optimality conditions as well as an efficient solution algorithm for which linear convergence is proved under natural assumptions. This behavior is also reflected in numerical examples for a model problem.

非光滑惩罚子级集极值点的精确表征既提供了关于最小化的详细信息,也提供了涉及它们的一般类型最小化问题的最优性条件。此外,它还能应用完全修正的广义条件梯度法来有效解决这些问题。在本手稿中,该程序适用于平滑凸保真度项的最小化,该保真度项与不平衡传输正则化项相辅相成,其形式为 Radon 测量的广义 Kantorovich-Rubinstein 规范。更确切地说,我们证明了与后者相关的极值点是由空间域中支持的所有狄拉克三角函数以及某些偶极子(即质量相同但符号不同的狄拉克对)给出的。随后,我们利用这一特征推导出精确的一阶最优条件以及高效的求解算法,并在自然假设条件下证明了该算法的线性收敛性。这一行为也反映在一个模型问题的数值示例中。
{"title":"Extremal Points and Sparse Optimization for Generalized Kantorovich–Rubinstein Norms","authors":"Marcello Carioni, José A. Iglesias, Daniel Walter","doi":"10.1007/s10208-023-09634-7","DOIUrl":"https://doi.org/10.1007/s10208-023-09634-7","url":null,"abstract":"<p>A precise characterization of the extremal points of sublevel sets of nonsmooth penalties provides both detailed information about minimizers, and optimality conditions in general classes of minimization problems involving them. Moreover, it enables the application of fully corrective generalized conditional gradient methods for their efficient solution. In this manuscript, this program is adapted to the minimization of a smooth convex fidelity term which is augmented with an unbalanced transport regularization term given in the form of a generalized Kantorovich–Rubinstein norm for Radon measures. More precisely, we show that the extremal points associated to the latter are given by all Dirac delta functionals supported in the spatial domain as well as certain dipoles, i.e., pairs of Diracs with the same mass but with different signs. Subsequently, this characterization is used to derive precise first-order optimality conditions as well as an efficient solution algorithm for which linear convergence is proved under natural assumptions. This behavior is also reflected in numerical examples for a model problem.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"1 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138571239","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Computational Complexity of Decomposing a Symmetric Matrix as a Sum of Positive Semidefinite and Diagonal Matrices 将对称矩阵分解为正半有限矩阵和对角矩阵之和的计算复杂性
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2023-12-08 DOI: 10.1007/s10208-023-09637-4
Levent Tunçel, Stephen A. Vavasis, Jingye Xu

We study several variants of decomposing a symmetric matrix into a sum of a low-rank positive-semidefinite matrix and a diagonal matrix. Such decompositions have applications in factor analysis, and they have been studied for many decades. On the one hand, we prove that when the rank of the positive-semidefinite matrix in the decomposition is bounded above by an absolute constant, the problem can be solved in polynomial time. On the other hand, we prove that, in general, these problems as well as their certain approximation versions are all NP-hard. Finally, we prove that many of these low-rank decomposition problems are complete in the first-order theory of the reals, i.e., given any system of polynomial equations, we can write down a low-rank decomposition problem in polynomial time so that the original system has a solution iff our corresponding decomposition problem has a feasible solution of certain (lowest) rank.

我们研究了将对称矩阵分解为低阶正半无限矩阵和对角矩阵之和的几种变体。这种分解在因子分析中有着广泛的应用,并且已经被研究了几十年。一方面,我们证明了当分解中正半无限矩阵的秩以绝对常数为界时,问题可以在多项式时间内求解。另一方面,我们证明,一般来说,这些问题以及它们的某些近似版本都是 NP 难问题。最后,我们证明了这些低阶分解问题中的许多问题在有数一阶理论中是完备的,也就是说,给定任何多项式方程组,我们都可以在多项式时间内写出一个低阶分解问题,如果我们相应的分解问题有某个(最低)阶的可行解,那么原方程组就有解。
{"title":"Computational Complexity of Decomposing a Symmetric Matrix as a Sum of Positive Semidefinite and Diagonal Matrices","authors":"Levent Tunçel, Stephen A. Vavasis, Jingye Xu","doi":"10.1007/s10208-023-09637-4","DOIUrl":"https://doi.org/10.1007/s10208-023-09637-4","url":null,"abstract":"<p>We study several variants of decomposing a symmetric matrix into a sum of a low-rank positive-semidefinite matrix and a diagonal matrix. Such decompositions have applications in factor analysis, and they have been studied for many decades. On the one hand, we prove that when the rank of the positive-semidefinite matrix in the decomposition is bounded above by an absolute constant, the problem can be solved in polynomial time. On the other hand, we prove that, in general, these problems as well as their certain approximation versions are all NP-hard. Finally, we prove that many of these low-rank decomposition problems are complete in the first-order theory of the reals, i.e., given any system of polynomial equations, we can write down a low-rank decomposition problem in polynomial time so that the original system has a solution iff our corresponding decomposition problem has a feasible solution of certain (lowest) rank.\u0000</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"17 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138559325","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Efficient Random Walks on Riemannian Manifolds 黎曼流形上的有效随机漫步
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2023-12-01 DOI: 10.1007/s10208-023-09635-6
Simon Schwarz, Michael Herrmann, Anja Sturm, Max Wardetzky

According to a version of Donsker’s theorem, geodesic random walks on Riemannian manifolds converge to the respective Brownian motion. From a computational perspective, however, evaluating geodesics can be quite costly. We therefore introduce approximate geodesic random walks based on the concept of retractions. We show that these approximate walks converge in distribution to the correct Brownian motion as long as the geodesic equation is approximated up to second order. As a result, we obtain an efficient algorithm for sampling Brownian motion on compact Riemannian manifolds.

根据Donsker定理的一个版本,黎曼流形上的测地随机游走收敛于相应的布朗运动。然而,从计算的角度来看,评估测地线的成本可能相当高。因此,我们引入基于回缩概念的近似测地线随机漫步。我们证明,只要测地线方程近似到二阶,这些近似游走在分布上收敛于正确的布朗运动。得到了紧黎曼流形上布朗运动采样的一种有效算法。
{"title":"Efficient Random Walks on Riemannian Manifolds","authors":"Simon Schwarz, Michael Herrmann, Anja Sturm, Max Wardetzky","doi":"10.1007/s10208-023-09635-6","DOIUrl":"https://doi.org/10.1007/s10208-023-09635-6","url":null,"abstract":"<p>According to a version of Donsker’s theorem, geodesic random walks on Riemannian manifolds converge to the respective Brownian motion. From a computational perspective, however, evaluating geodesics can be quite costly. We therefore introduce approximate geodesic random walks based on the concept of retractions. We show that these approximate walks converge in distribution to the correct Brownian motion as long as the geodesic equation is approximated up to second order. As a result, we obtain an efficient algorithm for sampling Brownian motion on compact Riemannian manifolds.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":" 24","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138473494","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Fast Optimistic Gradient Descent Ascent (OGDA) Method in Continuous and Discrete Time 连续和离散时间下的快速乐观梯度下降上升(OGDA)方法
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2023-11-29 DOI: 10.1007/s10208-023-09636-5
Radu Ioan Boţ, Ernö Robert Csetnek, Dang-Khoa Nguyen

In the framework of real Hilbert spaces, we study continuous in time dynamics as well as numerical algorithms for the problem of approaching the set of zeros of a single-valued monotone and continuous operator V. The starting point of our investigations is a second-order dynamical system that combines a vanishing damping term with the time derivative of V along the trajectory, which can be seen as an analogous of the Hessian-driven damping in case the operator is originating from a potential. Our method exhibits fast convergence rates of order (o left( frac{1}{tbeta (t)} right) ) for (Vert V(z(t))Vert ), where (z(cdot )) denotes the generated trajectory and (beta (cdot )) is a positive nondecreasing function satisfying a growth condition, and also for the restricted gap function, which is a measure of optimality for variational inequalities. We also prove the weak convergence of the trajectory to a zero of V. Temporal discretizations of the dynamical system generate implicit and explicit numerical algorithms, which can be both seen as accelerated versions of the Optimistic Gradient Descent Ascent (OGDA) method for monotone operators, for which we prove that the generated sequence of iterates ((z_k)_{k ge 0}) shares the asymptotic features of the continuous dynamics. In particular we show for the implicit numerical algorithm convergence rates of order (o left( frac{1}{kbeta _k} right) ) for (Vert V(z^k)Vert ) and the restricted gap function, where ((beta _k)_{k ge 0}) is a positive nondecreasing sequence satisfying a growth condition. For the explicit numerical algorithm, we show by additionally assuming that the operator V is Lipschitz continuous convergence rates of order (o left( frac{1}{k} right) ) for (Vert V(z^k)Vert ) and the restricted gap function. All convergence rate statements are last iterate convergence results; in addition to these, we prove for both algorithms the convergence of the iterates to a zero of V. To our knowledge, our study exhibits the best-known convergence rate results for monotone equations. Numerical experiments indicate the overwhelming superiority of our explicit numerical algorithm over other methods designed to solve monotone equations governed by monotone and Lipschitz continuous operators.

在实数Hilbert空间的框架下,我们研究了单值单调连续算子V的连续时间动力学和逼近零集问题的数值算法。我们研究的起点是一个二阶动力系统,它结合了一个消失的阻尼项和V沿轨迹的时间导数,这可以看作是一个类似于hessian驱动的阻尼,当算子起源于一个势。对于(Vert V(z(t))Vert ),我们的方法显示出(o left( frac{1}{tbeta (t)} right) )级的快速收敛速度,其中(z(cdot ))表示生成的轨迹,(beta (cdot ))是满足增长条件的正非递减函数,并且对于受限间隙函数也是如此,这是变分不等式的最优性度量。我们还证明了轨迹对v的零的弱收敛性。动力系统的时间离散化产生隐式和显式数值算法,它们都可以看作是单调算子的乐观梯度下降上升(OGDA)方法的加速版本,为此我们证明了生成的迭代序列((z_k)_{k ge 0})具有连续动力学的渐近特征。特别地,我们证明了隐式数值算法对于(Vert V(z^k)Vert )和受限间隙函数的(o left( frac{1}{kbeta _k} right) )阶收敛率,其中((beta _k)_{k ge 0})是满足生长条件的正非递减序列。对于显式数值算法,我们通过另外假设算子V是(Vert V(z^k)Vert )和受限间隙函数的Lipschitz连续收敛率为(o left( frac{1}{k} right) )阶来证明。所有的收敛速率表述都是最后迭代的收敛结果;除此之外,我们还证明了这两种算法的迭代收敛到v的零点。据我们所知,我们的研究展示了单调方程的最著名的收敛率结果。数值实验表明,我们的显式数值算法比其他设计用于求解单调方程和Lipschitz连续算子的方法具有压倒性的优势。
{"title":"Fast Optimistic Gradient Descent Ascent (OGDA) Method in Continuous and Discrete Time","authors":"Radu Ioan Boţ, Ernö Robert Csetnek, Dang-Khoa Nguyen","doi":"10.1007/s10208-023-09636-5","DOIUrl":"https://doi.org/10.1007/s10208-023-09636-5","url":null,"abstract":"<p>In the framework of real Hilbert spaces, we study continuous in time dynamics as well as numerical algorithms for the problem of approaching the set of zeros of a single-valued monotone and continuous operator <i>V</i>. The starting point of our investigations is a second-order dynamical system that combines a vanishing damping term with the time derivative of <i>V</i> along the trajectory, which can be seen as an analogous of the Hessian-driven damping in case the operator is originating from a potential. Our method exhibits fast convergence rates of order <span>(o left( frac{1}{tbeta (t)} right) )</span> for <span>(Vert V(z(t))Vert )</span>, where <span>(z(cdot ))</span> denotes the generated trajectory and <span>(beta (cdot ))</span> is a positive nondecreasing function satisfying a growth condition, and also for the restricted gap function, which is a measure of optimality for variational inequalities. We also prove the weak convergence of the trajectory to a zero of <i>V</i>. Temporal discretizations of the dynamical system generate implicit and explicit numerical algorithms, which can be both seen as accelerated versions of the Optimistic Gradient Descent Ascent (OGDA) method for monotone operators, for which we prove that the generated sequence of iterates <span>((z_k)_{k ge 0})</span> shares the asymptotic features of the continuous dynamics. In particular we show for the implicit numerical algorithm convergence rates of order <span>(o left( frac{1}{kbeta _k} right) )</span> for <span>(Vert V(z^k)Vert )</span> and the restricted gap function, where <span>((beta _k)_{k ge 0})</span> is a positive nondecreasing sequence satisfying a growth condition. For the explicit numerical algorithm, we show by additionally assuming that the operator <i>V</i> is Lipschitz continuous convergence rates of order <span>(o left( frac{1}{k} right) )</span> for <span>(Vert V(z^k)Vert )</span> and the restricted gap function. All convergence rate statements are last iterate convergence results; in addition to these, we prove for both algorithms the convergence of the iterates to a zero of <i>V</i>. To our knowledge, our study exhibits the best-known convergence rate results for monotone equations. Numerical experiments indicate the overwhelming superiority of our explicit numerical algorithm over other methods designed to solve monotone equations governed by monotone and Lipschitz continuous operators.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"122 34","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138468746","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Foundations of Computational Mathematics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1