Pub Date : 2024-02-15DOI: 10.1007/s10208-024-09645-y
Erwan Faou, Benoît Grébert
We consider a class of discrete operators introduced by O. Chodosh, acting on infinite sequences and mimicking standard properties of pseudo-differential operators. By using a new approach, we extend this class to finite or periodic sequences, allowing a general representation of discrete pseudo-differential operators obtained by finite differences approximations and easily transferred to time discretizations. In particular we can define the notion of order and regularity, and we recover the fundamental property, well known in pseudo-differential calculus, that the commutator of two discrete operators gains one order of regularity. As examples of practical applications, we revisit standard error estimates for the convergence of splitting methods, obtaining in some Hamiltonian cases no loss of derivative in the error estimates, in particular for discretizations of general waves and/or water-waves equations. Moreover, we give an example of preconditioner constructions inspired by normal form analysis to deal with the similar question for more general cases.
我们考虑了由 O. Chodosh 引入的一类离散算子,它作用于无穷序列并模仿伪微分算子的标准特性。通过使用一种新方法,我们将该类算子扩展到有限序列或周期序列,从而可以对通过有限差分近似获得的离散伪微分算子进行一般表示,并轻松转移到时间离散化中。特别是,我们可以定义阶次和正则性的概念,并恢复了在伪微分学中众所周知的基本性质,即两个离散算子的换元获得一个阶次的正则性。作为实际应用的例子,我们重新审视了分裂方法收敛的标准误差估计,在某些哈密顿情况下,误差估计中没有导数损失,特别是对于一般波和/或水波方程的离散化。此外,我们还举例说明了受正则表达式分析启发的预处理构造,以解决更一般情况下的类似问题。
{"title":"Discrete Pseudo-differential Operators and Applications to Numerical Schemes","authors":"Erwan Faou, Benoît Grébert","doi":"10.1007/s10208-024-09645-y","DOIUrl":"https://doi.org/10.1007/s10208-024-09645-y","url":null,"abstract":"<p>We consider a class of discrete operators introduced by O. Chodosh, acting on infinite sequences and mimicking standard properties of pseudo-differential operators. By using a new approach, we extend this class to finite or periodic sequences, allowing a general representation of discrete pseudo-differential operators obtained by finite differences approximations and easily transferred to time discretizations. In particular we can define the notion of order and regularity, and we recover the fundamental property, well known in pseudo-differential calculus, that the commutator of two discrete operators gains one order of regularity. As examples of practical applications, we revisit standard error estimates for the convergence of splitting methods, obtaining in some Hamiltonian cases no loss of derivative in the error estimates, in particular for discretizations of general waves and/or water-waves equations. Moreover, we give an example of preconditioner constructions inspired by normal form analysis to deal with the similar question for more general cases.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"258 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139750263","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-02-13DOI: 10.1007/s10208-024-09639-w
Benjamin Dörich
In the present paper, we consider a class of quasilinear wave equations on a smooth, bounded domain. We discretize it in space with isoparametric finite elements and apply a semi-implicit Euler and midpoint rule as well as the exponential Euler and midpoint rule to obtain four fully discrete schemes. We derive rigorous error bounds of optimal order for the semi-discretization in space and the fully discrete methods in norms which are stronger than the classical (H^1times L^2) energy norm under weak CFL-type conditions. To confirm our theoretical findings, we also present numerical experiments.
{"title":"Strong Norm Error Bounds for Quasilinear Wave Equations Under Weak CFL-Type Conditions","authors":"Benjamin Dörich","doi":"10.1007/s10208-024-09639-w","DOIUrl":"https://doi.org/10.1007/s10208-024-09639-w","url":null,"abstract":"<p>In the present paper, we consider a class of quasilinear wave equations on a smooth, bounded domain. We discretize it in space with isoparametric finite elements and apply a semi-implicit Euler and midpoint rule as well as the exponential Euler and midpoint rule to obtain four fully discrete schemes. We derive rigorous error bounds of optimal order for the semi-discretization in space and the fully discrete methods in norms which are stronger than the classical <span>(H^1times L^2)</span> energy norm under weak CFL-type conditions. To confirm our theoretical findings, we also present numerical experiments.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"84 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139733608","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-02-08DOI: 10.1007/s10208-024-09644-z
Charles-Edouard Bréhier
We propose a modification of the standard linear implicit Euler integrator for the weak approximation of parabolic semilinear stochastic PDEs driven by additive space-time white noise. This new method can easily be combined with a finite difference method for the spatial discretization. The proposed method is shown to have improved qualitative properties compared with the standard method. First, for any time-step size, the spatial regularity of the solution is preserved, at all times. Second, the proposed method preserves the Gaussian invariant distribution of the infinite dimensional Ornstein–Uhlenbeck process obtained when the nonlinearity is removed, for any time-step size. The weak order of convergence of the proposed method is shown to be equal to 1/2 in a general setting, like for the standard Euler scheme. A stronger weak approximation result is obtained when considering the approximation of a Gibbs invariant distribution, when the nonlinearity is a gradient: one obtains an approximation in total variation distance of order 1/2, which does not hold for the standard method. This is the first result of this type in the literature and this is the major and most original result of this article.
{"title":"Analysis of a Modified Regularity-Preserving Euler Scheme for Parabolic Semilinear SPDEs: Total Variation Error Bounds for the Numerical Approximation of the Invariant Distribution","authors":"Charles-Edouard Bréhier","doi":"10.1007/s10208-024-09644-z","DOIUrl":"https://doi.org/10.1007/s10208-024-09644-z","url":null,"abstract":"<p>We propose a modification of the standard linear implicit Euler integrator for the weak approximation of parabolic semilinear stochastic PDEs driven by additive space-time white noise. This new method can easily be combined with a finite difference method for the spatial discretization. The proposed method is shown to have improved qualitative properties compared with the standard method. First, for any time-step size, the spatial regularity of the solution is preserved, at all times. Second, the proposed method preserves the Gaussian invariant distribution of the infinite dimensional Ornstein–Uhlenbeck process obtained when the nonlinearity is removed, for any time-step size. The weak order of convergence of the proposed method is shown to be equal to 1/2 in a general setting, like for the standard Euler scheme. A stronger weak approximation result is obtained when considering the approximation of a Gibbs invariant distribution, when the nonlinearity is a gradient: one obtains an approximation in total variation distance of order 1/2, which does not hold for the standard method. This is the first result of this type in the literature and this is the major and most original result of this article.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"98 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139710666","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-02-08DOI: 10.1007/s10208-024-09640-3
Philipp Grohs, Lukas Liehr
Due to its appearance in a remarkably wide field of applications, such as audio processing and coherent diffraction imaging, the short-time Fourier transform (STFT) phase retrieval problem has seen a great deal of attention in recent years. A central problem in STFT phase retrieval concerns the question for which window functions (g in {L^2({mathbb R}^d)}) and which sampling sets (Lambda subseteq {mathbb R}^{2d}) is every (f in {L^2({mathbb R}^d)}) uniquely determined (up to a global phase factor) by phaseless samples of the form
where (V_gf) denotes the STFT of f with respect to g. The investigation of this question constitutes a key step towards making the problem computationally tractable. However, it deviates from ordinary sampling tasks in a fundamental and subtle manner: recent results demonstrate that uniqueness is unachievable if (Lambda ) is a lattice, i.e (Lambda = A{mathbb Z}^{2d}, A in textrm{GL}(2d,{mathbb R})). Driven by this discretization barrier, the present article centers around the initiation of a novel sampling scheme which allows for unique recovery of any square-integrable function via phaseless STFT-sampling. Specifically, we show that square-root lattices, i.e., sets of the form
$$begin{aligned} Lambda = A left( sqrt{{mathbb Z}} right) ^{2d}, sqrt{{mathbb Z}} = { pm sqrt{n}: n in {mathbb N}_0 }, end{aligned}$$
guarantee uniqueness of the STFT phase retrieval problem. The result holds for a large class of window functions, including Gaussians
由于短时傅里叶变换(STFT)相位检索问题在音频处理和相干衍射成像等极其广泛的应用领域中出现,近年来受到了广泛关注。STFT 相位检索中的一个核心问题是,对于哪些窗口函数(g (in {L^2({mathbb R}^^d)} )和哪些采样集(Lambda (subseteq {mathbb R}^{2d} ),每一个(f (in {L^2({mathbb R}^^d)} )都是由形式为 $$begin{aligned} 的无相采样唯一确定的(直到全局相位因子)。|V_gf(Lambda )| = left{ |V_gf(lambda )|:lambda in Lambda right} , end{aligned}.end{aligned}$ 其中 (V_gf) 表示 f 相对于 g 的 STFT。然而,它以一种基本而微妙的方式偏离了普通的采样任务:最近的结果表明,如果 (Lambda ) 是一个晶格,即 (Lambda = A{mathbb Z}^{2d}, A in textrm{GL}(2d,{mathbb R})),唯一性是无法实现的。在这一离散化障碍的驱动下,本文围绕一种新颖的采样方案展开,该方案允许通过无相 STFT 采样唯一地恢复任何平方可积分函数。具体来说,我们证明了方根网格,即形式为 $$begin{aligned} 的集合Lambda = A left( sqrt{{mathbb Z}} right) ^{2d}, sqrt{{mathbb Z}} = { pm sqrt{n}: n in {mathbb N}_0 }, end{aligned}$$保证了STFT相位检索问题的唯一性。该结果对包括高斯在内的一大类窗函数都成立
{"title":"Phaseless Sampling on Square-Root Lattices","authors":"Philipp Grohs, Lukas Liehr","doi":"10.1007/s10208-024-09640-3","DOIUrl":"https://doi.org/10.1007/s10208-024-09640-3","url":null,"abstract":"<p>Due to its appearance in a remarkably wide field of applications, such as audio processing and coherent diffraction imaging, the short-time Fourier transform (STFT) phase retrieval problem has seen a great deal of attention in recent years. A central problem in STFT phase retrieval concerns the question for which window functions <span>(g in {L^2({mathbb R}^d)})</span> and which sampling sets <span>(Lambda subseteq {mathbb R}^{2d})</span> is every <span>(f in {L^2({mathbb R}^d)})</span> uniquely determined (up to a global phase factor) by phaseless samples of the form </p><span>$$begin{aligned} |V_gf(Lambda )| = left{ |V_gf(lambda )|: lambda in Lambda right} , end{aligned}$$</span><p>where <span>(V_gf)</span> denotes the STFT of <i>f</i> with respect to <i>g</i>. The investigation of this question constitutes a key step towards making the problem computationally tractable. However, it deviates from ordinary sampling tasks in a fundamental and subtle manner: recent results demonstrate that uniqueness is unachievable if <span>(Lambda )</span> is a lattice, i.e <span>(Lambda = A{mathbb Z}^{2d}, A in textrm{GL}(2d,{mathbb R}))</span>. Driven by this discretization barrier, the present article centers around the initiation of a novel sampling scheme which allows for unique recovery of any square-integrable function via phaseless STFT-sampling. Specifically, we show that square-root lattices, i.e., sets of the form </p><span>$$begin{aligned} Lambda = A left( sqrt{{mathbb Z}} right) ^{2d}, sqrt{{mathbb Z}} = { pm sqrt{n}: n in {mathbb N}_0 }, end{aligned}$$</span><p>guarantee uniqueness of the STFT phase retrieval problem. The result holds for a large class of window functions, including Gaussians</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"38 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139710668","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-02-08DOI: 10.1007/s10208-024-09641-2
Nadav Dym, Steven J. Gortler
This paper studies separating invariants: mappings on D-dimensional domains which are invariant to an appropriate group action and which separate orbits. The motivation for this study comes from the usefulness of separating invariants in proving universality of equivariant neural network architectures. We observe that in several cases the cardinality of separating invariants proposed in the machine learning literature is much larger than the dimension D. As a result, the theoretical universal constructions based on these separating invariants are unrealistically large. Our goal in this paper is to resolve this issue. We show that when a continuous family of semi-algebraic separating invariants is available, separation can be obtained by randomly selecting (2D+1 ) of these invariants. We apply this methodology to obtain an efficient scheme for computing separating invariants for several classical group actions which have been studied in the invariant learning literature. Examples include matrix multiplication actions on point clouds by permutations, rotations, and various other linear groups. Often the requirement of invariant separation is relaxed and only generic separation is required. In this case, we show that only (D+1) invariants are required. More importantly, generic invariants are often significantly easier to compute, as we illustrate by discussing generic and full separation for weighted graphs. Finally we outline an approach for proving that separating invariants can be constructed also when the random parameters have finite precision.
{"title":"Low-Dimensional Invariant Embeddings for Universal Geometric Learning","authors":"Nadav Dym, Steven J. Gortler","doi":"10.1007/s10208-024-09641-2","DOIUrl":"https://doi.org/10.1007/s10208-024-09641-2","url":null,"abstract":"<p>This paper studies separating invariants: mappings on <i>D</i>-dimensional domains which are invariant to an appropriate group action and which separate orbits. The motivation for this study comes from the usefulness of separating invariants in proving universality of equivariant neural network architectures. We observe that in several cases the cardinality of separating invariants proposed in the machine learning literature is much larger than the dimension <i>D</i>. As a result, the theoretical universal constructions based on these separating invariants are unrealistically large. Our goal in this paper is to resolve this issue. We show that when a continuous family of semi-algebraic separating invariants is available, separation can be obtained by randomly selecting <span>(2D+1 )</span> of these invariants. We apply this methodology to obtain an efficient scheme for computing separating invariants for several classical group actions which have been studied in the invariant learning literature. Examples include matrix multiplication actions on point clouds by permutations, rotations, and various other linear groups. Often the requirement of invariant separation is relaxed and only generic separation is required. In this case, we show that only <span>(D+1)</span> invariants are required. More importantly, generic invariants are often significantly easier to compute, as we illustrate by discussing generic and full separation for weighted graphs. Finally we outline an approach for proving that separating invariants can be constructed also when the random parameters have finite precision.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"25 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139710669","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-01-19DOI: 10.1007/s10208-023-09638-3
Eugen Bronasco
B-Series and generalizations are a powerful tool for the analysis of numerical integrators. An extension named exotic aromatic B-Series was introduced to study the order conditions for sampling the invariant measure of ergodic SDEs. Introducing a new symmetry normalization coefficient, we analyze the algebraic structures related to exotic B-Series and S-Series. Precisely, we prove the relationship between the Grossman–Larson algebras over exotic and grafted forests and the corresponding duals to the Connes–Kreimer coalgebras and use it to study the natural composition laws on exotic S-Series. Applying this algebraic framework to the derivation of order conditions for a class of stochastic Runge–Kutta methods, we present a multiplicative property that ensures some order conditions to be satisfied automatically.
B序列和广义B序列是分析数值积分的有力工具。我们引入了一种名为奇异芳香 B 系列的扩展,以研究对遍历性 SDE 的不变度量进行采样的阶次条件。通过引入新的对称归一化系数,我们分析了与外来 B 系列和 S 系列相关的代数结构。准确地说,我们证明了奇异森林和嫁接森林上的格罗斯曼-拉森(Grossman-Larson)代数与康涅斯-克里默(Connes-Kreimer)煤层的相应对偶之间的关系,并用它来研究奇异 S 序列的自然组成规律。将这一代数框架应用于推导一类随机 Runge-Kutta 方法的阶次条件时,我们提出了一个乘法性质,可确保自动满足某些阶次条件。
{"title":"Exotic B-Series and S-Series: Algebraic Structures and Order Conditions for Invariant Measure Sampling","authors":"Eugen Bronasco","doi":"10.1007/s10208-023-09638-3","DOIUrl":"https://doi.org/10.1007/s10208-023-09638-3","url":null,"abstract":"<p>B-Series and generalizations are a powerful tool for the analysis of numerical integrators. An extension named exotic aromatic B-Series was introduced to study the order conditions for sampling the invariant measure of ergodic SDEs. Introducing a new symmetry normalization coefficient, we analyze the algebraic structures related to exotic B-Series and S-Series. Precisely, we prove the relationship between the Grossman–Larson algebras over exotic and grafted forests and the corresponding duals to the Connes–Kreimer coalgebras and use it to study the natural composition laws on exotic S-Series. Applying this algebraic framework to the derivation of order conditions for a class of stochastic Runge–Kutta methods, we present a multiplicative property that ensures some order conditions to be satisfied automatically.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"6 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139505892","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-11DOI: 10.1007/s10208-023-09634-7
Marcello Carioni, José A. Iglesias, Daniel Walter
A precise characterization of the extremal points of sublevel sets of nonsmooth penalties provides both detailed information about minimizers, and optimality conditions in general classes of minimization problems involving them. Moreover, it enables the application of fully corrective generalized conditional gradient methods for their efficient solution. In this manuscript, this program is adapted to the minimization of a smooth convex fidelity term which is augmented with an unbalanced transport regularization term given in the form of a generalized Kantorovich–Rubinstein norm for Radon measures. More precisely, we show that the extremal points associated to the latter are given by all Dirac delta functionals supported in the spatial domain as well as certain dipoles, i.e., pairs of Diracs with the same mass but with different signs. Subsequently, this characterization is used to derive precise first-order optimality conditions as well as an efficient solution algorithm for which linear convergence is proved under natural assumptions. This behavior is also reflected in numerical examples for a model problem.
{"title":"Extremal Points and Sparse Optimization for Generalized Kantorovich–Rubinstein Norms","authors":"Marcello Carioni, José A. Iglesias, Daniel Walter","doi":"10.1007/s10208-023-09634-7","DOIUrl":"https://doi.org/10.1007/s10208-023-09634-7","url":null,"abstract":"<p>A precise characterization of the extremal points of sublevel sets of nonsmooth penalties provides both detailed information about minimizers, and optimality conditions in general classes of minimization problems involving them. Moreover, it enables the application of fully corrective generalized conditional gradient methods for their efficient solution. In this manuscript, this program is adapted to the minimization of a smooth convex fidelity term which is augmented with an unbalanced transport regularization term given in the form of a generalized Kantorovich–Rubinstein norm for Radon measures. More precisely, we show that the extremal points associated to the latter are given by all Dirac delta functionals supported in the spatial domain as well as certain dipoles, i.e., pairs of Diracs with the same mass but with different signs. Subsequently, this characterization is used to derive precise first-order optimality conditions as well as an efficient solution algorithm for which linear convergence is proved under natural assumptions. This behavior is also reflected in numerical examples for a model problem.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"1 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138571239","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-08DOI: 10.1007/s10208-023-09637-4
Levent Tunçel, Stephen A. Vavasis, Jingye Xu
We study several variants of decomposing a symmetric matrix into a sum of a low-rank positive-semidefinite matrix and a diagonal matrix. Such decompositions have applications in factor analysis, and they have been studied for many decades. On the one hand, we prove that when the rank of the positive-semidefinite matrix in the decomposition is bounded above by an absolute constant, the problem can be solved in polynomial time. On the other hand, we prove that, in general, these problems as well as their certain approximation versions are all NP-hard. Finally, we prove that many of these low-rank decomposition problems are complete in the first-order theory of the reals, i.e., given any system of polynomial equations, we can write down a low-rank decomposition problem in polynomial time so that the original system has a solution iff our corresponding decomposition problem has a feasible solution of certain (lowest) rank.
{"title":"Computational Complexity of Decomposing a Symmetric Matrix as a Sum of Positive Semidefinite and Diagonal Matrices","authors":"Levent Tunçel, Stephen A. Vavasis, Jingye Xu","doi":"10.1007/s10208-023-09637-4","DOIUrl":"https://doi.org/10.1007/s10208-023-09637-4","url":null,"abstract":"<p>We study several variants of decomposing a symmetric matrix into a sum of a low-rank positive-semidefinite matrix and a diagonal matrix. Such decompositions have applications in factor analysis, and they have been studied for many decades. On the one hand, we prove that when the rank of the positive-semidefinite matrix in the decomposition is bounded above by an absolute constant, the problem can be solved in polynomial time. On the other hand, we prove that, in general, these problems as well as their certain approximation versions are all NP-hard. Finally, we prove that many of these low-rank decomposition problems are complete in the first-order theory of the reals, i.e., given any system of polynomial equations, we can write down a low-rank decomposition problem in polynomial time so that the original system has a solution iff our corresponding decomposition problem has a feasible solution of certain (lowest) rank.\u0000</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"17 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138559325","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-01DOI: 10.1007/s10208-023-09635-6
Simon Schwarz, Michael Herrmann, Anja Sturm, Max Wardetzky
According to a version of Donsker’s theorem, geodesic random walks on Riemannian manifolds converge to the respective Brownian motion. From a computational perspective, however, evaluating geodesics can be quite costly. We therefore introduce approximate geodesic random walks based on the concept of retractions. We show that these approximate walks converge in distribution to the correct Brownian motion as long as the geodesic equation is approximated up to second order. As a result, we obtain an efficient algorithm for sampling Brownian motion on compact Riemannian manifolds.
{"title":"Efficient Random Walks on Riemannian Manifolds","authors":"Simon Schwarz, Michael Herrmann, Anja Sturm, Max Wardetzky","doi":"10.1007/s10208-023-09635-6","DOIUrl":"https://doi.org/10.1007/s10208-023-09635-6","url":null,"abstract":"<p>According to a version of Donsker’s theorem, geodesic random walks on Riemannian manifolds converge to the respective Brownian motion. From a computational perspective, however, evaluating geodesics can be quite costly. We therefore introduce approximate geodesic random walks based on the concept of retractions. We show that these approximate walks converge in distribution to the correct Brownian motion as long as the geodesic equation is approximated up to second order. As a result, we obtain an efficient algorithm for sampling Brownian motion on compact Riemannian manifolds.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":" 24","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138473494","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-29DOI: 10.1007/s10208-023-09636-5
Radu Ioan Boţ, Ernö Robert Csetnek, Dang-Khoa Nguyen
In the framework of real Hilbert spaces, we study continuous in time dynamics as well as numerical algorithms for the problem of approaching the set of zeros of a single-valued monotone and continuous operator V. The starting point of our investigations is a second-order dynamical system that combines a vanishing damping term with the time derivative of V along the trajectory, which can be seen as an analogous of the Hessian-driven damping in case the operator is originating from a potential. Our method exhibits fast convergence rates of order (o left( frac{1}{tbeta (t)} right) ) for (Vert V(z(t))Vert ), where (z(cdot )) denotes the generated trajectory and (beta (cdot )) is a positive nondecreasing function satisfying a growth condition, and also for the restricted gap function, which is a measure of optimality for variational inequalities. We also prove the weak convergence of the trajectory to a zero of V. Temporal discretizations of the dynamical system generate implicit and explicit numerical algorithms, which can be both seen as accelerated versions of the Optimistic Gradient Descent Ascent (OGDA) method for monotone operators, for which we prove that the generated sequence of iterates ((z_k)_{k ge 0}) shares the asymptotic features of the continuous dynamics. In particular we show for the implicit numerical algorithm convergence rates of order (o left( frac{1}{kbeta _k} right) ) for (Vert V(z^k)Vert ) and the restricted gap function, where ((beta _k)_{k ge 0}) is a positive nondecreasing sequence satisfying a growth condition. For the explicit numerical algorithm, we show by additionally assuming that the operator V is Lipschitz continuous convergence rates of order (o left( frac{1}{k} right) ) for (Vert V(z^k)Vert ) and the restricted gap function. All convergence rate statements are last iterate convergence results; in addition to these, we prove for both algorithms the convergence of the iterates to a zero of V. To our knowledge, our study exhibits the best-known convergence rate results for monotone equations. Numerical experiments indicate the overwhelming superiority of our explicit numerical algorithm over other methods designed to solve monotone equations governed by monotone and Lipschitz continuous operators.
{"title":"Fast Optimistic Gradient Descent Ascent (OGDA) Method in Continuous and Discrete Time","authors":"Radu Ioan Boţ, Ernö Robert Csetnek, Dang-Khoa Nguyen","doi":"10.1007/s10208-023-09636-5","DOIUrl":"https://doi.org/10.1007/s10208-023-09636-5","url":null,"abstract":"<p>In the framework of real Hilbert spaces, we study continuous in time dynamics as well as numerical algorithms for the problem of approaching the set of zeros of a single-valued monotone and continuous operator <i>V</i>. The starting point of our investigations is a second-order dynamical system that combines a vanishing damping term with the time derivative of <i>V</i> along the trajectory, which can be seen as an analogous of the Hessian-driven damping in case the operator is originating from a potential. Our method exhibits fast convergence rates of order <span>(o left( frac{1}{tbeta (t)} right) )</span> for <span>(Vert V(z(t))Vert )</span>, where <span>(z(cdot ))</span> denotes the generated trajectory and <span>(beta (cdot ))</span> is a positive nondecreasing function satisfying a growth condition, and also for the restricted gap function, which is a measure of optimality for variational inequalities. We also prove the weak convergence of the trajectory to a zero of <i>V</i>. Temporal discretizations of the dynamical system generate implicit and explicit numerical algorithms, which can be both seen as accelerated versions of the Optimistic Gradient Descent Ascent (OGDA) method for monotone operators, for which we prove that the generated sequence of iterates <span>((z_k)_{k ge 0})</span> shares the asymptotic features of the continuous dynamics. In particular we show for the implicit numerical algorithm convergence rates of order <span>(o left( frac{1}{kbeta _k} right) )</span> for <span>(Vert V(z^k)Vert )</span> and the restricted gap function, where <span>((beta _k)_{k ge 0})</span> is a positive nondecreasing sequence satisfying a growth condition. For the explicit numerical algorithm, we show by additionally assuming that the operator <i>V</i> is Lipschitz continuous convergence rates of order <span>(o left( frac{1}{k} right) )</span> for <span>(Vert V(z^k)Vert )</span> and the restricted gap function. All convergence rate statements are last iterate convergence results; in addition to these, we prove for both algorithms the convergence of the iterates to a zero of <i>V</i>. To our knowledge, our study exhibits the best-known convergence rate results for monotone equations. Numerical experiments indicate the overwhelming superiority of our explicit numerical algorithm over other methods designed to solve monotone equations governed by monotone and Lipschitz continuous operators.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"122 34","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138468746","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}