首页 > 最新文献

IMA Journal of Numerical Analysis最新文献

英文 中文
Numerical method and error estimate for stochastic Landau–Lifshitz–Bloch equation 随机 Landau-Lifshitz-Bloch 方程的数值方法和误差估计
IF 2.1 2区 数学 Q1 MATHEMATICS, APPLIED Pub Date : 2024-08-10 DOI: 10.1093/imanum/drae046
Beniamin Goldys, Chunxi Jiao, Kim-Ngan Le
In this paper we study numerical methods for solving a system of quasilinear stochastic partial differential equations known as the stochastic Landau–Lifshitz–Bloch (LLB) equation on a bounded domain in ${mathbb{R}}^{d}$ for $d=1,2$. Our main results are estimates of the rate of convergence of the Finite Element Method to the solutions of stochastic LLB. To overcome the lack of regularity of the solution in the case $d=2$, we propose a Finite Element scheme for a regularized version of the equation. We then obtain error estimates of numerical solutions and for the solution of the regularized equation as well as the rate of convergence of this solution to the solution of the stochastic LLB equation. As a consequence, the convergence in probability of the approximate solutions to the solution of the stochastic LLB equation is derived. A stronger result is obtained in the case $d=1$ due to a new regularity result for the LLB equation which allows us to avoid regularization.
本文研究了求解在 ${mathbb{R}}^{d}$d=1,2$ 条件下 ${mathbb{R}}^{d}$ 有界域上的准线性随机偏微分方程系(即随机 Landau-Lifshitz-Bloch (LLB) 方程)的数值方法。我们的主要结果是有限元法对随机 LLB 解的收敛速率的估计。为了克服解在 $d=2$ 情况下缺乏正则性的问题,我们为方程的正则化版本提出了有限元方案。然后,我们获得了数值解和正则化方程解的误差估计,以及该解向随机 LLB 方程解的收敛速度。因此,我们得出了近似解对随机 LLB 方程解的收敛概率。由于 LLB 方程的新正则性结果使我们可以避免正则化,因此在 $d=1$ 的情况下会得到更强的结果。
{"title":"Numerical method and error estimate for stochastic Landau–Lifshitz–Bloch equation","authors":"Beniamin Goldys, Chunxi Jiao, Kim-Ngan Le","doi":"10.1093/imanum/drae046","DOIUrl":"https://doi.org/10.1093/imanum/drae046","url":null,"abstract":"In this paper we study numerical methods for solving a system of quasilinear stochastic partial differential equations known as the stochastic Landau–Lifshitz–Bloch (LLB) equation on a bounded domain in ${mathbb{R}}^{d}$ for $d=1,2$. Our main results are estimates of the rate of convergence of the Finite Element Method to the solutions of stochastic LLB. To overcome the lack of regularity of the solution in the case $d=2$, we propose a Finite Element scheme for a regularized version of the equation. We then obtain error estimates of numerical solutions and for the solution of the regularized equation as well as the rate of convergence of this solution to the solution of the stochastic LLB equation. As a consequence, the convergence in probability of the approximate solutions to the solution of the stochastic LLB equation is derived. A stronger result is obtained in the case $d=1$ due to a new regularity result for the LLB equation which allows us to avoid regularization.","PeriodicalId":56295,"journal":{"name":"IMA Journal of Numerical Analysis","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141915158","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On the fast convergence of minibatch heavy ball momentum 论小批重球动量的快速收敛
IF 2.1 2区 数学 Q1 MATHEMATICS, APPLIED Pub Date : 2024-08-09 DOI: 10.1093/imanum/drae033
Raghu Bollapragada, Tyler Chen, Rachel Ward
Simple stochastic momentum methods are widely used in machine learning optimization, but their good practical performance is at odds with an absence of theoretical guarantees of acceleration in the literature. In this work, we aim to close the gap between theory and practice by showing that stochastic heavy ball momentum retains the fast linear rate of (deterministic) heavy ball momentum on quadratic optimization problems, at least when minibatching with a sufficiently large batch size. The algorithm we study can be interpreted as an accelerated randomized Kaczmarz algorithm with minibatching and heavy ball momentum. The analysis relies on carefully decomposing the momentum transition matrix, and using new spectral norm concentration bounds for products of independent random matrices. We provide numerical illustrations demonstrating that our bounds are reasonably sharp.
简单的随机重球动量法被广泛应用于机器学习优化中,但其良好的实用性能却与文献中缺乏加速理论保证的情况相悖。在这项工作中,我们旨在缩小理论与实践之间的差距,证明随机重球动量在二次优化问题上保持了(确定性)重球动量的快速线性速率,至少在批量足够大的迷你批处理时是如此。我们所研究的算法可以解释为具有迷你批处理和重球动量的加速随机卡兹马兹算法。分析依赖于仔细分解动量转换矩阵,并对独立随机矩阵的乘积使用新的谱规范集中边界。我们提供的数值说明表明,我们的边界相当锐利。
{"title":"On the fast convergence of minibatch heavy ball momentum","authors":"Raghu Bollapragada, Tyler Chen, Rachel Ward","doi":"10.1093/imanum/drae033","DOIUrl":"https://doi.org/10.1093/imanum/drae033","url":null,"abstract":"Simple stochastic momentum methods are widely used in machine learning optimization, but their good practical performance is at odds with an absence of theoretical guarantees of acceleration in the literature. In this work, we aim to close the gap between theory and practice by showing that stochastic heavy ball momentum retains the fast linear rate of (deterministic) heavy ball momentum on quadratic optimization problems, at least when minibatching with a sufficiently large batch size. The algorithm we study can be interpreted as an accelerated randomized Kaczmarz algorithm with minibatching and heavy ball momentum. The analysis relies on carefully decomposing the momentum transition matrix, and using new spectral norm concentration bounds for products of independent random matrices. We provide numerical illustrations demonstrating that our bounds are reasonably sharp.","PeriodicalId":56295,"journal":{"name":"IMA Journal of Numerical Analysis","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141910224","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Long-term accuracy of numerical approximations of SPDEs with the stochastic Navier–Stokes equations as a paradigm 以随机纳维-斯托克斯方程为范例的 SPDE 数值近似的长期准确性
IF 2.1 2区 数学 Q1 MATHEMATICS, APPLIED Pub Date : 2024-07-16 DOI: 10.1093/imanum/drae043
Nathan E Glatt-Holtz, Cecilia F Mondaini
This work introduces a general framework for establishing the long time accuracy for approximations of Markovian dynamical systems on separable Banach spaces. Our results illuminate the role that a certain uniformity in Wasserstein contraction rates for the approximating dynamics bears on long time accuracy estimates. In particular, our approach yields weak consistency bounds on ${mathbb{R}}^{+}$ while providing a means to sidestepping a commonly occurring situation where certain higher order moment bounds are unavailable for the approximating dynamics. Additionally, to facilitate the analytical core of our approach, we develop a refinement of certain ‘weak Harris theorems’. This extension expands the scope of applicability of such Wasserstein contraction estimates to a variety of interesting stochastic partial differential equation examples involving weaker dissipation or stronger nonlinearity than would be covered by the existing literature. As a guiding and paradigmatic example, we apply our formalism to the stochastic 2D Navier–Stokes equations and to a semi-implicit in time and spectral Galerkin in space numerical approximation of this system. In the case of a numerical approximation, we establish quantitative estimates on the approximation of invariant measures as well as prove weak consistency on ${mathbb{R}}^{+}$. To develop these numerical analysis results, we provide a refinement of $L^{2}_{x}$ accuracy bounds in comparison to the existing literature, which are results of independent interest.
这项研究引入了一个通用框架,用于确定可分离巴拿赫空间上马尔可夫动力系统近似的长时间精度。我们的结果阐明了近似动力学的瓦瑟斯坦收缩率的某种统一性对长时间精度估计的影响。特别是,我们的方法在${/mathbb{R}}^{+}$上得到了弱一致性约束,同时提供了一种方法来避开常见的情况,即近似动力学无法获得某些高阶矩约束。此外,为了促进我们方法的分析核心,我们对某些 "弱哈里斯定理 "进行了改进。这种扩展将这种瓦瑟斯坦收缩估计的适用范围扩大到各种有趣的随机偏微分方程实例,其中涉及的耗散或非线性比现有文献所涵盖的更弱。作为一个指导性的范例,我们将我们的形式主义应用于随机二维 Navier-Stokes 方程以及该系统的时间半隐式和空间谱 Galerkin 数值近似。在数值近似的情况下,我们建立了对近似不变度量的定量估计,并证明了 ${mathbb{R}}^{+}$ 上的弱一致性。为了发展这些数值分析结果,我们提供了与现有文献相比较的 $L^{2}_{x}$ 精度约束的改进,这些都是独立关注的结果。
{"title":"Long-term accuracy of numerical approximations of SPDEs with the stochastic Navier–Stokes equations as a paradigm","authors":"Nathan E Glatt-Holtz, Cecilia F Mondaini","doi":"10.1093/imanum/drae043","DOIUrl":"https://doi.org/10.1093/imanum/drae043","url":null,"abstract":"This work introduces a general framework for establishing the long time accuracy for approximations of Markovian dynamical systems on separable Banach spaces. Our results illuminate the role that a certain uniformity in Wasserstein contraction rates for the approximating dynamics bears on long time accuracy estimates. In particular, our approach yields weak consistency bounds on ${mathbb{R}}^{+}$ while providing a means to sidestepping a commonly occurring situation where certain higher order moment bounds are unavailable for the approximating dynamics. Additionally, to facilitate the analytical core of our approach, we develop a refinement of certain ‘weak Harris theorems’. This extension expands the scope of applicability of such Wasserstein contraction estimates to a variety of interesting stochastic partial differential equation examples involving weaker dissipation or stronger nonlinearity than would be covered by the existing literature. As a guiding and paradigmatic example, we apply our formalism to the stochastic 2D Navier–Stokes equations and to a semi-implicit in time and spectral Galerkin in space numerical approximation of this system. In the case of a numerical approximation, we establish quantitative estimates on the approximation of invariant measures as well as prove weak consistency on ${mathbb{R}}^{+}$. To develop these numerical analysis results, we provide a refinement of $L^{2}_{x}$ accuracy bounds in comparison to the existing literature, which are results of independent interest.","PeriodicalId":56295,"journal":{"name":"IMA Journal of Numerical Analysis","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141631548","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The error bounds of Gaussian quadratures for one rational modification of Chebyshev measures 切比雪夫量纲的一次合理修正的高斯四则运算误差边界
IF 2.1 2区 数学 Q1 MATHEMATICS, APPLIED Pub Date : 2024-07-09 DOI: 10.1093/imanum/drae039
Rada M Mutavdžić Djukić
For an analytic integrand, the error term in the Gaussian quadrature can be represented as a contour integral, where the contour is commonly taken to be an ellipse. Thus, finding its upper bound can be reduced to finding the maximum of the modulus of the kernel on the ellipse. The location of this maximum was investigated in many special cases, particularly, for the Gaussian quadrature with respect to the Chebyshev measures modified by a quadratic divisor (known as the Bernstein–Szeg̋ measures). Here, for the Gaussian quadratures with respect to the Chebyshev measures modified by a linear over linear rational factor, we examine the kernel and describe sufficient conditions for the maximum to occur on the real axis. Furthermore, an assessment of the kernel is made in each case, since in some cases the true maximum is hard to reach. Hence, we derive the error bounds for these quadrature formulas. The results are illustrated by the numerical examples. An alternative approach for estimating the error of the Gaussian quadrature with respect to the same measure can be found in [Djukić, D. L., Djukić, R. M. M., Reichel, L. & Spalević, M. M. (2023, Weighted averaged Gaussian quadrature rules for modified Chebyshev measure. Appl. Numer. Math., ISSN 0168-9274)].
对于解析积分,高斯正交中的误差项可以表示为等值线积分,其中等值线通常被视为椭圆。因此,寻找其上限可以简化为寻找椭圆上核的模的最大值。这个最大值的位置在许多特殊情况下都得到了研究,特别是高斯正交与二次除数修正的切比雪夫度量(称为伯恩斯坦-塞格度量)的关系。在此,对于关于经线性有理因子修正的切比雪夫度量的高斯正交,我们研究了核,并描述了在实轴上出现最大值的充分条件。此外,我们还对每种情况下的核进行了评估,因为在某些情况下很难达到真正的最大值。因此,我们推导出了这些正交公式的误差范围。结果将通过数值示例加以说明。估算高斯正交对于同一度量的误差的另一种方法见 [Djukić, D. L., Djukić, R. M. M., Reichel, L. & Spalević, M. M. (2023, Weighted averaged Gaussian quadrature rules for modified Chebyshev measure.Appl.Math., ISSN 0168-9274)].
{"title":"The error bounds of Gaussian quadratures for one rational modification of Chebyshev measures","authors":"Rada M Mutavdžić Djukić","doi":"10.1093/imanum/drae039","DOIUrl":"https://doi.org/10.1093/imanum/drae039","url":null,"abstract":"For an analytic integrand, the error term in the Gaussian quadrature can be represented as a contour integral, where the contour is commonly taken to be an ellipse. Thus, finding its upper bound can be reduced to finding the maximum of the modulus of the kernel on the ellipse. The location of this maximum was investigated in many special cases, particularly, for the Gaussian quadrature with respect to the Chebyshev measures modified by a quadratic divisor (known as the Bernstein–Szeg̋ measures). Here, for the Gaussian quadratures with respect to the Chebyshev measures modified by a linear over linear rational factor, we examine the kernel and describe sufficient conditions for the maximum to occur on the real axis. Furthermore, an assessment of the kernel is made in each case, since in some cases the true maximum is hard to reach. Hence, we derive the error bounds for these quadrature formulas. The results are illustrated by the numerical examples. An alternative approach for estimating the error of the Gaussian quadrature with respect to the same measure can be found in [Djukić, D. L., Djukić, R. M. M., Reichel, L. & Spalević, M. M. (2023, Weighted averaged Gaussian quadrature rules for modified Chebyshev measure. Appl. Numer. Math., ISSN 0168-9274)].","PeriodicalId":56295,"journal":{"name":"IMA Journal of Numerical Analysis","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-07-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141566247","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Barycentric rational interpolation of exponentially clustered poles 指数集群极点的巴利心理性插值法
IF 2.1 2区 数学 Q1 MATHEMATICS, APPLIED Pub Date : 2024-07-06 DOI: 10.1093/imanum/drae040
Kelong Zhao, Shuhuang Xiang
We have developed a rational interpolation method for analytic functions with branch point singularities, which utilizes several exponentially clustered poles proposed by Trefethen and his collaborators (2021, Exponential node clustering at singularities for rational approximation, quadrature, and PDEs. Numer. Math., 147, 227–254). The key to the feasibility of this interpolation method is that the interpolation nodes approximately satisfy the distribution of the equilibrium potential. These nodes make the convergence rate of the rational interpolation consistent with the theoretical rates, and steadily approach machine accuracy. The technique can be used, not only for the interval $[0,1]$, but can also be extended to include corner regions and the case of multiple singularities.
我们为具有支点奇异性的解析函数开发了一种有理插值方法,该方法利用了 Trefethen 及其合作者提出的几个指数簇极点(2021,Exponential node clustering at singularities for rational approximation, quadrature, and PDEs.Numer.Numer.Math.,147,227-254)。这种插值方法可行性的关键在于插值节点近似满足平衡势的分布。这些节点使得有理插值的收敛速率与理论速率一致,并稳步接近机器精度。该技术不仅可用于区间 $[0,1]$,还可扩展至角区域和多奇点情况。
{"title":"Barycentric rational interpolation of exponentially clustered poles","authors":"Kelong Zhao, Shuhuang Xiang","doi":"10.1093/imanum/drae040","DOIUrl":"https://doi.org/10.1093/imanum/drae040","url":null,"abstract":"We have developed a rational interpolation method for analytic functions with branch point singularities, which utilizes several exponentially clustered poles proposed by Trefethen and his collaborators (2021, Exponential node clustering at singularities for rational approximation, quadrature, and PDEs. Numer. Math., 147, 227–254). The key to the feasibility of this interpolation method is that the interpolation nodes approximately satisfy the distribution of the equilibrium potential. These nodes make the convergence rate of the rational interpolation consistent with the theoretical rates, and steadily approach machine accuracy. The technique can be used, not only for the interval $[0,1]$, but can also be extended to include corner regions and the case of multiple singularities.","PeriodicalId":56295,"journal":{"name":"IMA Journal of Numerical Analysis","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-07-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141553448","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
First-Order Perturbation Theory of Trust-Region Subproblem 信任区域子问题的一阶扰动理论
IF 2.1 2区 数学 Q1 MATHEMATICS, APPLIED Pub Date : 2024-07-06 DOI: 10.1093/imanum/drae042
Bo Feng, Gang Wu
Trust-region subproblem (TRS) is an important problem arising in many applications such as numerical optimization, Tikhonov regularization of ill-posed problems and constrained eigenvalue problems. In recent decades, extensive works focus on how to solve the trust-region subproblem efficiently. To the best of our knowledge, there are few results on perturbation analysis of the trust-region subproblem. In order to fill in this gap, we focus on first-order perturbation theory of the trust-region subproblem. The main contributions of this paper are three-fold. First, suppose that the TRS is in easy case, we give a sufficient condition under which the perturbed TRS is still in easy case. Secondly, with the help of the structure of the TRS and the classical eigenproblem perturbation theory, we perform first-order perturbation analysis on the Lagrange multiplier and the solution of the TRS, and define their condition numbers. Thirdly, we point out that the solution and the Lagrange multiplier could be well-conditioned even if TRS is in nearly hard case. The established results are computable, and are helpful to evaluate ill-conditioning of the large-scale TRS problem beforehand. Numerical experiments show the sharpness of the established bounds and the effectiveness of the proposed strategies.
信任区域子问题(TRS)是一个重要问题,出现在数值优化、Tikhonov 正则化问题和约束特征值问题等许多应用中。近几十年来,大量研究集中于如何高效解决信任区域子问题。据我们所知,关于信任区域子问题扰动分析的成果很少。为了填补这一空白,我们重点研究了信任区域子问题的一阶扰动理论。本文的主要贡献有三方面。首先,假设 TRS 处于易解状态,我们给出了扰动 TRS 仍处于易解状态的充分条件。其次,借助 TRS 的结构和经典特征问题扰动理论,对拉格朗日乘子和 TRS 的解进行一阶扰动分析,并定义其条件数。第三,我们指出,即使 TRS 处于近乎困难的情况,其解和拉格朗日乘数也可能是条件良好的。所建立的结果是可计算的,有助于事先评估大规模 TRS 问题的条件不良情况。数值实验表明了所建立的界限的尖锐性和所提出的策略的有效性。
{"title":"First-Order Perturbation Theory of Trust-Region Subproblem","authors":"Bo Feng, Gang Wu","doi":"10.1093/imanum/drae042","DOIUrl":"https://doi.org/10.1093/imanum/drae042","url":null,"abstract":"Trust-region subproblem (TRS) is an important problem arising in many applications such as numerical optimization, Tikhonov regularization of ill-posed problems and constrained eigenvalue problems. In recent decades, extensive works focus on how to solve the trust-region subproblem efficiently. To the best of our knowledge, there are few results on perturbation analysis of the trust-region subproblem. In order to fill in this gap, we focus on first-order perturbation theory of the trust-region subproblem. The main contributions of this paper are three-fold. First, suppose that the TRS is in easy case, we give a sufficient condition under which the perturbed TRS is still in easy case. Secondly, with the help of the structure of the TRS and the classical eigenproblem perturbation theory, we perform first-order perturbation analysis on the Lagrange multiplier and the solution of the TRS, and define their condition numbers. Thirdly, we point out that the solution and the Lagrange multiplier could be well-conditioned even if TRS is in nearly hard case. The established results are computable, and are helpful to evaluate ill-conditioning of the large-scale TRS problem beforehand. Numerical experiments show the sharpness of the established bounds and the effectiveness of the proposed strategies.","PeriodicalId":56295,"journal":{"name":"IMA Journal of Numerical Analysis","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-07-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141553449","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A geometric integration approach to smooth optimization: foundations of the discrete gradient method 平滑优化的几何整合方法:离散梯度法的基础
IF 2.1 2区 数学 Q1 MATHEMATICS, APPLIED Pub Date : 2024-07-01 DOI: 10.1093/imanum/drae037
Matthias J Ehrhardt, Erlend S Riis, Torbjørn Ringholm, Carola-Bibiane Schönlieb
Discrete gradient methods are geometric integration techniques that can preserve the dissipative structure of gradient flows. Due to the monotonic decay of the function values, they are well suited for general convex and nonconvex optimization problems. Both zero- and first-order algorithms can be derived from the discrete gradient method by selecting different discrete gradients. In this paper, we present a thorough analysis of the discrete gradient method for optimization that provides a solid theoretical foundation. We show that the discrete gradient method is well-posed by proving the existence of iterates for any positive time step, as well as uniqueness in some cases, and propose an efficient method for solving the associated discrete gradient equation. Moreover, we establish an $text{O}(1/k)$ convergence rate for convex objectives and prove linear convergence if instead the Polyak–Łojasiewicz inequality is satisfied. The analysis is carried out for three discrete gradients—the Gonzalez discrete gradient, the mean value discrete gradient, and the Itoh–Abe discrete gradient—as well as for a randomised Itoh–Abe method. Our theoretical results are illustrated with a variety of numerical experiments, and we furthermore demonstrate that the methods are robust with respect to stiffness.
离散梯度法是一种几何积分技术,可以保留梯度流的耗散结构。由于函数值的单调衰减,离散梯度法非常适合一般的凸和非凸优化问题。通过选择不同的离散梯度,离散梯度法可以衍生出零阶算法和一阶算法。本文对离散梯度法进行了深入分析,为优化提供了坚实的理论基础。我们证明了离散梯度法在任意正时间步长下迭代的存在性,以及在某些情况下的唯一性,从而证明了离散梯度法的良好假设,并提出了一种求解相关离散梯度方程的高效方法。此外,我们还为凸目标建立了 $text{O}(1/k)$收敛率,并在满足 Polyak-Łojasiewicz 不等式的情况下证明了线性收敛。分析针对三种离散梯度--冈萨雷斯离散梯度、均值离散梯度和伊藤阿部离散梯度--以及随机化伊藤阿部方法。我们通过各种数值实验对理论结果进行了说明,并进一步证明了这些方法在刚度方面的鲁棒性。
{"title":"A geometric integration approach to smooth optimization: foundations of the discrete gradient method","authors":"Matthias J Ehrhardt, Erlend S Riis, Torbjørn Ringholm, Carola-Bibiane Schönlieb","doi":"10.1093/imanum/drae037","DOIUrl":"https://doi.org/10.1093/imanum/drae037","url":null,"abstract":"Discrete gradient methods are geometric integration techniques that can preserve the dissipative structure of gradient flows. Due to the monotonic decay of the function values, they are well suited for general convex and nonconvex optimization problems. Both zero- and first-order algorithms can be derived from the discrete gradient method by selecting different discrete gradients. In this paper, we present a thorough analysis of the discrete gradient method for optimization that provides a solid theoretical foundation. We show that the discrete gradient method is well-posed by proving the existence of iterates for any positive time step, as well as uniqueness in some cases, and propose an efficient method for solving the associated discrete gradient equation. Moreover, we establish an $text{O}(1/k)$ convergence rate for convex objectives and prove linear convergence if instead the Polyak–Łojasiewicz inequality is satisfied. The analysis is carried out for three discrete gradients—the Gonzalez discrete gradient, the mean value discrete gradient, and the Itoh–Abe discrete gradient—as well as for a randomised Itoh–Abe method. Our theoretical results are illustrated with a variety of numerical experiments, and we furthermore demonstrate that the methods are robust with respect to stiffness.","PeriodicalId":56295,"journal":{"name":"IMA Journal of Numerical Analysis","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141489284","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Asymptotically compatible energy of variable-step fractional BDF2 scheme for the time-fractional Cahn–Hilliard model 时间分数卡恩-希利亚德模型的变步分数 BDF2 方案的渐近兼容能量
IF 2.1 2区 数学 Q1 Mathematics Pub Date : 2024-06-25 DOI: 10.1093/imanum/drae034
Hong-lin Liao, Nan Liu, Xuan Zhao
A novel discrete gradient structure of the variable-step fractional BDF2 formula approximating the Caputo fractional derivative of order $alpha in (0,1)$ is constructed by a local-nonlocal splitting technique, that is, the fractional BDF2 formula is split into a local part analogue to the two-step backward differentiation formula (BDF2) of the first derivative and a nonlocal part analogue to the L1-type formula of the Caputo derivative. Then a local discrete energy dissipation law of the variable-step fractional BDF2 implicit scheme is established for the time-fractional Cahn–Hilliard model under a weak step-ratio constraint $0.3960le tau _{k}/tau _{k-1}<r^{*}(alpha )$, where $tau _{k}$ is the $k$th time-step size and $r^{*}(alpha )ge 4.660$ for $alpha in (0,1)$. The present result provides a practical answer to the open problem in [SINUM, 57: 218-237, Remark 6] and significantly relaxes the severe step-ratio restriction [Math. Comp., 90: 19–40, Theorem 3.2]. More interestingly, the discrete energy and the corresponding energy dissipation law are asymptotically compatible with the associated discrete energy and the energy dissipation law of the variable-step BDF2 method for the classical Cahn–Hilliard equation, respectively. To the best of our knowledge, such type energy dissipation law is established at the first time for the variable-step L2 type formula of Caputo’s derivative. Numerical examples with an adaptive stepping procedure are provided to demonstrate the accuracy and the effectiveness of our proposed method.
通过局部-非局部拆分技术构建了近似于阶数为 $alpha in (0,1)$ 的 Caputo 分导数的变步长分式 BDF2 公式的新型离散梯度结构,即将分式 BDF2 公式拆分为类似于一阶导数的两步反向微分公式(BDF2)的局部部分和类似于 Caputo 导数的 L1 型公式的非局部部分。然后在弱步长比约束$0下建立了时间分式Cahn-Hilliard模型的变步长分式BDF2隐式方案的局部离散能量耗散规律。3960le tau _{k}/tau _{k-1}<r^{*}(alpha )$,其中$tau _{k}$ 是第k$个时间步长,$r^{*}(alpha )ge 4.660$ for $alpha in (0,1)$.本结果为[SINUM, 57: 218-237, Remark 6]中的开放问题提供了一个实际答案,并大大放宽了严格的步长比限制[Math.]更有趣的是,离散能量和相应的能量耗散规律分别与经典 Cahn-Hilliard 方程的变步长 BDF2 方法的相关离散能量和能量耗散规律渐近兼容。据我们所知,这种类型的能量耗散规律是首次针对卡普托导数的变步长 L2 型公式建立的。为了证明我们提出的方法的准确性和有效性,我们提供了带有自适应步进程序的数值示例。
{"title":"Asymptotically compatible energy of variable-step fractional BDF2 scheme for the time-fractional Cahn–Hilliard model","authors":"Hong-lin Liao, Nan Liu, Xuan Zhao","doi":"10.1093/imanum/drae034","DOIUrl":"https://doi.org/10.1093/imanum/drae034","url":null,"abstract":"A novel discrete gradient structure of the variable-step fractional BDF2 formula approximating the Caputo fractional derivative of order $alpha in (0,1)$ is constructed by a local-nonlocal splitting technique, that is, the fractional BDF2 formula is split into a local part analogue to the two-step backward differentiation formula (BDF2) of the first derivative and a nonlocal part analogue to the L1-type formula of the Caputo derivative. Then a local discrete energy dissipation law of the variable-step fractional BDF2 implicit scheme is established for the time-fractional Cahn–Hilliard model under a weak step-ratio constraint $0.3960le tau _{k}/tau _{k-1}<r^{*}(alpha )$, where $tau _{k}$ is the $k$th time-step size and $r^{*}(alpha )ge 4.660$ for $alpha in (0,1)$. The present result provides a practical answer to the open problem in [SINUM, 57: 218-237, Remark 6] and significantly relaxes the severe step-ratio restriction [Math. Comp., 90: 19–40, Theorem 3.2]. More interestingly, the discrete energy and the corresponding energy dissipation law are asymptotically compatible with the associated discrete energy and the energy dissipation law of the variable-step BDF2 method for the classical Cahn–Hilliard equation, respectively. To the best of our knowledge, such type energy dissipation law is established at the first time for the variable-step L2 type formula of Caputo’s derivative. Numerical examples with an adaptive stepping procedure are provided to demonstrate the accuracy and the effectiveness of our proposed method.","PeriodicalId":56295,"journal":{"name":"IMA Journal of Numerical Analysis","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141453029","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Interpolation of set-valued functions 定值函数插值
IF 2.1 2区 数学 Q1 Mathematics Pub Date : 2024-06-25 DOI: 10.1093/imanum/drae031
Nira Dyn, David Levin, Qusay Muzaffar
Given a finite number of samples of a continuous set-valued function F, mapping an interval to compact subsets of the real line, we develop good approximations of F, which can be computed efficiently. In the first stage, we develop an efficient algorithm for computing an interpolant to $F$, inspired by the ‘metric polynomial interpolation’, which is based on the theory in Dyn et al. (2014, Approximation of Set-Valued Functions: Adaptation of Classical Approximation Operators. Imperial College Press). By this theory, a ‘metric polynomial interpolant’ is a collection of polynomial interpolants to all the ‘metric chains’ of the given samples of $F$. For set-valued functions whose graphs have nonempty interior, the collection of these ‘metric chains’ can be infinite. Our algorithm computes a small finite subset of ‘significant metric chains’, which is sufficient for approximating $F$. For the class of Lipschitz continuous functions with samples at the roots of the Chebyshev polynomials of the first kind, we prove that the error incurred by our computed interpolant decays with increasing number of interpolation points in the same rate as in the case of interpolation by the metric polynomial interpolant. This is also demonstrated by our numerical examples. For the class of set-valued functions whose graphs have smooth boundaries, we extend our algorithm to achieve a high-precision detection of the points of topology change, followed by a high-order approximation of the boundaries of the graph of F. We further discuss the case of set-valued functions whose graphs have ‘holes’ with Hölder-type singularities at the points of change of topology. To treat this case we apply some special approximation ideas near the singular points of the holes. We analyze the approximation order of the algorithm, including the error in approximating the points of change of topology, and show by several numerical examples the capability of obtaining high-order approximation of the holes.
给定连续集值函数 F 的有限数量样本,将区间映射到实线的紧凑子集,我们就能开发出 F 的良好近似值,并能高效计算。在第一阶段,我们受 "度量多项式插值 "的启发,开发了一种计算 $F$ 插值的高效算法,该算法基于 Dyn 等人(2014,Approximation of Set-Valued Functions:Adaptation of Classical Approximation Operators.帝国学院出版社)。根据这一理论,"度量多项式插值 "是$F$给定样本的所有 "度量链 "的多项式插值的集合。对于图具有非空内部的集值函数,这些 "度量链 "的集合可能是无限的。我们的算法可以计算出一小部分有限的 "重要度量链 "子集,这足以逼近 $F$。对于在切比雪夫多项式第一种的根上有样本的利普齐兹连续函数类,我们证明了我们计算的插值器所产生的误差随着插值点数量的增加而减小,减小的速度与用度量多项式插值器插值时的速度相同。我们的数值示例也证明了这一点。对于图形具有平滑边界的一类集值函数,我们扩展了算法,以实现拓扑变化点的高精度检测,然后对 F 的图形边界进行高阶近似。为了处理这种情况,我们在洞的奇点附近应用了一些特殊的近似思想。我们分析了算法的近似阶数,包括拓扑变化点的近似误差,并通过几个数值示例展示了获得洞的高阶近似的能力。
{"title":"Interpolation of set-valued functions","authors":"Nira Dyn, David Levin, Qusay Muzaffar","doi":"10.1093/imanum/drae031","DOIUrl":"https://doi.org/10.1093/imanum/drae031","url":null,"abstract":"Given a finite number of samples of a continuous set-valued function F, mapping an interval to compact subsets of the real line, we develop good approximations of F, which can be computed efficiently. In the first stage, we develop an efficient algorithm for computing an interpolant to $F$, inspired by the ‘metric polynomial interpolation’, which is based on the theory in Dyn et al. (2014, Approximation of Set-Valued Functions: Adaptation of Classical Approximation Operators. Imperial College Press). By this theory, a ‘metric polynomial interpolant’ is a collection of polynomial interpolants to all the ‘metric chains’ of the given samples of $F$. For set-valued functions whose graphs have nonempty interior, the collection of these ‘metric chains’ can be infinite. Our algorithm computes a small finite subset of ‘significant metric chains’, which is sufficient for approximating $F$. For the class of Lipschitz continuous functions with samples at the roots of the Chebyshev polynomials of the first kind, we prove that the error incurred by our computed interpolant decays with increasing number of interpolation points in the same rate as in the case of interpolation by the metric polynomial interpolant. This is also demonstrated by our numerical examples. For the class of set-valued functions whose graphs have smooth boundaries, we extend our algorithm to achieve a high-precision detection of the points of topology change, followed by a high-order approximation of the boundaries of the graph of F. We further discuss the case of set-valued functions whose graphs have ‘holes’ with Hölder-type singularities at the points of change of topology. To treat this case we apply some special approximation ideas near the singular points of the holes. We analyze the approximation order of the algorithm, including the error in approximating the points of change of topology, and show by several numerical examples the capability of obtaining high-order approximation of the holes.","PeriodicalId":56295,"journal":{"name":"IMA Journal of Numerical Analysis","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141452781","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Convergence analysis for minimum action methods coupled with a finite difference method 最小作用法与有限差分法的收敛性分析
IF 2.1 2区 数学 Q1 Mathematics Pub Date : 2024-06-21 DOI: 10.1093/imanum/drae038
Jialin Hong, Diancong Jin, Derui Sheng
The minimum action method (MAM) is an effective approach to numerically solving minima and minimizers of Freidlin–Wentzell (F-W) action functionals, which is used to study the most probable transition path and probability of the occurrence of transitions for stochastic differential equations (SDEs) with small noise. In this paper, we focus on MAMs based on a finite difference method with nonuniform mesh, and present the convergence analysis of minimums and minimizers of the discrete F-W action functional. The main result shows that the convergence orders of the minimum of the discrete F-W action functional in the cases of multiplicative noises and additive noises are $1/2$ and $1$, respectively. Our main result also reveals the convergence of the stochastic $theta $-method for SDEs with small noise in terms of large deviations. Numerical experiments are reported to verify the theoretical results.
最小作用法(MAM)是数值求解Freidlin-Wentzell(F-W)作用函数最小值和最小化值的有效方法,用于研究具有小噪声的随机微分方程(SDE)的最可能过渡路径和过渡发生概率。本文重点研究了基于非均匀网格有限差分法的 MAM,并给出了离散 F-W 作用函数的最小值和最小化值的收敛分析。主要结果表明,在乘法噪声和加法噪声情况下,离散 F-W 作用函数最小值的收敛阶数分别为 1/2$ 和 1$。我们的主要结果还揭示了随机$theta $方法对具有小噪声的SDE的大偏差收敛性。报告中的数值实验验证了理论结果。
{"title":"Convergence analysis for minimum action methods coupled with a finite difference method","authors":"Jialin Hong, Diancong Jin, Derui Sheng","doi":"10.1093/imanum/drae038","DOIUrl":"https://doi.org/10.1093/imanum/drae038","url":null,"abstract":"The minimum action method (MAM) is an effective approach to numerically solving minima and minimizers of Freidlin–Wentzell (F-W) action functionals, which is used to study the most probable transition path and probability of the occurrence of transitions for stochastic differential equations (SDEs) with small noise. In this paper, we focus on MAMs based on a finite difference method with nonuniform mesh, and present the convergence analysis of minimums and minimizers of the discrete F-W action functional. The main result shows that the convergence orders of the minimum of the discrete F-W action functional in the cases of multiplicative noises and additive noises are $1/2$ and $1$, respectively. Our main result also reveals the convergence of the stochastic $theta $-method for SDEs with small noise in terms of large deviations. Numerical experiments are reported to verify the theoretical results.","PeriodicalId":56295,"journal":{"name":"IMA Journal of Numerical Analysis","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141452971","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IMA Journal of Numerical Analysis
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1