首页 > 最新文献

Foundations of Computational Mathematics最新文献

英文 中文
Polynomial and Rational Measure Modifications of Orthogonal Polynomials via Infinite-Dimensional Banded Matrix Factorizations 通过无限维带状矩阵因式分解对正交多项式进行多项式和有理测度修正
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2024-08-05 DOI: 10.1007/s10208-024-09671-w
Timon S. Gutleb, Sheehan Olver, Richard Mikaël Slevinsky

We describe fast algorithms for approximating the connection coefficients between a family of orthogonal polynomials and another family with a polynomially or rationally modified measure. The connection coefficients are computed via infinite-dimensional banded matrix factorizations and may be used to compute the modified Jacobi matrices all in linear complexity with respect to the truncation degree. A family of orthogonal polynomials with modified classical weights is constructed that support banded differentiation matrices, enabling sparse spectral methods with modified classical orthogonal polynomials. We present several applications and numerical experiments using an open source implementation which make direct use of these results.

我们描述了近似正交多项式族与另一个具有多项式或合理修正度量的族之间的连接系数的快速算法。连接系数通过无穷维带状矩阵因式分解计算,并可用于计算修正雅可比矩阵,其复杂度与截断度呈线性关系。我们构建了一个具有修正经典权重的正交多项式族,它支持带状微分矩阵,从而实现了使用修正经典正交多项式的稀疏谱方法。我们介绍了直接利用这些结果的几个应用和使用开源实现的数值实验。
{"title":"Polynomial and Rational Measure Modifications of Orthogonal Polynomials via Infinite-Dimensional Banded Matrix Factorizations","authors":"Timon S. Gutleb, Sheehan Olver, Richard Mikaël Slevinsky","doi":"10.1007/s10208-024-09671-w","DOIUrl":"https://doi.org/10.1007/s10208-024-09671-w","url":null,"abstract":"<p>We describe fast algorithms for approximating the connection coefficients between a family of orthogonal polynomials and another family with a polynomially or rationally modified measure. The connection coefficients are computed via infinite-dimensional banded matrix factorizations and may be used to compute the modified Jacobi matrices all in linear complexity with respect to the truncation degree. A family of orthogonal polynomials with modified classical weights is constructed that support banded differentiation matrices, enabling sparse spectral methods with modified classical orthogonal polynomials. We present several applications and numerical experiments using an open source implementation which make direct use of these results.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"23 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141895228","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Stable Liftings of Polynomial Traces on Tetrahedra 多项式轨迹在四面体上的稳定提升
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2024-07-29 DOI: 10.1007/s10208-024-09670-x
Charles Parker, Endre Süli

On the reference tetrahedron (K), we construct, for each (k in {mathbb {N}}_0), a right inverse for the trace operator (u mapsto (u, partial _{textbf{n}} u, ldots , partial _{textbf{n}}^k u)|_{partial K}). The operator is stable as a mapping from the trace space of (W^{s, p}(K)) to (W^{s, p}(K)) for all (p in (1, infty )) and (s in (k+1/p, infty )). Moreover, if the data is the trace of a polynomial of degree (N in {mathbb {N}}_0), then the resulting lifting is a polynomial of degree N. One consequence of the analysis is a novel characterization for the range of the trace operator.

在参考四面体 (K)上,我们为每个 (k in {mathbb {N}}_0) 构造了迹算子 (u mapsto (u, partial _{textbf{n}} u, ldots , partial _{textbf{n}}^k u)|_{partial K}) 的右逆。对于所有的 (pin (1, infty )) 和 (sin (k+1/p, infty )) 来说,这个算子作为从 (W^{s, p}(K))的迹空间到 (W^{s, p}(K))的映射是稳定的。此外,如果数据是度数为 (N in {mathbb {N}}_0) 的多项式的迹,那么得到的提升就是度数为 N 的多项式。
{"title":"Stable Liftings of Polynomial Traces on Tetrahedra","authors":"Charles Parker, Endre Süli","doi":"10.1007/s10208-024-09670-x","DOIUrl":"https://doi.org/10.1007/s10208-024-09670-x","url":null,"abstract":"<p>On the reference tetrahedron <span>(K)</span>, we construct, for each <span>(k in {mathbb {N}}_0)</span>, a right inverse for the trace operator <span>(u mapsto (u, partial _{textbf{n}} u, ldots , partial _{textbf{n}}^k u)|_{partial K})</span>. The operator is stable as a mapping from the trace space of <span>(W^{s, p}(K))</span> to <span>(W^{s, p}(K))</span> for all <span>(p in (1, infty ))</span> and <span>(s in (k+1/p, infty ))</span>. Moreover, if the data is the trace of a polynomial of degree <span>(N in {mathbb {N}}_0)</span>, then the resulting lifting is a polynomial of degree <i>N</i>. One consequence of the analysis is a novel characterization for the range of the trace operator.\u0000</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"19 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141836767","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Analysis of Langevin Monte Carlo from Poincaré to Log-Sobolev 从 Poincaré 到 Log-Sobolev 的 Langevin 蒙特卡洛分析
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2024-07-26 DOI: 10.1007/s10208-024-09667-6
Sinho Chewi, Murat A. Erdogdu, Mufan Li, Ruoqi Shen, Matthew S. Zhang

Classically, the continuous-time Langevin diffusion converges exponentially fast to its stationary distribution (pi ) under the sole assumption that (pi ) satisfies a Poincaré inequality. Using this fact to provide guarantees for the discrete-time Langevin Monte Carlo (LMC) algorithm, however, is considerably more challenging due to the need for working with chi-squared or Rényi divergences, and prior works have largely focused on strongly log-concave targets. In this work, we provide the first convergence guarantees for LMC assuming that (pi ) satisfies either a Latała–Oleszkiewicz or modified log-Sobolev inequality, which interpolates between the Poincaré and log-Sobolev settings. Unlike prior works, our results allow for weak smoothness and do not require convexity or dissipativity conditions.

从经典上讲,在 (pi ) 满足Poincaré不等式的唯一假设下,连续时间朗之文扩散以指数级速度收敛到其静态分布 (pi )。然而,利用这一事实为离散时间朗之文蒙特卡洛(LMC)算法提供保证要困难得多,因为需要处理秩方或雷尼发散,而且之前的工作主要集中在强对数凹目标上。在这项工作中,我们首次为 LMC 提供了收敛性保证,假设 (pi ) 满足拉塔瓦-奥列兹凯维奇不等式或修正的 log-Sobolev 不等式,它们在 Poincaré 和 log-Sobolev 设置之间进行插值。与之前的研究不同,我们的结果允许弱平稳性,并且不需要凸性或消散性条件。
{"title":"Analysis of Langevin Monte Carlo from Poincaré to Log-Sobolev","authors":"Sinho Chewi, Murat A. Erdogdu, Mufan Li, Ruoqi Shen, Matthew S. Zhang","doi":"10.1007/s10208-024-09667-6","DOIUrl":"https://doi.org/10.1007/s10208-024-09667-6","url":null,"abstract":"<p>Classically, the continuous-time Langevin diffusion converges exponentially fast to its stationary distribution <span>(pi )</span> under the sole assumption that <span>(pi )</span> satisfies a Poincaré inequality. Using this fact to provide guarantees for the discrete-time Langevin Monte Carlo (LMC) algorithm, however, is considerably more challenging due to the need for working with chi-squared or Rényi divergences, and prior works have largely focused on strongly log-concave targets. In this work, we provide the first convergence guarantees for LMC assuming that <span>(pi )</span> satisfies either a Latała–Oleszkiewicz or modified log-Sobolev inequality, which interpolates between the Poincaré and log-Sobolev settings. Unlike prior works, our results allow for weak smoothness and do not require convexity or dissipativity conditions.\u0000</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"57 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141768486","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Resonances as a Computational Tool 作为计算工具的共振
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2024-07-26 DOI: 10.1007/s10208-024-09665-8
Frédéric Rousset, Katharina Schratz

A large toolbox of numerical schemes for dispersive equations has been established, based on different discretization techniques such as discretizing the variation-of-constants formula (e.g., exponential integrators) or splitting the full equation into a series of simpler subproblems (e.g., splitting methods). In many situations these classical schemes allow a precise and efficient approximation. This, however, drastically changes whenever non-smooth phenomena enter the scene such as for problems at low regularity and high oscillations. Classical schemes fail to capture the oscillatory nature of the solution, and this may lead to severe instabilities and loss of convergence. In this article we review a new class of resonance-based schemes. The key idea in the construction of the new schemes is to tackle and deeply embed the underlying nonlinear structure of resonances into the numerical discretization. As in the continuous case, these terms are central to structure preservation and offer the new schemes strong properties at low regularity.

基于不同的离散化技术,如将常数变异公式离散化(如指数积分器)或将完整方程拆分为一系列更简单的子问题(如拆分方法),已经建立了一个庞大的分散方程数值方案工具箱。在许多情况下,这些经典方案可以实现精确而高效的近似。然而,一旦出现非光滑现象,例如低规律性和高振荡问题,情况就会发生巨大变化。经典方案无法捕捉解的振荡性质,这可能会导致严重的不稳定性和收敛性损失。在本文中,我们回顾了一类基于共振的新方案。构建新方案的关键思路是解决共振的基本非线性结构,并将其深入嵌入数值离散化中。正如在连续情况下一样,这些项是结构保持的核心,并为新方案提供了低正则性的强大特性。
{"title":"Resonances as a Computational Tool","authors":"Frédéric Rousset, Katharina Schratz","doi":"10.1007/s10208-024-09665-8","DOIUrl":"https://doi.org/10.1007/s10208-024-09665-8","url":null,"abstract":"<p>A large toolbox of numerical schemes for dispersive equations has been established, based on different discretization techniques such as discretizing the variation-of-constants formula (e.g., exponential integrators) or splitting the full equation into a series of simpler subproblems (e.g., splitting methods). In many situations these classical schemes allow a precise and efficient approximation. This, however, drastically changes whenever non-smooth phenomena enter the scene such as for problems at low regularity and high oscillations. Classical schemes fail to capture the oscillatory nature of the solution, and this may lead to severe instabilities and loss of convergence. In this article we review a new class of resonance-based schemes. The key idea in the construction of the new schemes is to tackle and deeply embed the underlying nonlinear structure of resonances into the numerical discretization. As in the continuous case, these terms are central to structure preservation and offer the new schemes strong properties at low regularity.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"32 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141768455","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Polynomial Time Iterative Algorithm for Matching Gaussian Matrices with Non-vanishing Correlation 匹配非相关性高斯矩阵的多项式时间迭代算法
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2024-07-22 DOI: 10.1007/s10208-024-09662-x
Jian Ding, Zhangsong Li

Motivated by the problem of matching vertices in two correlated Erdős-Rényi graphs, we study the problem of matching two correlated Gaussian Wigner matrices. We propose an iterative matching algorithm, which succeeds in polynomial time as long as the correlation between the two Gaussian matrices does not vanish. Our result is the first polynomial time algorithm that solves a graph matching type of problem when the correlation is an arbitrarily small constant.

受两个相关厄尔多斯-雷尼图中顶点匹配问题的启发,我们研究了两个相关高斯维格纳矩阵的匹配问题。我们提出了一种迭代匹配算法,只要两个高斯矩阵之间的相关性不消失,该算法就能在多项式时间内取得成功。我们的成果是第一个在相关性为任意小常数时解决图匹配类型问题的多项式时间算法。
{"title":"A Polynomial Time Iterative Algorithm for Matching Gaussian Matrices with Non-vanishing Correlation","authors":"Jian Ding, Zhangsong Li","doi":"10.1007/s10208-024-09662-x","DOIUrl":"https://doi.org/10.1007/s10208-024-09662-x","url":null,"abstract":"<p>Motivated by the problem of matching vertices in two correlated Erdős-Rényi graphs, we study the problem of matching two correlated Gaussian Wigner matrices. We propose an iterative matching algorithm, which succeeds in polynomial time as long as the correlation between the two Gaussian matrices does not vanish. Our result is the first polynomial time algorithm that solves a graph matching type of problem when the correlation is an arbitrarily small constant.\u0000</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"60 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141737076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Quantitative Stability of the Pushforward Operation by an Optimal Transport Map 通过最优传输图实现前推操作的定量稳定性
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2024-07-19 DOI: 10.1007/s10208-024-09669-4
Guillaume Carlier, Alex Delalande, Quentin Mérigot

We study the quantitative stability of the mapping that to a measure associates its pushforward measure by a fixed (non-smooth) optimal transport map. We exhibit a tight Hölder-behavior for this operation under minimal assumptions. Our proof essentially relies on a new bound that quantifies the size of the singular sets of a convex and Lipschitz continuous function on a bounded domain.

我们研究了用固定的(非光滑的)最优传输映射来关联一个度量的前推度量的映射的定量稳定性。在极少假设条件下,我们展示了这一操作的严密荷尔德行为。我们的证明主要依赖于一个新的约束,它量化了有界域上凸函数和利普希兹连续函数奇异集的大小。
{"title":"Quantitative Stability of the Pushforward Operation by an Optimal Transport Map","authors":"Guillaume Carlier, Alex Delalande, Quentin Mérigot","doi":"10.1007/s10208-024-09669-4","DOIUrl":"https://doi.org/10.1007/s10208-024-09669-4","url":null,"abstract":"<p>We study the quantitative stability of the mapping that to a measure associates its pushforward measure by a fixed (non-smooth) optimal transport map. We exhibit a tight Hölder-behavior for this operation under minimal assumptions. Our proof essentially relies on a new bound that quantifies the size of the singular sets of a convex and Lipschitz continuous function on a bounded domain.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"25 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141730631","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Koszul Complexes and Relative Homological Algebra of Functors Over Posets Koszul 复数和 Posets 上函数的相对同调代数
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2024-06-18 DOI: 10.1007/s10208-024-09660-z
Wojciech Chachólski, Andrea Guidolin, Isaac Ren, Martina Scolamiero, Francesca Tombari

Under certain conditions, Koszul complexes can be used to calculate relative Betti diagrams of vector space-valued functors indexed by a poset, without the explicit computation of global minimal relative resolutions. In relative homological algebra of such functors, free functors are replaced by an arbitrary family of functors. Relative Betti diagrams encode the multiplicities of these functors in minimal relative resolutions. In this article we provide conditions under which grading the chosen family of functors leads to explicit Koszul complexes whose homology dimensions are the relative Betti diagrams, thus giving a scheme for the computation of these numerical descriptors.

在某些条件下,Koszul 复数可用于计算由正集索引的向量空间值函数的相对贝蒂图,而无需明确计算全局最小相对分辨率。在这类函子的相对同调代数中,自由函子被任意的函子族所取代。相对贝蒂图用最小相对解析编码了这些函数的乘法。在这篇文章中,我们提供了一些条件,在这些条件下,对所选的函数族进行分级会导致明确的科斯祖尔复数,其同调维数就是相对贝蒂图,从而给出了计算这些数值描述符的方案。
{"title":"Koszul Complexes and Relative Homological Algebra of Functors Over Posets","authors":"Wojciech Chachólski, Andrea Guidolin, Isaac Ren, Martina Scolamiero, Francesca Tombari","doi":"10.1007/s10208-024-09660-z","DOIUrl":"https://doi.org/10.1007/s10208-024-09660-z","url":null,"abstract":"<p>Under certain conditions, Koszul complexes can be used to calculate relative Betti diagrams of vector space-valued functors indexed by a poset, without the explicit computation of global minimal relative resolutions. In relative homological algebra of such functors, free functors are replaced by an arbitrary family of functors. Relative Betti diagrams encode the multiplicities of these functors in minimal relative resolutions. In this article we provide conditions under which grading the chosen family of functors leads to explicit Koszul complexes whose homology dimensions are the relative Betti diagrams, thus giving a scheme for the computation of these numerical descriptors.\u0000</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"14 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141425513","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Local Nearly Linearly Convergent First-Order Method for Nonsmooth Functions with Quadratic Growth 具有二次增长的非光滑函数的局部近线性收敛一阶方法
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2024-06-14 DOI: 10.1007/s10208-024-09653-y
Damek Davis, Liwei Jiang

Classical results show that gradient descent converges linearly to minimizers of smooth strongly convex functions. A natural question is whether there exists a locally nearly linearly convergent method for nonsmooth functions with quadratic growth. This work designs such a method for a wide class of nonsmooth and nonconvex locally Lipschitz functions, including max-of-smooth, Shapiro’s decomposable class, and generic semialgebraic functions. The algorithm is parameter-free and derives from Goldstein’s conceptual subgradient method.

经典结果表明,梯度下降线性收敛于光滑强凸函数的最小值。一个自然的问题是,对于二次增长的非光滑函数,是否存在一种近乎线性收敛的局部方法。这项研究为一大类非光滑和非凸局部 Lipschitz 函数设计了这样一种方法,包括最大光滑函数、Shapiro 的可分解类函数和一般半代数函数。该算法无参数,源自戈尔茨坦的概念子梯度法。
{"title":"A Local Nearly Linearly Convergent First-Order Method for Nonsmooth Functions with Quadratic Growth","authors":"Damek Davis, Liwei Jiang","doi":"10.1007/s10208-024-09653-y","DOIUrl":"https://doi.org/10.1007/s10208-024-09653-y","url":null,"abstract":"<p>Classical results show that gradient descent converges linearly to minimizers of smooth strongly convex functions. A natural question is whether there exists a locally nearly linearly convergent method for nonsmooth functions with quadratic growth. This work designs such a method for a wide class of nonsmooth and nonconvex locally Lipschitz functions, including max-of-smooth, Shapiro’s decomposable class, and generic semialgebraic functions. The algorithm is parameter-free and derives from Goldstein’s conceptual subgradient method.\u0000</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"29 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141326869","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Convergent Regularization in Inverse Problems and Linear Plug-and-Play Denoisers 逆问题中的收敛正则化和线性即插即用去噪器
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2024-06-03 DOI: 10.1007/s10208-024-09654-x
Andreas Hauptmann, Subhadip Mukherjee, Carola-Bibiane Schönlieb, Ferdia Sherry

Regularization is necessary when solving inverse problems to ensure the well-posedness of the solution map. Additionally, it is desired that the chosen regularization strategy is convergent in the sense that the solution map converges to a solution of the noise-free operator equation. This provides an important guarantee that stable solutions can be computed for all noise levels and that solutions satisfy the operator equation in the limit of vanishing noise. In recent years, reconstructions in inverse problems are increasingly approached from a data-driven perspective. Despite empirical success, the majority of data-driven approaches do not provide a convergent regularization strategy. One such popular example is given by iterative plug-and-play (PnP) denoising using off-the-shelf image denoisers. These usually provide only convergence of the PnP iterates to a fixed point, under suitable regularity assumptions on the denoiser, rather than convergence of the method as a regularization technique, thatis under vanishing noise and regularization strength. This paper serves two purposes: first, we provide an overview of the classical regularization theory in inverse problems and survey a few notable recent data-driven methods that are provably convergent regularization schemes. We then continue to discuss PnP algorithms and their established convergence guarantees. Subsequently, we consider PnP algorithms with learned linear denoisers and propose a novel spectral filtering technique of the denoiser to control the strength of regularization. Further, by relating the implicit regularization of the denoiser to an explicit regularization functional, we are the first to rigorously show that PnP with a learned linear denoiser leads to a convergent regularization scheme. The theoretical analysis is corroborated by numerical experiments for the classical inverse problem of tomographic image reconstruction.

在求解逆问题时,为了确保解图的良好拟合性,正则化是必要的。此外,我们还希望所选的正则化策略具有收敛性,即解图能收敛到无噪声算子方程的解。这就提供了一个重要保证,即可以计算出所有噪声水平下的稳定解,并且在噪声消失的极限下,解满足算子方程。近年来,逆问题中的重建越来越多地从数据驱动的角度出发。尽管在经验上取得了成功,但大多数数据驱动方法并没有提供收敛正则化策略。使用现成的图像去噪器进行迭代即插即用(PnP)去噪就是这样一个流行的例子。这些方法通常只提供在去噪器适当的正则假设条件下 PnP 迭代收敛到一个固定点的情况,而不提供该方法作为正则化技术的收敛情况,即在噪声和正则化强度消失的情况下。本文有两个目的:首先,我们概述了逆问题中的经典正则化理论,并调查了近期一些著名的数据驱动方法,这些方法都是可证明收敛的正则化方案。然后,我们继续讨论 PnP 算法及其既定的收敛性保证。随后,我们考虑了带有学习线性去噪器的 PnP 算法,并提出了一种新颖的去噪器光谱过滤技术来控制正则化的强度。此外,通过将去噪器的隐式正则化与显式正则化函数联系起来,我们首次严格地证明了使用学习线性去噪器的 PnP 算法会带来收敛的正则化方案。理论分析得到了经典的断层图像重建逆问题数值实验的证实。
{"title":"Convergent Regularization in Inverse Problems and Linear Plug-and-Play Denoisers","authors":"Andreas Hauptmann, Subhadip Mukherjee, Carola-Bibiane Schönlieb, Ferdia Sherry","doi":"10.1007/s10208-024-09654-x","DOIUrl":"https://doi.org/10.1007/s10208-024-09654-x","url":null,"abstract":"<p>Regularization is necessary when solving inverse problems to ensure the well-posedness of the solution map. Additionally, it is desired that the chosen regularization strategy is convergent in the sense that the solution map converges to a solution of the noise-free operator equation. This provides an important guarantee that stable solutions can be computed for all noise levels and that solutions satisfy the operator equation in the limit of vanishing noise. In recent years, reconstructions in inverse problems are increasingly approached from a data-driven perspective. Despite empirical success, the majority of data-driven approaches do not provide a convergent regularization strategy. One such popular example is given by iterative plug-and-play (PnP) denoising using off-the-shelf image denoisers. These usually provide only convergence of the PnP iterates to a fixed point, under suitable regularity assumptions on the denoiser, rather than convergence of the method as a regularization technique, thatis under vanishing noise and regularization strength. This paper serves two purposes: first, we provide an overview of the classical regularization theory in inverse problems and survey a few notable recent data-driven methods that are provably convergent regularization schemes. We then continue to discuss PnP algorithms and their established convergence guarantees. Subsequently, we consider PnP algorithms with learned linear denoisers and propose a novel spectral filtering technique of the denoiser to control the strength of regularization. Further, by relating the implicit regularization of the denoiser to an explicit regularization functional, we are the first to rigorously show that PnP with a learned linear denoiser leads to a convergent regularization scheme. The theoretical analysis is corroborated by numerical experiments for the classical inverse problem of tomographic image reconstruction.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"47 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141246310","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Identifiability, the KL Property in Metric Spaces, and Subgradient Curves 可识别性、公度空间中的 KL 特性和次梯度曲线
IF 3 1区 数学 Q2 COMPUTER SCIENCE, THEORY & METHODS Pub Date : 2024-05-28 DOI: 10.1007/s10208-024-09652-z
A. S. Lewis, Tonghua Tian

Identifiability, and the closely related idea of partial smoothness, unify classical active set methods and more general notions of solution structure. Diverse optimization algorithms generate iterates in discrete time that are eventually confined to identifiable sets. We present two fresh perspectives on identifiability. The first distills the notion to a simple metric property, applicable not just in Euclidean settings but to optimization over manifolds and beyond; the second reveals analogous continuous-time behavior for subgradient descent curves. The Kurdyka–Łojasiewicz property typically governs convergence in both discrete and continuous time: we explore its interplay with identifiability.

可识别性以及与之密切相关的部分平滑性概念,统一了经典的有源集方法和更普遍的解结构概念。各种优化算法会在离散时间内产生迭代,而这些迭代最终会局限于可识别集。我们对可识别性提出了两个全新的视角。第一种观点将这一概念提炼为一个简单的度量属性,不仅适用于欧几里得环境,还适用于流形及流形以外的优化;第二种观点揭示了子梯度下降曲线的类似连续时间行为。Kurdyka-Łojasiewicz 属性通常支配着离散时间和连续时间的收敛性:我们探讨了它与可识别性之间的相互作用。
{"title":"Identifiability, the KL Property in Metric Spaces, and Subgradient Curves","authors":"A. S. Lewis, Tonghua Tian","doi":"10.1007/s10208-024-09652-z","DOIUrl":"https://doi.org/10.1007/s10208-024-09652-z","url":null,"abstract":"<p>Identifiability, and the closely related idea of partial smoothness, unify classical active set methods and more general notions of solution structure. Diverse optimization algorithms generate iterates in discrete time that are eventually confined to identifiable sets. We present two fresh perspectives on identifiability. The first distills the notion to a simple metric property, applicable not just in Euclidean settings but to optimization over manifolds and beyond; the second reveals analogous continuous-time behavior for subgradient descent curves. The Kurdyka–Łojasiewicz property typically governs convergence in both discrete and continuous time: we explore its interplay with identifiability.</p>","PeriodicalId":55151,"journal":{"name":"Foundations of Computational Mathematics","volume":"61 23 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141165298","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Foundations of Computational Mathematics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1