首页 > 最新文献

SIAM Journal on Imaging Sciences最新文献

英文 中文
Riesz Feature Representation: Scale Equivariant Scattering Network for Classification Tasks 里兹特征表示:用于分类任务的尺度等变散射网络
IF 2.1 3区 数学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-06-20 DOI: 10.1137/23m1584836
Tin Barisin, Jesus Angulo, Katja Schladitz, Claudia Redenbach
SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1284-1313, June 2024.
Abstract. Scattering networks yield powerful and robust hierarchical image descriptors which do not require lengthy training and which work well with very few training data. However, they rely on sampling the scale dimension. Hence, they become sensitive to scale variations and are unable to generalize to unseen scales. In this work, we define an alternative feature representation based on the Riesz transform. We detail and analyze the mathematical foundations behind this representation. In particular, it inherits scale equivariance from the Riesz transform and completely avoids sampling of the scale dimension. Additionally, the number of features in the representation is reduced by a factor four compared to scattering networks. Nevertheless, our representation performs comparably well for texture classification with an interesting addition: scale equivariance. Our method yields very good performance when dealing with scales outside of those covered by the training dataset. The usefulness of the equivariance property is demonstrated on the digit classification task, where accuracy remains stable even for scales four times larger than the one chosen for training. As a second example, we consider classification of textures. Finally, we show how this representation can be used to build hybrid deep learning methods that are more stable to scale variations than standard deep networks.
SIAM 影像科学杂志》,第 17 卷第 2 期,第 1284-1313 页,2024 年 6 月。 摘要散射网络产生了强大而稳健的分层图像描述符,它不需要长时间的训练,只需很少的训练数据就能很好地工作。然而,它们依赖于尺度维度的采样。因此,它们对尺度变化非常敏感,无法泛化到未见过的尺度。在这项工作中,我们定义了一种基于 Riesz 变换的替代特征表示。我们详细介绍并分析了这种表示方法背后的数学基础。特别是,它继承了 Riesz 变换的尺度等差性,并完全避免了对尺度维度的采样。此外,与散射网络相比,该表示法的特征数量减少了四倍。尽管如此,我们的表示法在纹理分类方面仍有不俗的表现,而且还增加了一个有趣的功能:尺度等方差。在处理训练数据集覆盖范围之外的尺度时,我们的方法表现非常出色。我们在数字分类任务中证明了等方差特性的实用性,即使是比训练时选择的尺度大四倍的尺度,准确率也能保持稳定。第二个例子是纹理分类。最后,我们展示了如何利用这种表示来构建混合深度学习方法,这种方法比标准深度网络更能稳定地应对尺度变化。
{"title":"Riesz Feature Representation: Scale Equivariant Scattering Network for Classification Tasks","authors":"Tin Barisin, Jesus Angulo, Katja Schladitz, Claudia Redenbach","doi":"10.1137/23m1584836","DOIUrl":"https://doi.org/10.1137/23m1584836","url":null,"abstract":"SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1284-1313, June 2024. <br/> Abstract. Scattering networks yield powerful and robust hierarchical image descriptors which do not require lengthy training and which work well with very few training data. However, they rely on sampling the scale dimension. Hence, they become sensitive to scale variations and are unable to generalize to unseen scales. In this work, we define an alternative feature representation based on the Riesz transform. We detail and analyze the mathematical foundations behind this representation. In particular, it inherits scale equivariance from the Riesz transform and completely avoids sampling of the scale dimension. Additionally, the number of features in the representation is reduced by a factor four compared to scattering networks. Nevertheless, our representation performs comparably well for texture classification with an interesting addition: scale equivariance. Our method yields very good performance when dealing with scales outside of those covered by the training dataset. The usefulness of the equivariance property is demonstrated on the digit classification task, where accuracy remains stable even for scales four times larger than the one chosen for training. As a second example, we consider classification of textures. Finally, we show how this representation can be used to build hybrid deep learning methods that are more stable to scale variations than standard deep networks.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141529027","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Marginal Likelihood Estimation in Semiblind Image Deconvolution: A Stochastic Approximation Approach 半盲图像解卷积中的边际似然估计:随机逼近法
IF 2.1 3区 数学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-06-19 DOI: 10.1137/23m1584496
Charlesquin Kemajou Mbakam, Marcelo Pereyra, Jean-François Giovannelli
SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1206-1254, June 2024.
Abstract.This paper presents a novel stochastic optimization methodology to perform empirical Bayesian inference in semi-blind image deconvolution problems. Given a blurred image and a parametric class of possible operators, the proposed optimization approach automatically calibrates the parameters of the blur model by maximum marginal likelihood estimation, followed by (non-blind) image deconvolution by maximum a posteriori estimation conditionally to the estimated model parameters. In addition to the blur model, the proposed approach also automatically calibrates the noise level as well as any regularization parameters. The marginal likelihood of the blur, noise, and regularization parameters is generally computationally intractable, as it requires calculating several integrals over the entire solution space. Our approach addresses this difficulty by using a stochastic approximation proximal gradient optimization scheme, which iteratively solves such integrals by using a Moreau–Yosida regularized unadjusted Langevin Markov chain Monte Carlo algorithm. This optimization strategy can be easily and efficiently applied to any model that is log-concave and by using the same gradient and proximal operators that are required to compute the maximum a posteriori solution by convex optimization. We provide convergence guarantees for the proposed optimization scheme under realistic and easily verifiable conditions and subsequently demonstrate the effectiveness of the approach with a series of deconvolution experiments and comparisons with alternative strategies from the state of the art
SIAM 影像科学杂志》,第 17 卷第 2 期,第 1206-1254 页,2024 年 6 月。 摘要:本文提出了一种新颖的随机优化方法,用于在半盲图像解卷积问题中执行经验贝叶斯推理。给定一幅模糊图像和一类可能的算子参数,所提出的优化方法通过最大边际似然估计自动校准模糊模型参数,然后根据估计的模型参数通过最大后验估计进行(非盲)图像解卷积。除了模糊模型外,所提出的方法还能自动校准噪声水平以及任何正则化参数。模糊、噪声和正则化参数的边际似然通常难以计算,因为它需要计算整个解空间的多个积分。我们的方法通过使用随机近似近似梯度优化方案解决了这一难题,该方案通过使用莫罗-尤西达正则化未调整朗之文马尔可夫链蒙特卡罗算法迭代求解这些积分。这种优化策略可以轻松高效地应用于任何对数凹模型,并使用与凸优化计算最大后验解所需的相同梯度和近似算子。我们在现实且易于验证的条件下为所提出的优化方案提供了收敛保证,并随后通过一系列解卷积实验以及与现有替代策略的比较,证明了该方法的有效性。
{"title":"Marginal Likelihood Estimation in Semiblind Image Deconvolution: A Stochastic Approximation Approach","authors":"Charlesquin Kemajou Mbakam, Marcelo Pereyra, Jean-François Giovannelli","doi":"10.1137/23m1584496","DOIUrl":"https://doi.org/10.1137/23m1584496","url":null,"abstract":"SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1206-1254, June 2024. <br/> Abstract.This paper presents a novel stochastic optimization methodology to perform empirical Bayesian inference in semi-blind image deconvolution problems. Given a blurred image and a parametric class of possible operators, the proposed optimization approach automatically calibrates the parameters of the blur model by maximum marginal likelihood estimation, followed by (non-blind) image deconvolution by maximum a posteriori estimation conditionally to the estimated model parameters. In addition to the blur model, the proposed approach also automatically calibrates the noise level as well as any regularization parameters. The marginal likelihood of the blur, noise, and regularization parameters is generally computationally intractable, as it requires calculating several integrals over the entire solution space. Our approach addresses this difficulty by using a stochastic approximation proximal gradient optimization scheme, which iteratively solves such integrals by using a Moreau–Yosida regularized unadjusted Langevin Markov chain Monte Carlo algorithm. This optimization strategy can be easily and efficiently applied to any model that is log-concave and by using the same gradient and proximal operators that are required to compute the maximum a posteriori solution by convex optimization. We provide convergence guarantees for the proposed optimization scheme under realistic and easily verifiable conditions and subsequently demonstrate the effectiveness of the approach with a series of deconvolution experiments and comparisons with alternative strategies from the state of the art","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141503739","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Stable Local-Smooth Principal Component Pursuit 稳定的局部平滑主成分搜索
IF 2.1 3区 数学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-06-17 DOI: 10.1137/23m1580164
Jiangjun Peng, Hailin Wang, Xiangyong Cao, Xixi Jia, Hongying Zhang, Deyu Meng
SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1182-1205, June 2024.
Abstract.Recently, the CTV-RPCA model proposed the first recoverable theory for separating low-rank and local-smooth matrices and sparse matrices based on the correlated total variation (CTV) regularizer. However, the CTV-RPCA model ignores the influence of noise, which makes the model unable to effectively extract low-rank and local-smooth principal components under noisy circumstances. To alleviate this issue, this article extends the CTV-RPCA model by considering the influence of noise and proposes two robust models with parameter adaptive adjustment, i.e., Stable Principal Component Pursuit based on CTV (CTV-SPCP) and Square Root Principal Component Pursuit based on CTV (CTV-[math]). Furthermore, we present a statistical recoverable error bound for the proposed models, which allows us to know the relationship between the solution of the proposed models and the ground-truth. It is worth mentioning that, in the absence of noise, our theory degenerates back to the exact recoverable theory of the CTV-RPCA model. Finally, we develop the effective algorithms with the strict convergence guarantees. Extensive experiments adequately validate the theoretical assertions and also demonstrate the superiority of the proposed models over many state-of-the-art methods on various typical applications, including video foreground extraction, multispectral image denoising, and hyperspectral image denoising. The source code is released at https://github.com/andrew-pengjj/CTV-SPCP.
SIAM 影像科学期刊》第 17 卷第 2 期第 1182-1205 页,2024 年 6 月。 摘要.最近,CTV-RPCA 模型首次提出了基于相关总变异(CTV)正则的低秩局部光滑矩阵和稀疏矩阵分离的可恢复理论。然而,CTV-RPCA 模型忽略了噪声的影响,这使得该模型无法在噪声环境下有效提取低秩和局部光滑主成分。为了缓解这一问题,本文在考虑噪声影响的基础上对 CTV-RPCA 模型进行了扩展,并提出了两种具有参数自适应调整功能的鲁棒模型,即基于 CTV 的稳定主成分搜索模型(CTV-SPCP)和基于 CTV 的平方根主成分搜索模型(CTV-[math])。此外,我们还提出了建议模型的统计可恢复误差约束,这使我们能够了解建议模型的解与地面实况之间的关系。值得一提的是,在没有噪声的情况下,我们的理论会退化回 CTV-RPCA 模型的精确可恢复理论。最后,我们开发了具有严格收敛性保证的有效算法。广泛的实验充分验证了理论论断,也证明了所提出的模型在视频前景提取、多光谱图像去噪和高光谱图像去噪等各种典型应用中优于许多最先进的方法。源代码发布于 https://github.com/andrew-pengjj/CTV-SPCP。
{"title":"Stable Local-Smooth Principal Component Pursuit","authors":"Jiangjun Peng, Hailin Wang, Xiangyong Cao, Xixi Jia, Hongying Zhang, Deyu Meng","doi":"10.1137/23m1580164","DOIUrl":"https://doi.org/10.1137/23m1580164","url":null,"abstract":"SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1182-1205, June 2024. <br/> Abstract.Recently, the CTV-RPCA model proposed the first recoverable theory for separating low-rank and local-smooth matrices and sparse matrices based on the correlated total variation (CTV) regularizer. However, the CTV-RPCA model ignores the influence of noise, which makes the model unable to effectively extract low-rank and local-smooth principal components under noisy circumstances. To alleviate this issue, this article extends the CTV-RPCA model by considering the influence of noise and proposes two robust models with parameter adaptive adjustment, i.e., Stable Principal Component Pursuit based on CTV (CTV-SPCP) and Square Root Principal Component Pursuit based on CTV (CTV-[math]). Furthermore, we present a statistical recoverable error bound for the proposed models, which allows us to know the relationship between the solution of the proposed models and the ground-truth. It is worth mentioning that, in the absence of noise, our theory degenerates back to the exact recoverable theory of the CTV-RPCA model. Finally, we develop the effective algorithms with the strict convergence guarantees. Extensive experiments adequately validate the theoretical assertions and also demonstrate the superiority of the proposed models over many state-of-the-art methods on various typical applications, including video foreground extraction, multispectral image denoising, and hyperspectral image denoising. The source code is released at https://github.com/andrew-pengjj/CTV-SPCP.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141503588","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Extrapolated Plug-and-Play Three-Operator Splitting Methods for Nonconvex Optimization with Applications to Image Restoration 用于非凸优化的外推即插即用三操作器分割方法及其在图像复原中的应用
IF 2.1 3区 数学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-06-13 DOI: 10.1137/23m1611166
Zhongming Wu, Chaoyan Huang, Tieyong Zeng
SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1145-1181, June 2024.
Abstract.This paper investigates the convergence properties and applications of the three-operator splitting method, also known as the Davis–Yin splitting (DYS) method, integrated with extrapolation and plug-and-play (PnP) denoiser within a nonconvex framework. We first propose an extrapolated DYS method to effectively solve a class of structural nonconvex optimization problems that involve minimizing the sum of three possibly nonconvex functions. Our approach provides an algorithmic framework that encompasses both extrapolated forward–backward splitting and extrapolated Douglas–Rachford splitting methods. To establish the convergence of the proposed method, we rigorously analyze its behavior based on the Kurdyka–Łojasiewicz property, subject to some tight parameter conditions. Moreover, we introduce two extrapolated PnP-DYS methods with convergence guarantee, where the traditional regularization step is replaced by a gradient step–based denoiser. This denoiser is designed using a differentiable neural network and can be reformulated as the proximal operator of a specific nonconvex functional. We conduct extensive experiments on image deblurring and image superresolution problems, where our numerical results showcase the advantage of the extrapolation strategy and the superior performance of the learning-based model that incorporates the PnP denoiser in terms of achieving high-quality recovery images.
SIAM 影像科学期刊》第 17 卷第 2 期第 1145-1181 页,2024 年 6 月。 摘要.本文研究了三操作器分裂方法(又称戴维斯-殷分裂(DYS)方法)的收敛特性及其在非凸框架内的应用,该方法集成了外推法和即插即用(PnP)去噪器。我们首先提出了一种外推 DYS 方法,以有效解决一类结构非凸优化问题,该问题涉及最小化三个可能非凸函数之和。我们的方法提供了一个包含外推前向后拆分法和外推法道格拉斯-拉赫福德拆分法的算法框架。为了确定所提方法的收敛性,我们根据 Kurdyka-Łojasiewicz 属性,在一些严格的参数条件下对其行为进行了严格分析。此外,我们还介绍了两种具有收敛性保证的外推 PnP-DYS 方法,其中传统的正则化步骤被基于梯度步骤的去噪器所取代。这种去噪器是利用可微神经网络设计的,可以重新表述为特定非凸函数的近端算子。我们在图像去模糊和图像超分辨率问题上进行了大量实验,数值结果显示了外推法的优势,以及基于学习的模型在实现高质量恢复图像方面的卓越性能,该模型结合了 PnP 去噪器。
{"title":"Extrapolated Plug-and-Play Three-Operator Splitting Methods for Nonconvex Optimization with Applications to Image Restoration","authors":"Zhongming Wu, Chaoyan Huang, Tieyong Zeng","doi":"10.1137/23m1611166","DOIUrl":"https://doi.org/10.1137/23m1611166","url":null,"abstract":"SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1145-1181, June 2024. <br/> Abstract.This paper investigates the convergence properties and applications of the three-operator splitting method, also known as the Davis–Yin splitting (DYS) method, integrated with extrapolation and plug-and-play (PnP) denoiser within a nonconvex framework. We first propose an extrapolated DYS method to effectively solve a class of structural nonconvex optimization problems that involve minimizing the sum of three possibly nonconvex functions. Our approach provides an algorithmic framework that encompasses both extrapolated forward–backward splitting and extrapolated Douglas–Rachford splitting methods. To establish the convergence of the proposed method, we rigorously analyze its behavior based on the Kurdyka–Łojasiewicz property, subject to some tight parameter conditions. Moreover, we introduce two extrapolated PnP-DYS methods with convergence guarantee, where the traditional regularization step is replaced by a gradient step–based denoiser. This denoiser is designed using a differentiable neural network and can be reformulated as the proximal operator of a specific nonconvex functional. We conduct extensive experiments on image deblurring and image superresolution problems, where our numerical results showcase the advantage of the extrapolation strategy and the superior performance of the learning-based model that incorporates the PnP denoiser in terms of achieving high-quality recovery images.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141531359","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Stochastic Variance Reduced Gradient for Affine Rank Minimization Problem 仿等级最小化问题的随机方差降低梯度
IF 2.1 3区 数学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-06-04 DOI: 10.1137/23m1555387
Ningning Han, Juan Nie, Jian Lu, Michael K. Ng
SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1118-1144, June 2024.
Abstract.In this paper, we develop an efficient stochastic variance reduced gradient descent algorithm to solve the affine rank minimization problem consisting of finding a matrix of minimum rank from linear measurements. The proposed algorithm as a stochastic gradient descent strategy enjoys a more favorable complexity than that using full gradients. It also reduces the variance of the stochastic gradient at each iteration and accelerates the rate of convergence. We prove that the proposed algorithm converges linearly in expectation to the solution under a restricted isometry condition. Numerical experimental results demonstrate that the proposed algorithm has a clear advantageous balance of efficiency, adaptivity, and accuracy compared with other state-of-the-art algorithms.
SIAM 影像科学期刊》第 17 卷第 2 期第 1118-1144 页,2024 年 6 月。 摘要.在本文中,我们开发了一种高效的随机方差降低梯度下降算法来解决仿射秩最小化问题,该问题包括从线性测量中找到秩最小的矩阵。作为一种随机梯度下降策略,所提出的算法比使用完全梯度的算法具有更高的复杂度。它还降低了每次迭代的随机梯度方差,加快了收敛速度。我们证明了所提出的算法在受限等距条件下线性收敛于期望解。数值实验结果表明,与其他最先进的算法相比,所提出的算法在效率、适应性和准确性之间具有明显的平衡优势。
{"title":"Stochastic Variance Reduced Gradient for Affine Rank Minimization Problem","authors":"Ningning Han, Juan Nie, Jian Lu, Michael K. Ng","doi":"10.1137/23m1555387","DOIUrl":"https://doi.org/10.1137/23m1555387","url":null,"abstract":"SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1118-1144, June 2024. <br/> Abstract.In this paper, we develop an efficient stochastic variance reduced gradient descent algorithm to solve the affine rank minimization problem consisting of finding a matrix of minimum rank from linear measurements. The proposed algorithm as a stochastic gradient descent strategy enjoys a more favorable complexity than that using full gradients. It also reduces the variance of the stochastic gradient at each iteration and accelerates the rate of convergence. We prove that the proposed algorithm converges linearly in expectation to the solution under a restricted isometry condition. Numerical experimental results demonstrate that the proposed algorithm has a clear advantageous balance of efficiency, adaptivity, and accuracy compared with other state-of-the-art algorithms.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141518265","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Accelerated Bayesian Imaging by Relaxed Proximal-Point Langevin Sampling 通过松弛近端点朗文采样加速贝叶斯成像
IF 2.1 3区 数学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2024-06-03 DOI: 10.1137/23m1594832
Teresa Klatzer, Paul Dobson, Yoann Altmann, Marcelo Pereyra, Jesus Maria Sanz-Serna, Konstantinos C. Zygalakis
SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1078-1117, June 2024.
Abstract.This paper presents a new accelerated proximal Markov chain Monte Carlo methodology to perform Bayesian inference in imaging inverse problems with an underlying convex geometry. The proposed strategy takes the form of a stochastic relaxed proximal-point iteration that admits two complementary interpretations. For models that are smooth or regularized by Moreau–Yosida smoothing, the algorithm is equivalent to an implicit midpoint discretization of an overdamped Langevin diffusion targeting the posterior distribution of interest. This discretization is asymptotically unbiased for Gaussian targets and shown to converge in an accelerated manner for any target that is [math]-strongly log-concave (i.e., requiring in the order of [math] iterations to converge, similar to accelerated optimization schemes), comparing favorably to Pereyra, Vargas Mieles, and Zygalakis [SIAM J. Imaging Sci., 13 (2020), pp. 905–935], which is only provably accelerated for Gaussian targets and has bias. For models that are not smooth, the algorithm is equivalent to a Leimkuhler–Matthews discretization of a Langevin diffusion targeting a Moreau–Yosida approximation of the posterior distribution of interest and hence achieves a significantly lower bias than conventional unadjusted Langevin strategies based on the Euler–Maruyama discretization. For targets that are [math]-strongly log-concave, the provided nonasymptotic convergence analysis also identifies the optimal time step, which maximizes the convergence speed. The proposed methodology is demonstrated through a range of experiments related to image deconvolution with Gaussian and Poisson noise with assumption-driven and data-driven convex priors. Source codes for the numerical experiments of this paper are available from https://github.com/MI2G/accelerated-langevin-imla.
SIAM 影像科学杂志》第 17 卷第 2 期第 1078-1117 页,2024 年 6 月。 摘要:本文提出了一种新的加速近端马尔科夫链蒙特卡洛方法,用于在具有底层凸几何的成像逆问题中执行贝叶斯推理。所提出的策略采用随机松弛近似点迭代的形式,允许两种互补的解释。对于通过莫罗-尤西达平滑法平滑或正则化的模型,该算法等同于以感兴趣的后验分布为目标的过阻尼 Langevin 扩散的隐式中点离散化。对于高斯目标,这种离散化是渐近无偏的,而且对于任何[math]强对数凹(即、与 Pereyra、Vargas Mieles 和 Zygalakis [SIAM J. Imaging Sci.对于非光滑模型,该算法等同于以感兴趣的后验分布的莫罗-约西达近似为目标的 Langevin 扩散的 Leimkuhler-Matthews 离散化,因此比基于 Euler-Maruyama 离散化的传统未调整 Langevin 策略的偏差低得多。对于[数学]强对数凹的目标,所提供的非渐近收敛分析还能确定最佳时间步长,从而最大限度地提高收敛速度。本文提出的方法通过一系列与高斯和泊松噪声的图像解卷积相关的实验进行了演示,实验中使用了假设驱动和数据驱动的凸先验。本文数值实验的源代码可从 https://github.com/MI2G/accelerated-langevin-imla 获取。
{"title":"Accelerated Bayesian Imaging by Relaxed Proximal-Point Langevin Sampling","authors":"Teresa Klatzer, Paul Dobson, Yoann Altmann, Marcelo Pereyra, Jesus Maria Sanz-Serna, Konstantinos C. Zygalakis","doi":"10.1137/23m1594832","DOIUrl":"https://doi.org/10.1137/23m1594832","url":null,"abstract":"SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1078-1117, June 2024. <br/> Abstract.This paper presents a new accelerated proximal Markov chain Monte Carlo methodology to perform Bayesian inference in imaging inverse problems with an underlying convex geometry. The proposed strategy takes the form of a stochastic relaxed proximal-point iteration that admits two complementary interpretations. For models that are smooth or regularized by Moreau–Yosida smoothing, the algorithm is equivalent to an implicit midpoint discretization of an overdamped Langevin diffusion targeting the posterior distribution of interest. This discretization is asymptotically unbiased for Gaussian targets and shown to converge in an accelerated manner for any target that is [math]-strongly log-concave (i.e., requiring in the order of [math] iterations to converge, similar to accelerated optimization schemes), comparing favorably to Pereyra, Vargas Mieles, and Zygalakis [SIAM J. Imaging Sci., 13 (2020), pp. 905–935], which is only provably accelerated for Gaussian targets and has bias. For models that are not smooth, the algorithm is equivalent to a Leimkuhler–Matthews discretization of a Langevin diffusion targeting a Moreau–Yosida approximation of the posterior distribution of interest and hence achieves a significantly lower bias than conventional unadjusted Langevin strategies based on the Euler–Maruyama discretization. For targets that are [math]-strongly log-concave, the provided nonasymptotic convergence analysis also identifies the optimal time step, which maximizes the convergence speed. The proposed methodology is demonstrated through a range of experiments related to image deconvolution with Gaussian and Poisson noise with assumption-driven and data-driven convex priors. Source codes for the numerical experiments of this paper are available from https://github.com/MI2G/accelerated-langevin-imla.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141551084","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Total Generalized Variation on a Tree 一棵树上的总体变化
IF 2.1 3区 数学 Q1 Mathematics Pub Date : 2024-05-30 DOI: 10.1137/23m1556915
Muhamed Kuric, Jan Ahmetspahic, Thomas Pock
SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1040-1077, June 2024.
Abstract.We consider a class of optimization problems defined over trees with unary cost terms and shifted pairwise cost terms. These problems arise when considering block coordinate descent (BCD) approaches for solving inverse problems with total generalized variation (TGV) regularizers or their nonconvex generalizations. We introduce a linear-time reduction that transforms the shifted problems into their nonshifted counterparts. However, combining existing continuous dynamic programming (DP) algorithms with the reduction does not lead to BCD iterations that compute TGV-like solutions. This problem can be overcome by considering a box-constrained modification of the subproblems or smoothing the cost terms of the TGV regularized problem. The former leads to shifted and box-constrained subproblems, for which we propose a linear-time reduction to their unconstrained counterpart. The latter naturally leads to problems with smooth unary and pairwise cost terms. With this in mind, we propose two novel continuous DP algorithms that can solve (convex and nonconvex) problems with piecewise quadratic unary and pairwise cost terms. We prove that the algorithm for the convex case has quadratic worst-case time and memory complexity, while the algorithm for the nonconvex case has exponential time and memory complexity, but works well in practice for smooth truncated total variation pairwise costs. Finally, we demonstrate the applicability of the proposed algorithms for solving inverse problems with first-order and higher-order regularizers.
SIAM 影像科学期刊》第 17 卷第 2 期第 1040-1077 页,2024 年 6 月。 摘要.我们考虑了一类定义在具有一元代价项和移位成对代价项的树上的优化问题。这些问题是在考虑用块坐标下降(BCD)方法解决具有总广义变异(TGV)正则或其非凸广义的逆问题时出现的。我们引入了一种线性时间还原法,可将移位问题转化为非移位问题。然而,将现有的连续动态编程(DP)算法与还原法结合起来,并不会产生能计算类似 TGV 解的 BCD 迭代。要解决这个问题,可以考虑对子问题进行箱约束修改,或者对 TGV 正则化问题的代价项进行平滑处理。前者会导致移位和盒式受限子问题,为此我们提出了一种线性时间还原为无约束对应问题的方法。后者自然会导致具有平滑单值和成对成本项的问题。有鉴于此,我们提出了两种新颖的连续 DP 算法,可以解决具有片断二次单项式和成对代价项的(凸和非凸)问题。我们证明,凸情况下的算法具有二次最坏情况时间和内存复杂度,而非凸情况下的算法具有指数时间和内存复杂度,但在实践中对于平滑截断的总变化成对成本效果很好。最后,我们展示了所提算法在解决具有一阶和高阶正则的逆问题时的适用性。
{"title":"Total Generalized Variation on a Tree","authors":"Muhamed Kuric, Jan Ahmetspahic, Thomas Pock","doi":"10.1137/23m1556915","DOIUrl":"https://doi.org/10.1137/23m1556915","url":null,"abstract":"SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1040-1077, June 2024. <br/> Abstract.We consider a class of optimization problems defined over trees with unary cost terms and shifted pairwise cost terms. These problems arise when considering block coordinate descent (BCD) approaches for solving inverse problems with total generalized variation (TGV) regularizers or their nonconvex generalizations. We introduce a linear-time reduction that transforms the shifted problems into their nonshifted counterparts. However, combining existing continuous dynamic programming (DP) algorithms with the reduction does not lead to BCD iterations that compute TGV-like solutions. This problem can be overcome by considering a box-constrained modification of the subproblems or smoothing the cost terms of the TGV regularized problem. The former leads to shifted and box-constrained subproblems, for which we propose a linear-time reduction to their unconstrained counterpart. The latter naturally leads to problems with smooth unary and pairwise cost terms. With this in mind, we propose two novel continuous DP algorithms that can solve (convex and nonconvex) problems with piecewise quadratic unary and pairwise cost terms. We prove that the algorithm for the convex case has quadratic worst-case time and memory complexity, while the algorithm for the nonconvex case has exponential time and memory complexity, but works well in practice for smooth truncated total variation pairwise costs. Finally, we demonstrate the applicability of the proposed algorithms for solving inverse problems with first-order and higher-order regularizers.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141171789","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assembling a Learnable Mumford–Shah Type Model with Multigrid Technique for Image Segmentation 利用多网格技术组装可学习的芒福德-沙阿型模型,用于图像分割
IF 2.1 3区 数学 Q1 Mathematics Pub Date : 2024-05-22 DOI: 10.1137/23m1577663
Junying Meng, Weihong Guo, Jun Liu, Mingrui Yang
{"title":"Assembling a Learnable Mumford–Shah Type Model with Multigrid Technique for Image Segmentation","authors":"Junying Meng, Weihong Guo, Jun Liu, Mingrui Yang","doi":"10.1137/23m1577663","DOIUrl":"https://doi.org/10.1137/23m1577663","url":null,"abstract":"","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141111706","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Imaging with Thermal Noise Induced Currents 利用热噪声诱导电流成像
IF 2.1 3区 数学 Q1 Mathematics Pub Date : 2024-05-21 DOI: 10.1137/23m1571630
Trent DeGiovanni, Fernando Guevara Vasquez, China Mauck
SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 984-1006, June 2024.
Abstract.We use thermal noise induced currents to image the real and imaginary parts of the conductivity of a body. Covariances of the thermal noise currents measured at a few electrodes are shown to be related to a deterministic problem. We use the covariances obtained while selectively heating the body to recover the real power density in the body under known boundary conditions and at a known frequency. The resulting inverse problem is related to acousto-electric tomography, but where the conductivity is complex and only the real power is measured. We study the local solvability of this problem by determining where its linearization is elliptic. Numerical experiments illustrating this inverse problem are included.
SIAM 影像科学杂志》第 17 卷第 2 期第 984-1006 页,2024 年 6 月。 摘要.我们利用热噪声感应电流对人体电导率的实部和虚部进行成像。在几个电极上测量的热噪声电流的协方差被证明与一个确定性问题有关。我们利用选择性加热人体时获得的协方差来恢复已知边界条件和已知频率下人体的实际功率密度。由此产生的逆问题与声电断层扫描有关,但其中的传导性是复杂的,而且只测量实际功率。我们通过确定其线性化椭圆的位置来研究该问题的局部可解性。文中还包括说明该逆问题的数值实验。
{"title":"Imaging with Thermal Noise Induced Currents","authors":"Trent DeGiovanni, Fernando Guevara Vasquez, China Mauck","doi":"10.1137/23m1571630","DOIUrl":"https://doi.org/10.1137/23m1571630","url":null,"abstract":"SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 984-1006, June 2024. <br/> Abstract.We use thermal noise induced currents to image the real and imaginary parts of the conductivity of a body. Covariances of the thermal noise currents measured at a few electrodes are shown to be related to a deterministic problem. We use the covariances obtained while selectively heating the body to recover the real power density in the body under known boundary conditions and at a known frequency. The resulting inverse problem is related to acousto-electric tomography, but where the conductivity is complex and only the real power is measured. We study the local solvability of this problem by determining where its linearization is elliptic. Numerical experiments illustrating this inverse problem are included.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141152808","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Weighted Spectral Filters for Kernel Interpolation on Spheres: Estimates of Prediction Accuracy for Noisy Data 用于球体上核插值的加权频谱滤波器:噪声数据的预测精度估算
IF 2.1 3区 数学 Q1 Mathematics Pub Date : 2024-05-20 DOI: 10.1137/23m1585350
Xiaotong Liu, Jinxin Wang, Di Wang, Shao-Bo Lin
SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 951-983, June 2024.
Abstract.Spherical radial-basis-based kernel interpolation abounds in image sciences, including geophysical image reconstruction, climate trends description, and image rendering, due to its excellent spatial localization property and perfect approximation performance. However, in dealing with noisy data, kernel interpolation frequently behaves not so well due to the large condition number of the kernel matrix and instability of the interpolation process. In this paper, we introduce a weighted spectral filter approach to reduce the condition number of the kernel matrix and then stabilize kernel interpolation. The main building blocks of the proposed method are the well-developed spherical positive quadrature rules and high-pass spectral filters. Using a recently developed integral operator approach for spherical data analysis, we theoretically demonstrate that the proposed weighted spectral filter approach succeeds in breaking through the bottleneck of kernel interpolation, especially in fitting noisy data. We provide optimal approximation rates of the new method to show that our approach does not compromise the predicting accuracy. Furthermore, we conduct both toy simulations and two real-world data experiments with synthetically added noise in geophysical image reconstruction and climate image processing to verify our theoretical assertions and show the feasibility of the weighted spectral filter approach.
SIAM 影像科学期刊》第 17 卷第 2 期第 951-983 页,2024 年 6 月。 摘要.基于球面径向基点的核插值因其出色的空间定位特性和完美的逼近性能,在地球物理图像重建、气候趋势描述和图像渲染等图像科学领域应用广泛。然而,在处理噪声数据时,由于内核矩阵的条件数较大,插值过程不稳定,内核插值常常表现不佳。在本文中,我们引入了一种加权谱滤波方法来减少核矩阵的条件数,进而稳定核插值。所提方法的主要构件是成熟的球面正交规则和高通频谱滤波器。利用最近开发的球面数据分析积分算子方法,我们从理论上证明了所提出的加权谱滤波器方法能成功突破内核插值的瓶颈,尤其是在拟合噪声数据时。我们提供了新方法的最佳逼近率,表明我们的方法不会影响预测精度。此外,我们还在地球物理图像重建和气候图像处理中进行了玩具模拟和两个人工添加噪声的实际数据实验,以验证我们的理论论断,并展示加权光谱滤波方法的可行性。
{"title":"Weighted Spectral Filters for Kernel Interpolation on Spheres: Estimates of Prediction Accuracy for Noisy Data","authors":"Xiaotong Liu, Jinxin Wang, Di Wang, Shao-Bo Lin","doi":"10.1137/23m1585350","DOIUrl":"https://doi.org/10.1137/23m1585350","url":null,"abstract":"SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 951-983, June 2024. <br/> Abstract.Spherical radial-basis-based kernel interpolation abounds in image sciences, including geophysical image reconstruction, climate trends description, and image rendering, due to its excellent spatial localization property and perfect approximation performance. However, in dealing with noisy data, kernel interpolation frequently behaves not so well due to the large condition number of the kernel matrix and instability of the interpolation process. In this paper, we introduce a weighted spectral filter approach to reduce the condition number of the kernel matrix and then stabilize kernel interpolation. The main building blocks of the proposed method are the well-developed spherical positive quadrature rules and high-pass spectral filters. Using a recently developed integral operator approach for spherical data analysis, we theoretically demonstrate that the proposed weighted spectral filter approach succeeds in breaking through the bottleneck of kernel interpolation, especially in fitting noisy data. We provide optimal approximation rates of the new method to show that our approach does not compromise the predicting accuracy. Furthermore, we conduct both toy simulations and two real-world data experiments with synthetically added noise in geophysical image reconstruction and climate image processing to verify our theoretical assertions and show the feasibility of the weighted spectral filter approach.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2024-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141153960","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
SIAM Journal on Imaging Sciences
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1