首页 > 最新文献

SIAM Journal on Imaging Sciences最新文献

英文 中文
Image Recovery for Blind Polychromatic Ptychography 盲多色印刷的图像恢复
3区 数学 Q1 Mathematics Pub Date : 2023-07-28 DOI: 10.1137/22m1527155
Frank Filbir, Oleh Melnyk
Ptychography is a lensless imaging technique, which considers reconstruction from a set of far-field diffraction patterns obtained by illuminating small overlapping regions of the specimen. In many cases, the distribution of light inside the illuminated region is unknown and has to be estimated along with the object of interest. This problem is referred to as blind ptychography. While in ptychography the illumination is commonly assumed to have a point spectrum, in this paper we consider an alternative scenario with a nontrivial light spectrum known as blind polychromatic ptychography. First, we show that nonblind polychromatic ptychography can be seen as a recovery from quadratic measurements. Then, a reconstruction from such measurements can be performed by a variant of the Amplitude Flow algorithm, which has guaranteed sublinear convergence to a critical point. Second, we address recovery from blind polychromatic ptychographic measurements by devising an alternating minimization version of Amplitude Flow and showing that it converges to a critical point at a sublinear rate.
Ptychography是一种无透镜成像技术,它考虑了通过照亮样品的小重叠区域获得的一组远场衍射图的重建。在许多情况下,光照区域内的光分布是未知的,必须与感兴趣的物体一起估计。这个问题被称为盲型印刷术。而在光刻中,照明通常被假设为具有点光谱,在本文中,我们考虑了一种替代方案,即具有非平凡光谱的盲多色光刻。首先,我们证明非盲多色型图可以被视为二次测量的恢复。然后,可以通过振幅流算法的一种变体来进行这些测量的重建,该算法保证了亚线性收敛到临界点。其次,我们通过设计幅度流的交替最小化版本并显示它以亚线性速率收敛到临界点来解决盲多色型测量的恢复问题。
{"title":"Image Recovery for Blind Polychromatic Ptychography","authors":"Frank Filbir, Oleh Melnyk","doi":"10.1137/22m1527155","DOIUrl":"https://doi.org/10.1137/22m1527155","url":null,"abstract":"Ptychography is a lensless imaging technique, which considers reconstruction from a set of far-field diffraction patterns obtained by illuminating small overlapping regions of the specimen. In many cases, the distribution of light inside the illuminated region is unknown and has to be estimated along with the object of interest. This problem is referred to as blind ptychography. While in ptychography the illumination is commonly assumed to have a point spectrum, in this paper we consider an alternative scenario with a nontrivial light spectrum known as blind polychromatic ptychography. First, we show that nonblind polychromatic ptychography can be seen as a recovery from quadratic measurements. Then, a reconstruction from such measurements can be performed by a variant of the Amplitude Flow algorithm, which has guaranteed sublinear convergence to a critical point. Second, we address recovery from blind polychromatic ptychographic measurements by devising an alternating minimization version of Amplitude Flow and showing that it converges to a critical point at a sublinear rate.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134966068","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Separable Quaternion Matrix Factorization for Polarization Images 偏振图像的可分离四元数矩阵分解
IF 2.1 3区 数学 Q1 Mathematics Pub Date : 2023-07-26 DOI: 10.1137/22m151248x
Junjun Pan, Michael K. Ng
SIAM Journal on Imaging Sciences, Volume 16, Issue 3, Page 1281-1307, September 2023.
Abstract. A transverse wave is a wave in which the particles are displaced perpendicular to the direction of the wave’s advance. Examples of transverse waves include ripples on the surface of water and light waves. Polarization is one of the primary properties of transverse waves. Analysis of polarization states can reveal valuable information about the sources. In this paper, we propose a separable low-rank quaternion linear mixing model for polarized signals: we assume each column of the source factor matrix equals a column of the polarized data matrix and refer to the corresponding problem as separable quaternion matrix factorization (SQMF). We discuss some properties of the matrix that can be decomposed by SQMF. To determine the source factor matrix in quaternion space, we propose a heuristic algorithm called quaternion successive projection algorithm (QSPA) inspired by the successive projection algorithm. To guarantee the effectiveness of QSPA, a new normalization operator is proposed for the quaternion matrix. We use a block coordinate descent algorithm to compute nonnegative activation matrix in real number space. We test our method on the applications of polarization image representation and spectro-polarimetric imaging unmixing to verify its effectiveness.
SIAM影像科学杂志,第16卷,第3期,1281-1307页,2023年9月。摘要。横波是一种波,其中的粒子垂直于波的前进方向而移位。横波的例子包括水面上的涟漪和光波。极化是横波的主要特性之一。对偏振态的分析可以揭示有关光源的宝贵信息。本文提出了一种极化信号的可分离低秩四元数线性混合模型:我们假设源因子矩阵的每一列等于极化数据矩阵的一列,并将相应的问题称为可分离四元数矩阵分解(SQMF)。讨论了可被SQMF分解的矩阵的一些性质。为了确定四元数空间中的源因子矩阵,我们在四元数连续投影算法的启发下提出了一种启发式算法——四元数连续投影算法(QSPA)。为了保证QSPA的有效性,提出了一种新的四元数矩阵归一化算子。采用块坐标下降算法计算实数空间中的非负激活矩阵。在偏振图像表示和光谱偏振成像解混的应用中验证了该方法的有效性。
{"title":"Separable Quaternion Matrix Factorization for Polarization Images","authors":"Junjun Pan, Michael K. Ng","doi":"10.1137/22m151248x","DOIUrl":"https://doi.org/10.1137/22m151248x","url":null,"abstract":"SIAM Journal on Imaging Sciences, Volume 16, Issue 3, Page 1281-1307, September 2023. <br/> Abstract. A transverse wave is a wave in which the particles are displaced perpendicular to the direction of the wave’s advance. Examples of transverse waves include ripples on the surface of water and light waves. Polarization is one of the primary properties of transverse waves. Analysis of polarization states can reveal valuable information about the sources. In this paper, we propose a separable low-rank quaternion linear mixing model for polarized signals: we assume each column of the source factor matrix equals a column of the polarized data matrix and refer to the corresponding problem as separable quaternion matrix factorization (SQMF). We discuss some properties of the matrix that can be decomposed by SQMF. To determine the source factor matrix in quaternion space, we propose a heuristic algorithm called quaternion successive projection algorithm (QSPA) inspired by the successive projection algorithm. To guarantee the effectiveness of QSPA, a new normalization operator is proposed for the quaternion matrix. We use a block coordinate descent algorithm to compute nonnegative activation matrix in real number space. We test our method on the applications of polarization image representation and spectro-polarimetric imaging unmixing to verify its effectiveness.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2023-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138528997","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Provable Phase Retrieval with Mirror Descent 可证明的相位反演与镜像下降
IF 2.1 3区 数学 Q1 Mathematics Pub Date : 2023-07-14 DOI: 10.1137/22m1528896
Jean-Jacques Godeme, Jalal Fadili, Xavier Buet, Myriam Zerrad, Michel Lequime, Claude Amra
SIAM Journal on Imaging Sciences, Volume 16, Issue 3, Page 1106-1141, September 2023.
Abstract. In this paper, we consider the problem of phase retrieval, which consists of recovering an [math]‐dimensional real vector from the magnitude of its [math] linear measurements. We propose a mirror descent (or Bregman gradient descent) algorithm based on a wisely chosen Bregman divergence, hence allowing us to remove the classical global Lipschitz continuity requirement on the gradient of the nonconvex phase retrieval objective to be minimized. We apply the mirror descent for two random measurements: the i.i.d. standard Gaussian and those obtained by multiple structured illuminations through coded diffraction patterns. For the Gaussian case, we show that when the number of measurements [math] is large enough, then with high probability, for almost all initializers, the algorithm recovers the original vector up to a global sign change. For both measurements, the mirror descent exhibits a local linear convergence behavior with a dimension-independent convergence rate. Finally, our theoretical results are illustrated with various numerical experiments, including an application to the reconstruction of images in precision optics.
SIAM影像科学杂志,第16卷,第3期,1106-1141页,2023年9月。摘要。在本文中,我们考虑相位恢复问题,它包括从[数学]维的线性测量值中恢复一个[数学]维的实向量。我们提出了一种基于明智选择的Bregman散度的镜像下降(或Bregman梯度下降)算法,从而使我们能够消除对要最小化的非凸相位检索目标梯度的经典全局Lipschitz连续性要求。我们将镜像下降应用于两种随机测量:i.i.d标准高斯和通过编码衍射图案获得的多个结构化照明。对于高斯情况,我们表明,当测量的数量[math]足够大时,那么对于几乎所有初始化器,算法都有很高的概率恢复原始向量,直到全局符号改变。对于这两种测量,镜面下降都表现出局部线性收敛行为,收敛速率与维数无关。最后,我们的理论结果通过各种数值实验加以说明,包括在精密光学图像重建中的应用。
{"title":"Provable Phase Retrieval with Mirror Descent","authors":"Jean-Jacques Godeme, Jalal Fadili, Xavier Buet, Myriam Zerrad, Michel Lequime, Claude Amra","doi":"10.1137/22m1528896","DOIUrl":"https://doi.org/10.1137/22m1528896","url":null,"abstract":"SIAM Journal on Imaging Sciences, Volume 16, Issue 3, Page 1106-1141, September 2023. <br/> Abstract. In this paper, we consider the problem of phase retrieval, which consists of recovering an [math]‐dimensional real vector from the magnitude of its [math] linear measurements. We propose a mirror descent (or Bregman gradient descent) algorithm based on a wisely chosen Bregman divergence, hence allowing us to remove the classical global Lipschitz continuity requirement on the gradient of the nonconvex phase retrieval objective to be minimized. We apply the mirror descent for two random measurements: the i.i.d. standard Gaussian and those obtained by multiple structured illuminations through coded diffraction patterns. For the Gaussian case, we show that when the number of measurements [math] is large enough, then with high probability, for almost all initializers, the algorithm recovers the original vector up to a global sign change. For both measurements, the mirror descent exhibits a local linear convergence behavior with a dimension-independent convergence rate. Finally, our theoretical results are illustrated with various numerical experiments, including an application to the reconstruction of images in precision optics.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":2.1,"publicationDate":"2023-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138528998","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On Assignment Problems Related to Gromov–Wasserstein Distances on the Real Line 实线上与Gromov-Wasserstein距离有关的分配问题
3区 数学 Q1 Mathematics Pub Date : 2023-06-23 DOI: 10.1137/22m1497808
Robert Beinert, Cosmas Heiss, Gabriele Steidl
Let and , , be real numbers. We show by an example that the assignment problem begin{align*} max_{sigma in S_n} F_sigma (x,y) := frac 12 sum_{i,k=1}^n |x_i- x_k|^alpha , |y_{sigma (i)}- y_{sigma (k)}|^alpha, quad alpha gt 0, end{align*} is in general neither solved by the identical permutation nor the anti-identical permutation if . Indeed the above maximum can be, depending on the number of points, arbitrarily far away from and . The motivation to deal with such assignment problems came from their relation to Gromov–Wasserstein distances, which have recently received a lot of attention in imaging and shape analysis.
设和为实数。我们通过一个例子证明了分配问题begin{align*} max_{sigma in S_n} F_sigma (x,y) := frac 12 sum_{i,k=1}^n |x_i- x_k|^alpha , |y_{sigma (i)}- y_{sigma (k)}|^alpha, quad alpha gt 0, end{align*}一般既不能用同置换解决,也不能用反同置换解决。实际上,根据点的数量,上述最大值可以是任意距离和的值。处理这种赋值问题的动机来自于它们与Gromov-Wasserstein距离的关系,后者最近在成像和形状分析中受到了很多关注。
{"title":"On Assignment Problems Related to Gromov–Wasserstein Distances on the Real Line","authors":"Robert Beinert, Cosmas Heiss, Gabriele Steidl","doi":"10.1137/22m1497808","DOIUrl":"https://doi.org/10.1137/22m1497808","url":null,"abstract":"Let and , , be real numbers. We show by an example that the assignment problem begin{align*} max_{sigma in S_n} F_sigma (x,y) := frac 12 sum_{i,k=1}^n |x_i- x_k|^alpha , |y_{sigma (i)}- y_{sigma (k)}|^alpha, quad alpha gt 0, end{align*} is in general neither solved by the identical permutation nor the anti-identical permutation if . Indeed the above maximum can be, depending on the number of points, arbitrarily far away from and . The motivation to deal with such assignment problems came from their relation to Gromov–Wasserstein distances, which have recently received a lot of attention in imaging and shape analysis.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-06-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135903434","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Toward Single Particle Reconstruction without Particle Picking: Breaking the Detection Limit 无粒子拾取的单粒子重构:突破检测极限
3区 数学 Q1 Mathematics Pub Date : 2023-06-07 DOI: 10.1137/22m1503828
Tamir Bendory, Nicolas Boumal, William Leeb, Eitan Levin, Amit Singer
Single-particle cryo-electron microscopy (cryo-EM) has recently joined X-ray crystallography and NMR spectroscopy as a high-resolution structural method to resolve biological macromolecules. In a cryo-EM experiment, the microscope produces images called micrographs. Projections of the molecule of interest are embedded in the micrographs at unknown locations, and under unknown viewing directions. Standard imaging techniques first locate these projections (detection) and then reconstruct the 3-D structure from them. Unfortunately, high noise levels hinder detection. When reliable detection is rendered impossible, the standard techniques fail. This is a problem, especially for small molecules. In this paper, we pursue a radically different approach: we contend that the structure could, in principle, be reconstructed directly from the micrographs, without intermediate detection. The aim is to bring small molecules within reach for cryo-EM. To this end, we design an autocorrelation analysis technique that allows one to go directly from the micrographs to the sought structures. This involves only one pass over the micrographs, allowing online, streaming processing for large experiments. We show numerical results and discuss challenges that lay ahead to turn this proof-of-concept into a complementary approach to state-of-the-art algorithms.
单粒子低温电子显微镜(cryo-EM)最近加入了x射线晶体学和核磁共振波谱学,成为一种高分辨率的结构方法来分析生物大分子。在低温电子显微镜实验中,显微镜产生的图像被称为显微照片。感兴趣的分子的投影嵌入在未知位置的显微照片中,在未知的观察方向下。标准成像技术首先定位这些投影(检测),然后从它们重建三维结构。不幸的是,高噪音水平阻碍了检测。当可靠的检测变得不可能时,标准技术就失效了。这是一个问题,特别是对于小分子。在本文中,我们采用了一种完全不同的方法:我们认为结构原则上可以直接从显微照片中重建,而无需中间检测。其目的是将小分子带入低温电子显微镜的触手可及范围内。为此,我们设计了一种自相关分析技术,允许人们直接从显微照片到所寻找的结构。这只需要通过一次显微照片,就可以对大型实验进行在线流式处理。我们展示了数值结果,并讨论了将这种概念验证转化为最先进算法的补充方法所面临的挑战。
{"title":"Toward Single Particle Reconstruction without Particle Picking: Breaking the Detection Limit","authors":"Tamir Bendory, Nicolas Boumal, William Leeb, Eitan Levin, Amit Singer","doi":"10.1137/22m1503828","DOIUrl":"https://doi.org/10.1137/22m1503828","url":null,"abstract":"Single-particle cryo-electron microscopy (cryo-EM) has recently joined X-ray crystallography and NMR spectroscopy as a high-resolution structural method to resolve biological macromolecules. In a cryo-EM experiment, the microscope produces images called micrographs. Projections of the molecule of interest are embedded in the micrographs at unknown locations, and under unknown viewing directions. Standard imaging techniques first locate these projections (detection) and then reconstruct the 3-D structure from them. Unfortunately, high noise levels hinder detection. When reliable detection is rendered impossible, the standard techniques fail. This is a problem, especially for small molecules. In this paper, we pursue a radically different approach: we contend that the structure could, in principle, be reconstructed directly from the micrographs, without intermediate detection. The aim is to bring small molecules within reach for cryo-EM. To this end, we design an autocorrelation analysis technique that allows one to go directly from the micrographs to the sought structures. This involves only one pass over the micrographs, allowing online, streaming processing for large experiments. We show numerical results and discuss challenges that lay ahead to turn this proof-of-concept into a complementary approach to state-of-the-art algorithms.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135363967","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
On Learning the Invisible in Photoacoustic Tomography with Flat Directionally Sensitive Detector 利用平面定向敏感探测器学习光声层析成像中的不可见性
3区 数学 Q1 Mathematics Pub Date : 2023-05-18 DOI: 10.1137/22m148793x
Bolin Pan, Marta M. Betcke
In photoacoustic tomography (PAT) with a flat sensor, we routinely encounter two types of limited data. The first is due to using a finite sensor and is especially perceptible if the region of interest is large relative to the sensor or located farther away from the sensor. In this paper, we focus on the second type caused by a varying sensitivity of the sensor to the incoming wavefront direction, which can be modelled as binary, i.e., by a cone of sensitivity. Such visibility conditions result, in the Fourier domain, in a restriction of both the image and the data to a bowtie, akin to the one corresponding to the range of the forward operator. The visible wavefrontsets in image and data domains, are related by the wavefront direction mapping. We adapt the wedge restricted curvelet decomposition, we previously proposed for the representation of the full PAT data, to separate the visible and invisible wavefronts in the image. We optimally combine fast approximate operators with tailored deep neural network architectures into efficient learned reconstruction methods which perform reconstruction of the visible coefficients, and the invisible coefficients are learned from a training set of similar data.
在光声层析成像(PAT)与平面传感器,我们经常遇到两种类型的有限数据。首先是由于使用有限传感器,如果感兴趣的区域相对于传感器较大或位于远离传感器的地方,则特别可感知。在本文中,我们关注的是由传感器对入射波前方向的不同灵敏度引起的第二种类型,它可以被建模为二进制,即通过灵敏度锥。在傅里叶域中,这样的可见性条件导致图像和数据都被限制为一个领结,类似于前向运算符范围对应的领结。通过波前方向映射,将图像域和数据域的可见波前集联系起来。我们采用楔形限制曲线分解,我们之前提出的表示完整的PAT数据,分离图像中的可见和不可见波前。我们最优地将快速近似算子与定制的深度神经网络架构结合到有效的学习重建方法中,该方法执行可见系数的重建,而不可见系数则从类似数据的训练集中学习。
{"title":"On Learning the Invisible in Photoacoustic Tomography with Flat Directionally Sensitive Detector","authors":"Bolin Pan, Marta M. Betcke","doi":"10.1137/22m148793x","DOIUrl":"https://doi.org/10.1137/22m148793x","url":null,"abstract":"In photoacoustic tomography (PAT) with a flat sensor, we routinely encounter two types of limited data. The first is due to using a finite sensor and is especially perceptible if the region of interest is large relative to the sensor or located farther away from the sensor. In this paper, we focus on the second type caused by a varying sensitivity of the sensor to the incoming wavefront direction, which can be modelled as binary, i.e., by a cone of sensitivity. Such visibility conditions result, in the Fourier domain, in a restriction of both the image and the data to a bowtie, akin to the one corresponding to the range of the forward operator. The visible wavefrontsets in image and data domains, are related by the wavefront direction mapping. We adapt the wedge restricted curvelet decomposition, we previously proposed for the representation of the full PAT data, to separate the visible and invisible wavefronts in the image. We optimally combine fast approximate operators with tailored deep neural network architectures into efficient learned reconstruction methods which perform reconstruction of the visible coefficients, and the invisible coefficients are learned from a training set of similar data.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135717995","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On the Convergence of Stochastic Gradient Descent for Linear Inverse Problems in Banach Spaces Banach空间中线性逆问题的随机梯度下降收敛性
3区 数学 Q1 Mathematics Pub Date : 2023-05-15 DOI: 10.1137/22m1518542
Bangti Jin, Željko Kereta
In this work we consider stochastic gradient descent (SGD) for solving linear inverse problems in Banach spaces. SGD and its variants have been established as one of the most successful optimization methods in machine learning, imaging, and signal processing, to name a few. At each iteration SGD uses a single datum, or a small subset of data, resulting in highly scalable methods that are very attractive for large-scale inverse problems. Nonetheless, the theoretical analysis of SGD-based approaches for inverse problems has thus far been largely limited to Euclidean and Hilbert spaces. In this work we present a novel convergence analysis of SGD for linear inverse problems in general Banach spaces: we show the almost sure convergence of the iterates to the minimum norm solution and establish the regularizing property for suitable a priori stopping criteria. Numerical results are also presented to illustrate features of the approach.
本文研究了用随机梯度下降法求解Banach空间中的线性逆问题。SGD及其变体已被确立为机器学习、成像和信号处理等领域最成功的优化方法之一。在每次迭代中,SGD使用单个数据,或者数据的一个小子集,从而产生高度可伸缩的方法,这对于大规模的逆问题非常有吸引力。然而,迄今为止,基于sgd的反问题方法的理论分析主要局限于欧几里得和希尔伯特空间。本文给出了一般Banach空间中线性逆问题的SGD的收敛性分析:我们证明了迭代到最小范数解的几乎肯定收敛,并建立了合适的先验停止准则的正则化性质。数值结果说明了该方法的特点。
{"title":"On the Convergence of Stochastic Gradient Descent for Linear Inverse Problems in Banach Spaces","authors":"Bangti Jin, Željko Kereta","doi":"10.1137/22m1518542","DOIUrl":"https://doi.org/10.1137/22m1518542","url":null,"abstract":"In this work we consider stochastic gradient descent (SGD) for solving linear inverse problems in Banach spaces. SGD and its variants have been established as one of the most successful optimization methods in machine learning, imaging, and signal processing, to name a few. At each iteration SGD uses a single datum, or a small subset of data, resulting in highly scalable methods that are very attractive for large-scale inverse problems. Nonetheless, the theoretical analysis of SGD-based approaches for inverse problems has thus far been largely limited to Euclidean and Hilbert spaces. In this work we present a novel convergence analysis of SGD for linear inverse problems in general Banach spaces: we show the almost sure convergence of the iterates to the minimum norm solution and establish the regularizing property for suitable a priori stopping criteria. Numerical results are also presented to illustrate features of the approach.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134959861","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Elastica Models for Color Image Regularization 彩色图像正则化的弹性模型
3区 数学 Q1 Mathematics Pub Date : 2023-03-30 DOI: 10.1137/22m147935x
Hao Liu, Xue-Cheng Tai, Ron Kimmel, Roland Glowinski
The choice of a proper regularization measure plays an important role in the field of image processing. One classical approach treats color images as two- dimensional surfaces embedded in a five-dimensional spatial-chromatic space. In this case, a natural regularization term arises as the image surface area. Choosing the chromatic coordinates as dominating over the spatial ones, we can think of the image spatial coordinates could as a parameterization of the image surface manifold in a three-dimensional color space. Minimizing the area of the image manifold leads to the Beltrami flow or mean curvature flow of the image surface in the three-dimensional color space, while minimizing the elastica of the image surface yields an additional interesting regularization. Recently, we proposed a color elastica model, which minimizes both the surface area and the elastica of the image manifold. In this paper, we propose to modify the color elastica and introduce two new models for color image regularization. The revised measures are motivated by the relations between the color elastica model, Euler’s elastica model, and the total variation model for gray level images. Compared to our previous color elastica model, the new models are direct extensions of Euler’s elastica model to color images. The proposed models are nonlinear and challenging to minimize. To overcome this difficulty, two operator-splitting methods are suggested. Specifically, nonlinearities are decoupled by the introduction of new vector- and matrix-valued variables. Then, the minimization problems are converted to initial value problems which are time-discretized by operator splitting. Each subproblem, after splitting, either has a closed-form solution or can be solved efficiently. The effectiveness and advantages of the proposed models are demonstrated by comprehensive experiments. The benefits of incorporating the elastica of the image surface as regularization terms compared to common alternatives are empirically validated.
选择合适的正则化测度在图像处理领域中起着重要的作用。一种经典的方法将彩色图像视为嵌入在五维空间色彩空间中的二维表面。在这种情况下,自然正则化项作为图像表面积出现。选择色坐标占主导地位而不是空间坐标,我们可以认为图像空间坐标可以作为图像表面流形在三维色彩空间中的参数化。最小化图像流形的面积会导致图像表面在三维色彩空间中的贝尔特拉米流或平均曲率流,而最小化图像表面的弹性会产生额外的有趣的正则化。最近,我们提出了一种颜色弹性模型,该模型可以最小化图像流形的表面积和弹性。本文对彩色图像正则化模型进行了改进,提出了两种新的彩色图像正则化模型。基于灰度图像的颜色弹性模型、欧拉弹性模型和总变分模型之间的关系,提出了改进的度量方法。与我们之前的彩色弹性模型相比,新模型是欧拉弹性模型对彩色图像的直接扩展。所提出的模型是非线性的,很难最小化。为了克服这一困难,提出了两种算子分割方法。具体地说,非线性是通过引入新的向量和矩阵值变量来解耦的。然后,将最小化问题转化为初始值问题,并通过算子分裂进行时间离散。每个子问题在分裂后,要么具有封闭解,要么能够有效地求解。综合实验证明了所提模型的有效性和优越性。与常见的替代方案相比,将图像表面的弹性作为正则化项的好处得到了经验验证。
{"title":"Elastica Models for Color Image Regularization","authors":"Hao Liu, Xue-Cheng Tai, Ron Kimmel, Roland Glowinski","doi":"10.1137/22m147935x","DOIUrl":"https://doi.org/10.1137/22m147935x","url":null,"abstract":"The choice of a proper regularization measure plays an important role in the field of image processing. One classical approach treats color images as two- dimensional surfaces embedded in a five-dimensional spatial-chromatic space. In this case, a natural regularization term arises as the image surface area. Choosing the chromatic coordinates as dominating over the spatial ones, we can think of the image spatial coordinates could as a parameterization of the image surface manifold in a three-dimensional color space. Minimizing the area of the image manifold leads to the Beltrami flow or mean curvature flow of the image surface in the three-dimensional color space, while minimizing the elastica of the image surface yields an additional interesting regularization. Recently, we proposed a color elastica model, which minimizes both the surface area and the elastica of the image manifold. In this paper, we propose to modify the color elastica and introduce two new models for color image regularization. The revised measures are motivated by the relations between the color elastica model, Euler’s elastica model, and the total variation model for gray level images. Compared to our previous color elastica model, the new models are direct extensions of Euler’s elastica model to color images. The proposed models are nonlinear and challenging to minimize. To overcome this difficulty, two operator-splitting methods are suggested. Specifically, nonlinearities are decoupled by the introduction of new vector- and matrix-valued variables. Then, the minimization problems are converted to initial value problems which are time-discretized by operator splitting. Each subproblem, after splitting, either has a closed-form solution or can be solved efficiently. The effectiveness and advantages of the proposed models are demonstrated by comprehensive experiments. The benefits of incorporating the elastica of the image surface as regularization terms compared to common alternatives are empirically validated.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136265878","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Nonlocal Graph-PDE and Higher-Order Geometric Integration for Image Labeling 图像标注的非局部图pde和高阶几何积分
3区 数学 Q1 Mathematics Pub Date : 2023-03-30 DOI: 10.1137/22m1496141
Dmitrij Sitenko, Bastian Boll, Christoph Schnörr
This paper introduces a novel nonlocal partial difference equation (G-PDE) for labeling metric data on graphs. The G-PDE is derived as a nonlocal reparametrization of the assignment flow approach that was introduced in [J. Math. Imaging Vision, 58 (2017), pp. 211–238]. Due to this parameterization, solving the G-PDE numerically is shown to be equivalent to computing the Riemannian gradient flow with respect to a nonconvex potential. We devise an entropy-regularized difference of convex (DC) functions decomposition of this potential and show that the basic geometric Euler scheme for integrating the assignment flow is equivalent to solving the G-PDE by an established DC programming scheme. Moreover, the viewpoint of geometric integration reveals a basic way to exploit higher-order information of the vector field that drives the assignment flow, in order to devise a novel accelerated DC programming scheme. A detailed convergence analysis of both numerical schemes is provided and illustrated by numerical experiments.
本文提出了一种新的非局部偏差分方程(G-PDE),用于标记图上度量数据。G-PDE是在文献[J]中引入的分配流方法的非局部再参数化。数学。影像视觉,58 (2017),pp. 211-238。由于这种参数化,数值求解G-PDE被证明等同于计算关于非凸势的黎曼梯度流。我们设计了一种熵正则化的凸差分(DC)函数分解,并证明了积分分配流的基本几何欧拉格式等价于用已建立的DC规划格式求解G-PDE。此外,几何积分的观点揭示了利用驱动分配流的矢量场的高阶信息来设计一种新的加速直流规划方案的基本方法。对两种格式进行了详细的收敛性分析,并通过数值实验加以说明。
{"title":"A Nonlocal Graph-PDE and Higher-Order Geometric Integration for Image Labeling","authors":"Dmitrij Sitenko, Bastian Boll, Christoph Schnörr","doi":"10.1137/22m1496141","DOIUrl":"https://doi.org/10.1137/22m1496141","url":null,"abstract":"This paper introduces a novel nonlocal partial difference equation (G-PDE) for labeling metric data on graphs. The G-PDE is derived as a nonlocal reparametrization of the assignment flow approach that was introduced in [J. Math. Imaging Vision, 58 (2017), pp. 211–238]. Due to this parameterization, solving the G-PDE numerically is shown to be equivalent to computing the Riemannian gradient flow with respect to a nonconvex potential. We devise an entropy-regularized difference of convex (DC) functions decomposition of this potential and show that the basic geometric Euler scheme for integrating the assignment flow is equivalent to solving the G-PDE by an established DC programming scheme. Moreover, the viewpoint of geometric integration reveals a basic way to exploit higher-order information of the vector field that drives the assignment flow, in order to devise a novel accelerated DC programming scheme. A detailed convergence analysis of both numerical schemes is provided and illustrated by numerical experiments.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136001736","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A Projected Nesterov–Kaczmarz Approach to Stellar Population-Kinematic Distribution Reconstruction in Extragalactic Archaeology 基于Nesterov-Kaczmarz方法的河外考古中恒星人口运动分布重建
3区 数学 Q1 Mathematics Pub Date : 2023-02-07 DOI: 10.1137/22m1503002
Fabian Hinterer, Simon Hubmer, Prashin Jethwa, Kirk M. Soodhalter, Glenn van de Ven, Ronny Ramlau
In this paper, we consider the problem of reconstructing a galaxy’s stellar population-kinematic distribution function from optical integral field unit measurements. These quantities are connected via a high-dimensional integral equation. To solve this problem, we propose a projected Nesterov–Kaczmarz reconstruction method, which efficiently leverages the problem structure and incorporates physical prior information such as smoothness and nonnegativity constraints. To test the performance of our reconstruction approach, we apply it to a dataset simulated from a known ground truth density, and validate it by comparing our recoveries to those obtained by the widely used pPXF software.
本文考虑从光学积分场单位测量中重建星系恒星群-运动分布函数的问题。这些量通过一个高维积分方程联系起来。为了解决这一问题,我们提出了一种投影Nesterov-Kaczmarz重建方法,该方法有效地利用了问题的结构,并结合了平滑性和非负性约束等物理先验信息。为了测试我们的重建方法的性能,我们将其应用于已知地面真值密度模拟的数据集,并通过将我们的恢复与广泛使用的pPXF软件获得的恢复进行比较来验证它。
{"title":"A Projected Nesterov–Kaczmarz Approach to Stellar Population-Kinematic Distribution Reconstruction in Extragalactic Archaeology","authors":"Fabian Hinterer, Simon Hubmer, Prashin Jethwa, Kirk M. Soodhalter, Glenn van de Ven, Ronny Ramlau","doi":"10.1137/22m1503002","DOIUrl":"https://doi.org/10.1137/22m1503002","url":null,"abstract":"In this paper, we consider the problem of reconstructing a galaxy’s stellar population-kinematic distribution function from optical integral field unit measurements. These quantities are connected via a high-dimensional integral equation. To solve this problem, we propose a projected Nesterov–Kaczmarz reconstruction method, which efficiently leverages the problem structure and incorporates physical prior information such as smoothness and nonnegativity constraints. To test the performance of our reconstruction approach, we apply it to a dataset simulated from a known ground truth density, and validate it by comparing our recoveries to those obtained by the widely used pPXF software.","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136181814","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
SIAM Journal on Imaging Sciences
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1