首页 > 最新文献

GAMM Mitteilungen最新文献

英文 中文
Classification and image processing with a semi-discrete scheme for fidelity forced Allen–Cahn on graphs 基于半离散保真度强制Allen-Cahn图的分类和图像处理
Q1 Mathematics Pub Date : 2021-03-17 DOI: 10.1002/gamm.202100004
Jeremy Budd, Yves van Gennip, Jonas Latz

This paper introduces a semi-discrete implicit Euler (SDIE) scheme for the Allen-Cahn equation (ACE) with fidelity forcing on graphs. The continuous-in-time version of this differential equation was pioneered by Bertozzi and Flenner in 2012 as a method for graph classification problems, such as semi-supervised learning and image segmentation. In 2013, Merkurjev et. al. used a Merriman-Bence-Osher (MBO) scheme with fidelity forcing instead, as heuristically it was expected to give similar results to the ACE. The current paper rigorously establishes the graph MBO scheme with fidelity forcing as a special case of an SDIE scheme for the graph ACE with fidelity forcing. This connection requires the use of the double-obstacle potential in the ACE, as was already demonstrated by Budd and Van Gennip in 2020 in the context of ACE without a fidelity forcing term. We also prove that solutions of the SDIE scheme converge to solutions of the graph ACE with fidelity forcing as the discrete time step converges to zero. In the second part of the paper we develop the SDIE scheme as a classification algorithm. We also introduce some innovations into the algorithms for the SDIE and MBO schemes. For large graphs, we use a QR decomposition method to compute an eigendecomposition from a Nyström extension, which outperforms the method used by, for example, Bertozzi and Flenner in 2012, in accuracy, stability, and speed. Moreover, we replace the Euler discretization for the scheme's diffusion step by a computation based on the Strang formula for matrix exponentials. We apply this algorithm to a number of image segmentation problems, and compare the performance with that of the graph MBO scheme with fidelity forcing. We find that while the general SDIE scheme does not perform better than the MBO special case at this task, our other innovations lead to a significantly better segmentation than that from previous literature. We also empirically quantify the uncertainty that this segmentation inherits from the randomness in the Nyström extension.

本文介绍了图上具有保真强迫的Allen-Cahn方程的一种半离散隐式欧拉格式。该微分方程的连续时间版本由Bertozzi和Flenner于2012年首创,用于半监督学习和图像分割等图分类问题的方法。2013年,Merkurjev等人使用了具有保真度强制的Merriman-Bence-Osher (MBO)方案,因为启发式地期望得到与ACE相似的结果。本文严格地建立了具有保真强迫的图MBO格式,作为具有保真强迫的图ACE的SDIE格式的一个特例。这种联系需要在ACE中使用双障碍电位,正如Budd和Van Gennip在2020年在没有保真强迫条件的ACE背景下已经证明的那样。我们还证明了当离散时间步长收敛于零时,SDIE格式的解收敛于具有保真强迫的图ACE的解。在论文的第二部分,我们开发了SDIE方案作为一种分类算法。我们还介绍了SDIE和MBO算法的一些创新。对于大型图,我们使用QR分解方法从Nyström扩展计算特征分解,该方法在准确性,稳定性和速度方面优于Bertozzi和Flenner在2012年使用的方法。此外,我们用基于矩阵指数的奇异公式的计算来代替方案扩散步骤的欧拉离散化。我们将该算法应用于许多图像分割问题,并与具有保真度强制的图MBO方案的性能进行了比较。我们发现,虽然一般的SDIE方案在这项任务中的表现并不比MBO特殊情况好,但我们的其他创新导致了比以前文献更好的分割。我们还根据经验量化了这种分割从Nyström扩展中的随机性继承的不确定性。
{"title":"Classification and image processing with a semi-discrete scheme for fidelity forced Allen–Cahn on graphs","authors":"Jeremy Budd,&nbsp;Yves van Gennip,&nbsp;Jonas Latz","doi":"10.1002/gamm.202100004","DOIUrl":"10.1002/gamm.202100004","url":null,"abstract":"<p>This paper introduces a semi-discrete implicit Euler (SDIE) scheme for the Allen-Cahn equation (ACE) with fidelity forcing on graphs. The continuous-in-time version of this differential equation was pioneered by Bertozzi and Flenner in 2012 as a method for graph classification problems, such as semi-supervised learning and image segmentation. In 2013, Merkurjev et. al. used a Merriman-Bence-Osher (MBO) scheme with fidelity forcing instead, as heuristically it was expected to give similar results to the ACE. The current paper rigorously establishes the graph MBO scheme with fidelity forcing as a special case of an SDIE scheme for the graph ACE with fidelity forcing. This connection requires the use of the double-obstacle potential in the ACE, as was already demonstrated by Budd and Van Gennip in 2020 in the context of ACE without a fidelity forcing term. We also prove that solutions of the SDIE scheme converge to solutions of the graph ACE with fidelity forcing as the discrete time step converges to zero. In the second part of the paper we develop the SDIE scheme as a classification algorithm. We also introduce some innovations into the algorithms for the SDIE and MBO schemes. For large graphs, we use a QR decomposition method to compute an eigendecomposition from a Nyström extension, which outperforms the method used by, for example, Bertozzi and Flenner in 2012, in accuracy, stability, and speed. Moreover, we replace the Euler discretization for the scheme's diffusion step by a computation based on the Strang formula for matrix exponentials. We apply this algorithm to a number of image segmentation problems, and compare the performance with that of the graph MBO scheme with fidelity forcing. We find that while the general SDIE scheme does not perform better than the MBO special case at this task, our other innovations lead to a significantly better segmentation than that from previous literature. We also empirically quantify the uncertainty that this segmentation inherits from the randomness in the Nyström extension.</p>","PeriodicalId":53634,"journal":{"name":"GAMM Mitteilungen","volume":"44 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1002/gamm.202100004","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90961049","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
Topical Issue Scientific Machine Learning (1/2) 科学机器学习(1/2)
Q1 Mathematics Pub Date : 2021-03-17 DOI: 10.1002/gamm.202100005
Peter Benner, Axel Klawonn, Martin Stoll
Scientific Machine Learning is a rapidly evolving field of research that combines and further develops techniques of scientific computing and machine learning. Special emphasis is given to the scientific (physical, chemical, biological, etc.) interpretability of models learned from data and their usefulness for robust predictions. On the other hand, this young field also investigates the utilization of Machine Learning methods for improving numerical algorithms in Scientific Computing. The name Scientific Machine Learning has been coined at a Basic Research Needs Workshop of the US Department of Energy (DOE) in January, 2018. It resulted in a report [2] published in February, 2019; see also [1] for a short brochure on this topic. The present special issue of the GAMM Mitteilungen, which is the first of a two-part series, contains contributions on the topic of Scientific Machine Learning in the context of complex applications across the sciences and engineering. Research in this new exciting field needs to address challenges such as complex physics, uncertain parameters, and possibly limited data through the development of new methods that combine algorithms from computational science and engineering and from numerical analysis with state of the art techniques from machine learning. At the GAMM Annual Meeting 2019, the activity group Computational and Mathematical Methods in Data Science (CoMinDS) has been established. Meanwhile, it has become a meeting place for researchers interested in all aspects of data science. All three editors of this special issue are founding members of this activity group. Because of the rapid development both in the theoretical foundations and the applicability of Scientific Machine Learning techniques, it is time to highlight developments within the field in the hope that it will become an essential domain within the GAMM and topical issues like this will have a frequent occurrence within this journal. We are happy that eight teams of authors have accepted our invitation to report on recent research highlights in Scientific Machine Learning, and to point out the relevant literature as well as software. The four papers in this first part of the special issue are: • Stoll, Benner: Machine Learning for Material Characterization with an Application for Predicting Mechanical Properties. This work explores the use of machine learning techniques for material property prediction. Given the abundance of data available in industrial applications, machine learning methods can help finding patterns in the data and the authors focus on the case of the small punch test and tensile data for illustration purposes. • Beck, Kurz: A Perspective on Machine Modelling Learning Methods in Turbulence. Turbulence modelling remains a humongous challenge in the simulation and analysis of complex flows. The authors review the use of data-driven techniques to open up new ways for studying turbulence and focus on the challenges and opportunities t
{"title":"Topical Issue Scientific Machine Learning (1/2)","authors":"Peter Benner,&nbsp;Axel Klawonn,&nbsp;Martin Stoll","doi":"10.1002/gamm.202100005","DOIUrl":"10.1002/gamm.202100005","url":null,"abstract":"Scientific Machine Learning is a rapidly evolving field of research that combines and further develops techniques of scientific computing and machine learning. Special emphasis is given to the scientific (physical, chemical, biological, etc.) interpretability of models learned from data and their usefulness for robust predictions. On the other hand, this young field also investigates the utilization of Machine Learning methods for improving numerical algorithms in Scientific Computing. The name Scientific Machine Learning has been coined at a Basic Research Needs Workshop of the US Department of Energy (DOE) in January, 2018. It resulted in a report [2] published in February, 2019; see also [1] for a short brochure on this topic. The present special issue of the GAMM Mitteilungen, which is the first of a two-part series, contains contributions on the topic of Scientific Machine Learning in the context of complex applications across the sciences and engineering. Research in this new exciting field needs to address challenges such as complex physics, uncertain parameters, and possibly limited data through the development of new methods that combine algorithms from computational science and engineering and from numerical analysis with state of the art techniques from machine learning. At the GAMM Annual Meeting 2019, the activity group Computational and Mathematical Methods in Data Science (CoMinDS) has been established. Meanwhile, it has become a meeting place for researchers interested in all aspects of data science. All three editors of this special issue are founding members of this activity group. Because of the rapid development both in the theoretical foundations and the applicability of Scientific Machine Learning techniques, it is time to highlight developments within the field in the hope that it will become an essential domain within the GAMM and topical issues like this will have a frequent occurrence within this journal. We are happy that eight teams of authors have accepted our invitation to report on recent research highlights in Scientific Machine Learning, and to point out the relevant literature as well as software. The four papers in this first part of the special issue are: • Stoll, Benner: Machine Learning for Material Characterization with an Application for Predicting Mechanical Properties. This work explores the use of machine learning techniques for material property prediction. Given the abundance of data available in industrial applications, machine learning methods can help finding patterns in the data and the authors focus on the case of the small punch test and tensile data for illustration purposes. • Beck, Kurz: A Perspective on Machine Modelling Learning Methods in Turbulence. Turbulence modelling remains a humongous challenge in the simulation and analysis of complex flows. The authors review the use of data-driven techniques to open up new ways for studying turbulence and focus on the challenges and opportunities t","PeriodicalId":53634,"journal":{"name":"GAMM Mitteilungen","volume":"44 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1002/gamm.202100005","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78463089","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Combining machine learning and domain decomposition methods for the solution of partial differential equations—A review 结合机器学习和区域分解方法求解偏微分方程综述
Q1 Mathematics Pub Date : 2021-03-17 DOI: 10.1002/gamm.202100001
Alexander Heinlein, Axel Klawonn, Martin Lanser, Janine Weber

Scientific machine learning (SciML), an area of research where techniques from machine learning and scientific computing are combined, has become of increasing importance and receives growing attention. Here, our focus is on a very specific area within SciML given by the combination of domain decomposition methods (DDMs) with machine learning techniques for the solution of partial differential equations. The aim of the present work is to make an attempt of providing a review of existing and also new approaches within this field as well as to present some known results in a unified framework; no claim of completeness is made. As a concrete example of machine learning enhanced DDMs, an approach is presented which uses neural networks to reduce the computational effort in adaptive DDMs while retaining their robustness. More precisely, deep neural networks are used to predict the geometric location of constraints which are needed to define a robust coarse space. Additionally, two recently published deep domain decomposition approaches are presented in a unified framework. Both approaches use physics-constrained neural networks to replace the discretization and solution of the subdomain problems of a given decomposition of the computational domain. Finally, a brief overview is given of several further approaches which combine machine learning with ideas from DDMs to either increase the performance of already existing algorithms or to create completely new methods.

科学机器学习(SciML)是机器学习和科学计算技术相结合的一个研究领域,已经变得越来越重要并受到越来越多的关注。在这里,我们的重点是在SciML中一个非常具体的领域,该领域是由域分解方法(DDMs)和求解偏微分方程的机器学习技术相结合给出的。本工作的目的是试图审查这一领域内现有的和新的办法,并在一个统一的框架内提出一些已知的结果;没有提出完整性的要求。作为机器学习增强ddm的一个具体例子,提出了一种使用神经网络减少自适应ddm的计算工作量同时保持其鲁棒性的方法。更准确地说,深度神经网络用于预测约束的几何位置,这些约束需要定义一个鲁棒的粗空间。此外,在统一的框架中介绍了最近发表的两种深度域分解方法。这两种方法都使用物理约束的神经网络来代替计算域给定分解的子域问题的离散化和求解。最后,简要概述了几种进一步的方法,这些方法将机器学习与ddm的思想相结合,以提高现有算法的性能或创建全新的方法。
{"title":"Combining machine learning and domain decomposition methods for the solution of partial differential equations—A review","authors":"Alexander Heinlein,&nbsp;Axel Klawonn,&nbsp;Martin Lanser,&nbsp;Janine Weber","doi":"10.1002/gamm.202100001","DOIUrl":"10.1002/gamm.202100001","url":null,"abstract":"<p>Scientific machine learning (SciML), an area of research where techniques from machine learning and scientific computing are combined, has become of increasing importance and receives growing attention. Here, our focus is on a very specific area within SciML given by the combination of domain decomposition methods (DDMs) with machine learning techniques for the solution of partial differential equations. The aim of the present work is to make an attempt of providing a review of existing and also new approaches within this field as well as to present some known results in a unified framework; no claim of completeness is made. As a concrete example of machine learning enhanced DDMs, an approach is presented which uses neural networks to reduce the computational effort in adaptive DDMs while retaining their robustness. More precisely, deep neural networks are used to predict the geometric location of constraints which are needed to define a robust coarse space. Additionally, two recently published deep domain decomposition approaches are presented in a unified framework. Both approaches use physics-constrained neural networks to replace the discretization and solution of the subdomain problems of a given decomposition of the computational domain. Finally, a brief overview is given of several further approaches which combine machine learning with ideas from DDMs to either increase the performance of already existing algorithms or to create completely new methods.</p>","PeriodicalId":53634,"journal":{"name":"GAMM Mitteilungen","volume":"44 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1002/gamm.202100001","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89787405","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 35
A perspective on machine learning methods in turbulence modeling 湍流建模中机器学习方法的展望
Q1 Mathematics Pub Date : 2021-03-04 DOI: 10.1002/gamm.202100002
Andrea Beck, Marius Kurz

This work presents a review of the current state of research in data-driven turbulence closure modeling. It offers a perspective on the challenges and open issues but also on the advantages and promises of machine learning (ML) methods applied to parameter estimation, model identification, closure term reconstruction, and beyond, mostly from the perspective of large Eddy simulation and related techniques. We stress that consistency of the training data, the model, the underlying physics, and the discretization is a key issue that needs to be considered for a successful ML-augmented modeling strategy. In order to make the discussion useful for non-experts in either field, we introduce both the modeling problem in turbulence as well as the prominent ML paradigms and methods in a concise and self-consistent manner. In this study, we present a survey of the current data-driven model concepts and methods, highlight important developments, and put them into the context of the discussed challenges.

本文综述了数据驱动湍流闭合建模的研究现状。它提供了一个关于挑战和开放问题的观点,但也提供了机器学习(ML)方法应用于参数估计、模型识别、闭项重建等方面的优势和前景,主要是从大涡模拟和相关技术的角度出发。我们强调训练数据、模型、底层物理和离散化的一致性是一个成功的ml增强建模策略需要考虑的关键问题。为了使讨论对任何一个领域的非专家都有用,我们以简洁和自一致的方式介绍了湍流中的建模问题以及突出的ML范式和方法。在本研究中,我们对当前数据驱动模型的概念和方法进行了调查,强调了重要的发展,并将它们置于所讨论的挑战的背景下。
{"title":"A perspective on machine learning methods in turbulence modeling","authors":"Andrea Beck,&nbsp;Marius Kurz","doi":"10.1002/gamm.202100002","DOIUrl":"10.1002/gamm.202100002","url":null,"abstract":"<p>This work presents a review of the current state of research in data-driven turbulence closure modeling. It offers a perspective on the challenges and open issues but also on the advantages and promises of machine learning (ML) methods applied to parameter estimation, model identification, closure term reconstruction, and beyond, mostly from the perspective of large Eddy simulation and related techniques. We stress that consistency of the training data, the model, the underlying physics, and the discretization is a key issue that needs to be considered for a successful ML-augmented modeling strategy. In order to make the discussion useful for non-experts in either field, we introduce both the modeling problem in turbulence as well as the prominent ML paradigms and methods in a concise and self-consistent manner. In this study, we present a survey of the current data-driven model concepts and methods, highlight important developments, and put them into the context of the discussed challenges.</p>","PeriodicalId":53634,"journal":{"name":"GAMM Mitteilungen","volume":"44 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1002/gamm.202100002","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76272585","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 51
Machine learning for material characterization with an application for predicting mechanical properties 材料表征的机器学习及其预测机械性能的应用
Q1 Mathematics Pub Date : 2021-03-04 DOI: 10.1002/gamm.202100003
Anke Stoll, Peter Benner

Currently, the growth of material data from experiments and simulations is expanding beyond processable amounts. This makes the development of new data-driven methods for the discovery of patterns among multiple lengthscales and time-scales and structure-property relationships essential. These data-driven approaches show enormous promise within materials science. The following review covers machine learning (ML) applications for metallic material characterization. Many parameters associated with the processing and the structure of materials affect the properties and the performance of manufactured components. Thus, this study is an attempt to investigate the usefulness of ML methods for material property prediction. Material characteristics such as strength, toughness, hardness, brittleness, or ductility are relevant to categorize a material or component according to their quality. In industry, material tests like tensile tests, compression tests, or creep tests are often time consuming and expensive to perform. Therefore, the application of ML approaches is considered helpful for an easier generation of material property information. This study also gives an application of ML methods on small punch test (SPT) data for the determination of the property ultimate tensile strength for various materials. A strong correlation between SPT data and tensile test data was found which ultimately allows to replace more costly tests by simple and fast tests in combination with ML.

目前,来自实验和模拟的材料数据的增长超出了可处理的数量。这使得开发新的数据驱动方法来发现多个长度尺度和时间尺度以及结构-属性关系之间的模式至关重要。这些数据驱动的方法在材料科学中显示出巨大的前景。下面回顾了机器学习(ML)在金属材料表征中的应用。与材料的加工和结构有关的许多参数影响制造部件的性能和性能。因此,本研究试图探讨机器学习方法对材料性能预测的有用性。材料的特性,如强度、韧性、硬度、脆性或延展性,与根据质量对材料或部件进行分类有关。在工业中,拉伸试验、压缩试验或蠕变试验等材料试验通常既耗时又昂贵。因此,ML方法的应用被认为有助于更容易地生成材料属性信息。本研究还给出了ML方法在小冲孔试验(SPT)数据上的应用,以确定各种材料的性能极限拉伸强度。发现SPT数据和拉伸试验数据之间存在很强的相关性,这最终允许通过结合ML的简单快速试验取代更昂贵的试验。
{"title":"Machine learning for material characterization with an application for predicting mechanical properties","authors":"Anke Stoll,&nbsp;Peter Benner","doi":"10.1002/gamm.202100003","DOIUrl":"10.1002/gamm.202100003","url":null,"abstract":"<p>Currently, the growth of material data from experiments and simulations is expanding beyond processable amounts. This makes the development of new data-driven methods for the discovery of patterns among multiple lengthscales and time-scales and structure-property relationships essential. These data-driven approaches show enormous promise within materials science. The following review covers machine learning (ML) applications for metallic material characterization. Many parameters associated with the processing and the structure of materials affect the properties and the performance of manufactured components. Thus, this study is an attempt to investigate the usefulness of ML methods for material property prediction. Material characteristics such as strength, toughness, hardness, brittleness, or ductility are relevant to categorize a material or component according to their quality. In industry, material tests like tensile tests, compression tests, or creep tests are often time consuming and expensive to perform. Therefore, the application of ML approaches is considered helpful for an easier generation of material property information. This study also gives an application of ML methods on small punch test (SPT) data for the determination of the property ultimate tensile strength for various materials. A strong correlation between SPT data and tensile test data was found which ultimately allows to replace more costly tests by simple and fast tests in combination with ML.</p>","PeriodicalId":53634,"journal":{"name":"GAMM Mitteilungen","volume":"44 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1002/gamm.202100003","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74302427","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 28
Topical Issue Applied and Numerical Linear Algebra (2/2) 应用与数值线性代数(2/2)
Q1 Mathematics Pub Date : 2020-11-03 DOI: 10.1002/gamm.202000021
Stefan Güttel, Jörg Liesen

The present special issue of the GAMM Mitteilungen, which is the second of a two-part series, contains contributions on the topic of Applied and Numerical Linear Algebra, compiled by the GAMM Activity Group of the same name. The Activity Group has already contributed special issues to the GAMM Mitteilungen in 2004, 2006, and 2013. Because of the rapid development both in the theoretical foundations and the applicability of numerical linear algebra techniques throughout science and engineering, it is time again to survey the field and present the results to the readers of the GAMM Mitteilungen. We are happy that eight authors or teams of authors have accepted our invitation to report on recent research highlights in Applied Numerical Linear Algebra, and to point out the relevant literature as well as software.

This work by Federico Poloni reviews a family of algorithms for Lyapunov- and Riccati-type equations which are all related by the idea of doubling. The algorithms are compared and their connections are highlighted. The paper also discusses open problems relating to their theory.

目前的GAMM Mitteilungen特刊是两部分系列的第二部分,包含了由同名GAMM活动小组编写的关于应用和数值线性代数主题的贡献。活动小组已经在2004年、2006年和2013年为GAMM Mitteilungen提供了特刊。由于数值线性代数技术在整个科学和工程领域的理论基础和适用性的迅速发展,现在是时候再次调查该领域并将结果呈现给GAMM Mitteilungen的读者。我们很高兴有8位作者或作者团队接受了我们的邀请,报告了应用数值线性代数的最新研究亮点,并指出了相关的文献和软件。Federico Poloni的这项工作回顾了李雅普诺夫和里卡蒂型方程的一系列算法,这些算法都与加倍的思想有关。对这些算法进行了比较,并突出了它们之间的联系。本文还讨论了与他们的理论有关的开放性问题。
{"title":"Topical Issue Applied and Numerical Linear Algebra (2/2)","authors":"Stefan Güttel,&nbsp;Jörg Liesen","doi":"10.1002/gamm.202000021","DOIUrl":"10.1002/gamm.202000021","url":null,"abstract":"<p>The present special issue of the GAMM Mitteilungen, which is the second of a two-part series, contains contributions on the topic of Applied and Numerical Linear Algebra, compiled by the GAMM Activity Group of the same name. The Activity Group has already contributed special issues to the GAMM Mitteilungen in 2004, 2006, and 2013. Because of the rapid development both in the theoretical foundations and the applicability of numerical linear algebra techniques throughout science and engineering, it is time again to survey the field and present the results to the readers of the GAMM Mitteilungen. We are happy that eight authors or teams of authors have accepted our invitation to report on recent research highlights in Applied Numerical Linear Algebra, and to point out the relevant literature as well as software.</p><p>This work by Federico Poloni reviews a family of algorithms for Lyapunov- and Riccati-type equations which are all related by the idea of doubling. The algorithms are compared and their connections are highlighted. The paper also discusses open problems relating to their theory.</p>","PeriodicalId":53634,"journal":{"name":"GAMM Mitteilungen","volume":"43 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1002/gamm.202000021","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76920951","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Preconditioners for Krylov subspace methods: An overview Krylov子空间方法的前置条件:概述
Q1 Mathematics Pub Date : 2020-10-21 DOI: 10.1002/gamm.202000015
John W. Pearson, Jennifer Pestana

When simulating a mechanism from science or engineering, or an industrial process, one is frequently required to construct a mathematical model, and then resolve this model numerically. If accurate numerical solutions are necessary or desirable, this can involve solving large-scale systems of equations. One major class of solution methods is that of preconditioned iterative methods, involving preconditioners which are computationally cheap to apply while also capturing information contained in the linear system. In this article, we give a short survey of the field of preconditioning. We introduce a range of preconditioners for partial differential equations, followed by optimization problems, before discussing preconditioners constructed with less standard objectives in mind.

在模拟科学、工程或工业过程中的机制时,经常需要构建数学模型,然后用数值方法求解该模型。如果精确的数值解是必要的或需要的,这可能涉及求解大型方程组。一类主要的解决方法是预条件迭代方法,它涉及的预条件在计算上很便宜,同时也可以捕获线性系统中包含的信息。在本文中,我们对预处理领域进行了简要的综述。我们介绍了偏微分方程的一系列预条件,然后讨论了优化问题,然后讨论了不太标准目标构造的预条件。
{"title":"Preconditioners for Krylov subspace methods: An overview","authors":"John W. Pearson,&nbsp;Jennifer Pestana","doi":"10.1002/gamm.202000015","DOIUrl":"10.1002/gamm.202000015","url":null,"abstract":"<p>When simulating a mechanism from science or engineering, or an industrial process, one is frequently required to construct a mathematical model, and then resolve this model numerically. If accurate numerical solutions are necessary or desirable, this can involve solving large-scale systems of equations. One major class of solution methods is that of preconditioned iterative methods, involving preconditioners which are computationally cheap to apply while also capturing information contained in the linear system. In this article, we give a short survey of the field of preconditioning. We introduce a range of preconditioners for partial differential equations, followed by optimization problems, before discussing preconditioners constructed with less standard objectives in mind.</p>","PeriodicalId":53634,"journal":{"name":"GAMM Mitteilungen","volume":"43 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1002/gamm.202000015","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73816556","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 22
Iterative and doubling algorithms for Riccati-type matrix equations: A comparative introduction riccti型矩阵方程的迭代和加倍算法:比较介绍
Q1 Mathematics Pub Date : 2020-10-08 DOI: 10.1002/gamm.202000018
Federico Poloni

We review a family of algorithms for Lyapunov- and Riccati-type equations which are all related to each other by the idea of doubling: they construct the iterate Qk=X2k of another naturally-arising fixed-point iteration (Xh) via a sort of repeated squaring. The equations we consider are Stein equations X − A X A = Q, Lyapunov equations A X + X A + Q = 0, discrete-time algebraic Riccati equations X = Q + A X(I + G X)−1A, continuous-time algebraic Riccati equations Q + A X + X A − X G X = 0, palindromic quadratic matrix equations A + Q Y + AY2 = 0, and nonlinear matrix equations X + A X−1A = Q. We draw comparisons among these algorithms, highlight the connections between them and to other algorithms such as subspace iteration, and discuss open issues in their theory.

我们回顾了李雅普诺夫和里卡蒂型方程的一系列算法,它们都是通过加倍的思想相互关联的:它们构造迭代Q k = X 2k另一个自然产生的不动点迭代(Xh)通过一种重复平方。我们考虑的方程是Stein方程X−A∗X A = Q, Lyapunov方程A * X + X A + Q = 0,离散时间代数Riccati方程X = Q + A∗X(I + G X)−1A,连续时间代数Riccati方程Q + A∗X + X A−X G X = 0,回文二次矩阵方程A + Q Y + A∗Y2 = 0,以及非线性矩阵方程X + A∗X−1A = Q。我们对这些算法进行了比较,强调了它们与其他算法(如子空间迭代)之间的联系,并讨论了它们理论中的开放问题。
{"title":"Iterative and doubling algorithms for Riccati-type matrix equations: A comparative introduction","authors":"Federico Poloni","doi":"10.1002/gamm.202000018","DOIUrl":"10.1002/gamm.202000018","url":null,"abstract":"<p>We review a family of algorithms for Lyapunov- and Riccati-type equations which are all related to each other by the idea of <i>doubling</i>: they construct the iterate <math>\u0000 <mrow>\u0000 <msub>\u0000 <mrow>\u0000 <mi>Q</mi>\u0000 </mrow>\u0000 <mrow>\u0000 <mi>k</mi>\u0000 </mrow>\u0000 </msub>\u0000 <mo>=</mo>\u0000 <msub>\u0000 <mrow>\u0000 <mi>X</mi>\u0000 </mrow>\u0000 <mrow>\u0000 <msup>\u0000 <mrow>\u0000 <mn>2</mn>\u0000 </mrow>\u0000 <mrow>\u0000 <mi>k</mi>\u0000 </mrow>\u0000 </msup>\u0000 </mrow>\u0000 </msub>\u0000 </mrow></math> of another naturally-arising fixed-point iteration <span>(<i>X</i><sub><i>h</i></sub>)</span> via a sort of repeated squaring. The equations we consider are Stein equations <span><i>X</i> − <i>A</i><sup>∗</sup> <i>X A</i> = <i>Q</i></span>, Lyapunov equations <span><i>A</i><sup>∗</sup> <i>X</i> + <i>X A</i> + <i>Q</i> = 0</span>, discrete-time algebraic Riccati equations <span><i>X</i> = <i>Q</i> + <i>A</i><sup>∗</sup> <i>X</i>(<i>I</i> + <i>G X</i>)<sup>−1</sup><i>A</i></span>, continuous-time algebraic Riccati equations <span><i>Q</i> + <i>A</i><sup>∗</sup> <i>X</i> + <i>X A</i> − <i>X G X</i> = 0</span>, palindromic quadratic matrix equations <span><i>A</i> + <i>Q Y</i> + <i>A</i><sup>∗</sup><i>Y</i><sup>2</sup> = 0</span>, and nonlinear matrix equations <span><i>X</i> + <i>A</i><sup>∗</sup> <i>X</i><sup>−1</sup><i>A</i> = <i>Q</i></span>. We draw comparisons among these algorithms, highlight the connections between them and to other algorithms such as subspace iteration, and discuss open issues in their theory.</p>","PeriodicalId":53634,"journal":{"name":"GAMM Mitteilungen","volume":"43 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1002/gamm.202000018","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88337416","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Krylov methods for inverse problems: Surveying classical, and introducing new, algorithmic approaches 反问题的Krylov方法:考察经典,并引入新的算法方法
Q1 Mathematics Pub Date : 2020-09-28 DOI: 10.1002/gamm.202000017
Silvia Gazzola, Malena Sabaté Landman

Large-scale linear systems coming from suitable discretizations of linear inverse problems are challenging to solve. Indeed, since they are inherently ill-posed, appropriate regularization should be applied; since they are large-scale, well-established direct regularization methods (such as Tikhonov regularization) cannot often be straightforwardly employed, and iterative linear solvers should be exploited. Moreover, every regularization method crucially depends on the choice of one or more regularization parameters, which should be suitably tuned. The aim of this paper is twofold: (a) survey some well-established regularizing projection methods based on Krylov subspace methods (with a particular emphasis on methods based on the Golub-Kahan bidiagonalization algorithm), and the so-called hybrid approaches (which combine Tikhonov regularization and projection onto Krylov subspaces of increasing dimension); (b) introduce a new principled and adaptive algorithmic approach for regularization similar to specific instances of hybrid methods. In particular, the new strategy provides reliable parameter choice rules by leveraging the framework of bilevel optimization, and the links between Gauss quadrature and Golub-Kahan bidiagonalization. Numerical tests modeling inverse problems in imaging illustrate the performance of existing regularizing Krylov methods, and validate the new algorithms.

由线性逆问题的适当离散化而产生的大规模线性系统是一个具有挑战性的问题。事实上,由于它们本质上是病态的,因此应该应用适当的正则化;由于它们是大规模的,成熟的直接正则化方法(如Tikhonov正则化)通常不能直接使用,而应该利用迭代线性求解器。此外,每一种正则化方法都依赖于一个或多个正则化参数的选择,这些参数应该进行适当的调整。本文的目的有两个:(a)综述了一些基于Krylov子空间方法的成熟的正则化投影方法(特别强调了基于Golub-Kahan双对角化算法的方法)和所谓的混合方法(将Tikhonov正则化和投影结合到增加维数的Krylov子空间上);(b)引入一种新的原则性和自适应的正则化算法,类似于混合方法的具体实例。特别是,新策略通过利用双层优化框架,以及Gauss正交和Golub-Kahan双对角化之间的联系,提供了可靠的参数选择规则。模拟成像反问题的数值试验说明了现有正则化Krylov方法的性能,并验证了新算法的有效性。
{"title":"Krylov methods for inverse problems: Surveying classical, and introducing new, algorithmic approaches","authors":"Silvia Gazzola,&nbsp;Malena Sabaté Landman","doi":"10.1002/gamm.202000017","DOIUrl":"10.1002/gamm.202000017","url":null,"abstract":"<p>Large-scale linear systems coming from suitable discretizations of linear inverse problems are challenging to solve. Indeed, since they are inherently ill-posed, appropriate regularization should be applied; since they are large-scale, well-established direct regularization methods (such as Tikhonov regularization) cannot often be straightforwardly employed, and iterative linear solvers should be exploited. Moreover, every regularization method crucially depends on the choice of one or more regularization parameters, which should be suitably tuned. The aim of this paper is twofold: (a) survey some well-established regularizing projection methods based on Krylov subspace methods (with a particular emphasis on methods based on the Golub-Kahan bidiagonalization algorithm), and the so-called hybrid approaches (which combine Tikhonov regularization and projection onto Krylov subspaces of increasing dimension); (b) introduce a new principled and adaptive algorithmic approach for regularization similar to specific instances of hybrid methods. In particular, the new strategy provides reliable parameter choice rules by leveraging the framework of bilevel optimization, and the links between Gauss quadrature and Golub-Kahan bidiagonalization. Numerical tests modeling inverse problems in imaging illustrate the performance of existing regularizing Krylov methods, and validate the new algorithms.</p>","PeriodicalId":53634,"journal":{"name":"GAMM Mitteilungen","volume":"43 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1002/gamm.202000017","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76182732","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 18
A survey of subspace recycling iterative methods 子空间循环迭代方法综述
Q1 Mathematics Pub Date : 2020-09-20 DOI: 10.1002/gamm.202000016
Kirk M. Soodhalter, Eric de Sturler, Misha E. Kilmer

This survey concerns subspace recycling methods, a popular class of iterative methods that enable effective reuse of subspace information in order to speed up convergence and find good initial vectors over a sequence of linear systems with slowly changing coefficient matrices, multiple right-hand sides, or both. The subspace information that is recycled is usually generated during the run of an iterative method (usually a Krylov subspace method) on one or more of the systems. Following introduction of definitions and notation, we examine the history of early augmentation schemes along with deflation preconditioning schemes and their influence on the development of recycling methods. We then discuss a general residual constraint framework through which many augmented Krylov and recycling methods can both be viewed. We review several augmented and recycling methods within this framework. We then discuss some known effective strategies for choosing subspaces to recycle before taking the reader through more recent developments that have generalized recycling for (sequences of) shifted linear systems, some of them with multiple right-hand sides in mind. We round out our survey with a brief review of application areas that have seen benefit from subspace recycling methods.

这项调查涉及子空间回收方法,这是一种流行的迭代方法,可以有效地重用子空间信息,以加快收敛速度,并在具有缓慢变化的系数矩阵、多个右侧或两者的线性系统序列上找到良好的初始向量。回收的子空间信息通常是在一个或多个系统上运行迭代方法(通常是Krylov子空间方法)期间生成的。在介绍定义和符号之后,我们研究了早期增强方案的历史以及通货紧缩预处理方案及其对回收方法发展的影响。然后,我们讨论了一个一般的剩余约束框架,通过它可以看到许多增强的Krylov和回收方法。我们在此框架内回顾了几种增强和回收方法。然后,我们讨论了一些已知的有效策略,用于选择要回收的子空间,然后再向读者介绍移位线性系统(序列)的广义回收的最新发展,其中一些考虑了多个右手边。最后,我们简要回顾了从子空间回收方法中获益的应用领域。
{"title":"A survey of subspace recycling iterative methods","authors":"Kirk M. Soodhalter,&nbsp;Eric de Sturler,&nbsp;Misha E. Kilmer","doi":"10.1002/gamm.202000016","DOIUrl":"10.1002/gamm.202000016","url":null,"abstract":"<p>This survey concerns <i>subspace recycling methods</i>, a popular class of iterative methods that enable effective reuse of subspace information in order to speed up convergence and find good initial vectors over a sequence of linear systems with slowly changing coefficient matrices, multiple right-hand sides, or both. The subspace information that is recycled is usually generated during the run of an iterative method (usually a Krylov subspace method) on one or more of the systems. Following introduction of definitions and notation, we examine the history of early augmentation schemes along with deflation preconditioning schemes and their influence on the development of recycling methods. We then discuss a general residual constraint framework through which many augmented Krylov and recycling methods can both be viewed. We review several augmented and recycling methods within this framework. We then discuss some known effective strategies for choosing subspaces to recycle before taking the reader through more recent developments that have generalized recycling for (sequences of) shifted linear systems, some of them with multiple right-hand sides in mind. We round out our survey with a brief review of application areas that have seen benefit from subspace recycling methods.</p>","PeriodicalId":53634,"journal":{"name":"GAMM Mitteilungen","volume":"43 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1002/gamm.202000016","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76431675","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 31
期刊
GAMM Mitteilungen
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1