{"title":"面向算子学习的高斯过程:用于计算力学的不确定性感知分辨率独立算子学习算法","authors":"Sawan Kumar, Rajdip Nayek, Souvik Chakraborty","doi":"arxiv-2409.10972","DOIUrl":null,"url":null,"abstract":"The growing demand for accurate, efficient, and scalable solutions in\ncomputational mechanics highlights the need for advanced operator learning\nalgorithms that can efficiently handle large datasets while providing reliable\nuncertainty quantification. This paper introduces a novel Gaussian Process (GP)\nbased neural operator for solving parametric differential equations. The\napproach proposed leverages the expressive capability of deterministic neural\noperators and the uncertainty awareness of conventional GP. In particular, we\npropose a ``neural operator-embedded kernel'' wherein the GP kernel is\nformulated in the latent space learned using a neural operator. Further, we\nexploit a stochastic dual descent (SDD) algorithm for simultaneously training\nthe neural operator parameters and the GP hyperparameters. Our approach\naddresses the (a) resolution dependence and (b) cubic complexity of traditional\nGP models, allowing for input-resolution independence and scalability in\nhigh-dimensional and non-linear parametric systems, such as those encountered\nin computational mechanics. We apply our method to a range of non-linear\nparametric partial differential equations (PDEs) and demonstrate its\nsuperiority in both computational efficiency and accuracy compared to standard\nGP models and wavelet neural operators. Our experimental results highlight the\nefficacy of this framework in solving complex PDEs while maintaining robustness\nin uncertainty estimation, positioning it as a scalable and reliable\noperator-learning algorithm for computational mechanics.","PeriodicalId":501340,"journal":{"name":"arXiv - STAT - Machine Learning","volume":"18 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Towards Gaussian Process for operator learning: an uncertainty aware resolution independent operator learning algorithm for computational mechanics\",\"authors\":\"Sawan Kumar, Rajdip Nayek, Souvik Chakraborty\",\"doi\":\"arxiv-2409.10972\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The growing demand for accurate, efficient, and scalable solutions in\\ncomputational mechanics highlights the need for advanced operator learning\\nalgorithms that can efficiently handle large datasets while providing reliable\\nuncertainty quantification. This paper introduces a novel Gaussian Process (GP)\\nbased neural operator for solving parametric differential equations. The\\napproach proposed leverages the expressive capability of deterministic neural\\noperators and the uncertainty awareness of conventional GP. In particular, we\\npropose a ``neural operator-embedded kernel'' wherein the GP kernel is\\nformulated in the latent space learned using a neural operator. Further, we\\nexploit a stochastic dual descent (SDD) algorithm for simultaneously training\\nthe neural operator parameters and the GP hyperparameters. Our approach\\naddresses the (a) resolution dependence and (b) cubic complexity of traditional\\nGP models, allowing for input-resolution independence and scalability in\\nhigh-dimensional and non-linear parametric systems, such as those encountered\\nin computational mechanics. We apply our method to a range of non-linear\\nparametric partial differential equations (PDEs) and demonstrate its\\nsuperiority in both computational efficiency and accuracy compared to standard\\nGP models and wavelet neural operators. Our experimental results highlight the\\nefficacy of this framework in solving complex PDEs while maintaining robustness\\nin uncertainty estimation, positioning it as a scalable and reliable\\noperator-learning algorithm for computational mechanics.\",\"PeriodicalId\":501340,\"journal\":{\"name\":\"arXiv - STAT - Machine Learning\",\"volume\":\"18 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - STAT - Machine Learning\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.10972\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - STAT - Machine Learning","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.10972","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
对精确、高效、可扩展的计算力学解决方案的需求日益增长,这凸显了对先进算子学习算法的需求,这种算法既能高效处理大型数据集,又能提供可靠的不确定性量化。本文介绍了一种基于高斯过程(GP)的新型神经算子,用于求解参数微分方程。本文提出的方法充分利用了确定性神经算子的表达能力和传统 GP 的不确定性意识。特别是,我们提出了一种 "神经算子嵌入内核",其中 GP 内核是在使用神经算子学习的潜空间中形成的。此外,我们还利用随机双降(SDD)算法同时训练神经算子参数和 GP 超参数。我们的方法解决了传统 GP 模型的(a)分辨率依赖性和(b)立方复杂性问题,从而实现了输入分辨率的独立性和高维非线性参数系统的可扩展性,例如在计算力学中遇到的系统。我们将我们的方法应用于一系列非线性参数偏微分方程(PDEs),并证明与标准 GP 模型和小波神经算子相比,我们的方法在计算效率和准确性方面都更胜一筹。我们的实验结果凸显了这一框架在求解复杂偏微分方程时的有效性,同时保持了不确定性估计的鲁棒性,使其成为计算力学领域一种可扩展且可靠的算子学习算法。
Towards Gaussian Process for operator learning: an uncertainty aware resolution independent operator learning algorithm for computational mechanics
The growing demand for accurate, efficient, and scalable solutions in
computational mechanics highlights the need for advanced operator learning
algorithms that can efficiently handle large datasets while providing reliable
uncertainty quantification. This paper introduces a novel Gaussian Process (GP)
based neural operator for solving parametric differential equations. The
approach proposed leverages the expressive capability of deterministic neural
operators and the uncertainty awareness of conventional GP. In particular, we
propose a ``neural operator-embedded kernel'' wherein the GP kernel is
formulated in the latent space learned using a neural operator. Further, we
exploit a stochastic dual descent (SDD) algorithm for simultaneously training
the neural operator parameters and the GP hyperparameters. Our approach
addresses the (a) resolution dependence and (b) cubic complexity of traditional
GP models, allowing for input-resolution independence and scalability in
high-dimensional and non-linear parametric systems, such as those encountered
in computational mechanics. We apply our method to a range of non-linear
parametric partial differential equations (PDEs) and demonstrate its
superiority in both computational efficiency and accuracy compared to standard
GP models and wavelet neural operators. Our experimental results highlight the
efficacy of this framework in solving complex PDEs while maintaining robustness
in uncertainty estimation, positioning it as a scalable and reliable
operator-learning algorithm for computational mechanics.