Jiahao Song
(, ), Wenbo Cao
(, ), Fei Liao
(, ), Weiwei Zhang
(, )
{"title":"VW-PINNs:物理信息神经网络中 PDE 残差的体积加权法","authors":"Jiahao Song \n (, ), Wenbo Cao \n (, ), Fei Liao \n (, ), Weiwei Zhang \n (, )","doi":"10.1007/s10409-024-24140-x","DOIUrl":null,"url":null,"abstract":"<div><p>Physics-informed neural networks (PINNs) have shown remarkable prospects in solving the forward and inverse problems involving partial differential equations (PDEs). The method embeds PDEs into the neural network by calculating the PDE loss at a set of collocation points, providing advantages such as meshfree and more convenient adaptive sampling. However, when solving PDEs using nonuniform collocation points, PINNs still face challenge regarding inefficient convergence of PDE residuals or even failure. In this work, we first analyze the ill-conditioning of the PDE loss in PINNs under nonuniform collocation points. To address the issue, we define volume weighting residual and propose volume weighting physics-informed neural networks (VW-PINNs). Through weighting the PDE residuals by the volume that the collocation points occupy within the computational domain, we embed explicitly the distribution characteristics of collocation points in the loss evaluation. The fast and sufficient convergence of the PDE residuals for the problems involving nonuniform collocation points is guaranteed. Considering the meshfree characteristics of VW-PINNs, we also develop a volume approximation algorithm based on kernel density estimation to calculate the volume of the collocation points. We validate the universality of VW-PINNs by solving the forward problems involving flow over a circular cylinder and flow over the NACA0012 airfoil under different inflow conditions, where conventional PINNs fail. By solving the Burgers’ equation, we verify that VW-PINNs can enhance the efficiency of existing the adaptive sampling method in solving the forward problem by three times, and can reduce the relative <i>L</i><sub>2</sub> error of conventional PINNs in solving the inverse problem by more than one order of magnitude.</p><div><figure><div><div><picture><source><img></source></picture></div></div></figure></div></div>","PeriodicalId":7109,"journal":{"name":"Acta Mechanica Sinica","volume":null,"pages":null},"PeriodicalIF":3.8000,"publicationDate":"2024-07-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"VW-PINNs: A volume weighting method for PDE residuals in physics-informed neural networks\",\"authors\":\"Jiahao Song \\n (, ), Wenbo Cao \\n (, ), Fei Liao \\n (, ), Weiwei Zhang \\n (, )\",\"doi\":\"10.1007/s10409-024-24140-x\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Physics-informed neural networks (PINNs) have shown remarkable prospects in solving the forward and inverse problems involving partial differential equations (PDEs). The method embeds PDEs into the neural network by calculating the PDE loss at a set of collocation points, providing advantages such as meshfree and more convenient adaptive sampling. However, when solving PDEs using nonuniform collocation points, PINNs still face challenge regarding inefficient convergence of PDE residuals or even failure. In this work, we first analyze the ill-conditioning of the PDE loss in PINNs under nonuniform collocation points. To address the issue, we define volume weighting residual and propose volume weighting physics-informed neural networks (VW-PINNs). Through weighting the PDE residuals by the volume that the collocation points occupy within the computational domain, we embed explicitly the distribution characteristics of collocation points in the loss evaluation. The fast and sufficient convergence of the PDE residuals for the problems involving nonuniform collocation points is guaranteed. Considering the meshfree characteristics of VW-PINNs, we also develop a volume approximation algorithm based on kernel density estimation to calculate the volume of the collocation points. We validate the universality of VW-PINNs by solving the forward problems involving flow over a circular cylinder and flow over the NACA0012 airfoil under different inflow conditions, where conventional PINNs fail. By solving the Burgers’ equation, we verify that VW-PINNs can enhance the efficiency of existing the adaptive sampling method in solving the forward problem by three times, and can reduce the relative <i>L</i><sub>2</sub> error of conventional PINNs in solving the inverse problem by more than one order of magnitude.</p><div><figure><div><div><picture><source><img></source></picture></div></div></figure></div></div>\",\"PeriodicalId\":7109,\"journal\":{\"name\":\"Acta Mechanica Sinica\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.8000,\"publicationDate\":\"2024-07-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Acta Mechanica Sinica\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s10409-024-24140-x\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MECHANICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Acta Mechanica Sinica","FirstCategoryId":"5","ListUrlMain":"https://link.springer.com/article/10.1007/s10409-024-24140-x","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MECHANICAL","Score":null,"Total":0}
VW-PINNs: A volume weighting method for PDE residuals in physics-informed neural networks
Physics-informed neural networks (PINNs) have shown remarkable prospects in solving the forward and inverse problems involving partial differential equations (PDEs). The method embeds PDEs into the neural network by calculating the PDE loss at a set of collocation points, providing advantages such as meshfree and more convenient adaptive sampling. However, when solving PDEs using nonuniform collocation points, PINNs still face challenge regarding inefficient convergence of PDE residuals or even failure. In this work, we first analyze the ill-conditioning of the PDE loss in PINNs under nonuniform collocation points. To address the issue, we define volume weighting residual and propose volume weighting physics-informed neural networks (VW-PINNs). Through weighting the PDE residuals by the volume that the collocation points occupy within the computational domain, we embed explicitly the distribution characteristics of collocation points in the loss evaluation. The fast and sufficient convergence of the PDE residuals for the problems involving nonuniform collocation points is guaranteed. Considering the meshfree characteristics of VW-PINNs, we also develop a volume approximation algorithm based on kernel density estimation to calculate the volume of the collocation points. We validate the universality of VW-PINNs by solving the forward problems involving flow over a circular cylinder and flow over the NACA0012 airfoil under different inflow conditions, where conventional PINNs fail. By solving the Burgers’ equation, we verify that VW-PINNs can enhance the efficiency of existing the adaptive sampling method in solving the forward problem by three times, and can reduce the relative L2 error of conventional PINNs in solving the inverse problem by more than one order of magnitude.
期刊介绍:
Acta Mechanica Sinica, sponsored by the Chinese Society of Theoretical and Applied Mechanics, promotes scientific exchanges and collaboration among Chinese scientists in China and abroad. It features high quality, original papers in all aspects of mechanics and mechanical sciences.
Not only does the journal explore the classical subdivisions of theoretical and applied mechanics such as solid and fluid mechanics, it also explores recently emerging areas such as biomechanics and nanomechanics. In addition, the journal investigates analytical, computational, and experimental progresses in all areas of mechanics. Lastly, it encourages research in interdisciplinary subjects, serving as a bridge between mechanics and other branches of engineering and the sciences.
In addition to research papers, Acta Mechanica Sinica publishes reviews, notes, experimental techniques, scientific events, and other special topics of interest.
Related subjects » Classical Continuum Physics - Computational Intelligence and Complexity - Mechanics