Yuling Jiao, Jerry Zhijian Yang, Cheng Yuan null, Junyu Zhou
{"title":"二阶抛物型偏微分方程弱对抗神经网络的收敛速度","authors":"Yuling Jiao, Jerry Zhijian Yang, Cheng Yuan null, Junyu Zhou","doi":"10.4208/cicp.oa-2023-0063","DOIUrl":null,"url":null,"abstract":". In this paper, we give the first rigorous error estimation of the Weak Ad-versarial Neural Networks (WAN) in solving the second order parabolic PDEs. By decomposing the error into approximation error and statistical error, we first show the weak solution can be approximated by the ReLU 2 with arbitrary accuracy, then prove that the statistical error can also be efficiently bounded by the Rademacher complexity of the network functions, which can be further bounded by some integral related with the covering numbers and pseudo-dimension of ReLU 2 space. Finally, by combining the two bounds, we prove that the error of the WAN method can be well controlled if the depth and width of the neural network as well as the sample numbers have been properly selected. Our result also reveals some kind of freedom in choosing sample numbers on ∂ Ω and in the time axis.","PeriodicalId":50661,"journal":{"name":"Communications in Computational Physics","volume":"12 1","pages":"0"},"PeriodicalIF":2.6000,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Rate of Convergence of Weak Adversarial Neural Networks for the Second Order Parabolic PDEs\",\"authors\":\"Yuling Jiao, Jerry Zhijian Yang, Cheng Yuan null, Junyu Zhou\",\"doi\":\"10.4208/cicp.oa-2023-0063\",\"DOIUrl\":null,\"url\":null,\"abstract\":\". In this paper, we give the first rigorous error estimation of the Weak Ad-versarial Neural Networks (WAN) in solving the second order parabolic PDEs. By decomposing the error into approximation error and statistical error, we first show the weak solution can be approximated by the ReLU 2 with arbitrary accuracy, then prove that the statistical error can also be efficiently bounded by the Rademacher complexity of the network functions, which can be further bounded by some integral related with the covering numbers and pseudo-dimension of ReLU 2 space. Finally, by combining the two bounds, we prove that the error of the WAN method can be well controlled if the depth and width of the neural network as well as the sample numbers have been properly selected. Our result also reveals some kind of freedom in choosing sample numbers on ∂ Ω and in the time axis.\",\"PeriodicalId\":50661,\"journal\":{\"name\":\"Communications in Computational Physics\",\"volume\":\"12 1\",\"pages\":\"0\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2023-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Communications in Computational Physics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.4208/cicp.oa-2023-0063\",\"RegionNum\":3,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PHYSICS, MATHEMATICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Communications in Computational Physics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4208/cicp.oa-2023-0063","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PHYSICS, MATHEMATICAL","Score":null,"Total":0}
A Rate of Convergence of Weak Adversarial Neural Networks for the Second Order Parabolic PDEs
. In this paper, we give the first rigorous error estimation of the Weak Ad-versarial Neural Networks (WAN) in solving the second order parabolic PDEs. By decomposing the error into approximation error and statistical error, we first show the weak solution can be approximated by the ReLU 2 with arbitrary accuracy, then prove that the statistical error can also be efficiently bounded by the Rademacher complexity of the network functions, which can be further bounded by some integral related with the covering numbers and pseudo-dimension of ReLU 2 space. Finally, by combining the two bounds, we prove that the error of the WAN method can be well controlled if the depth and width of the neural network as well as the sample numbers have been properly selected. Our result also reveals some kind of freedom in choosing sample numbers on ∂ Ω and in the time axis.
期刊介绍:
Communications in Computational Physics (CiCP) publishes original research and survey papers of high scientific value in computational modeling of physical problems. Results in multi-physics and multi-scale innovative computational methods and modeling in all physical sciences will be featured.