Prediction of spatiotemporal dynamics using deep learning: Coupled neural networks of long short-terms memory, auto-encoder and physics-informed neural networks
Ziyang Zhang , Feifan Zhang , Weixi Gong , Tailai Chen , Luowei Tan , Heng Gui
{"title":"Prediction of spatiotemporal dynamics using deep learning: Coupled neural networks of long short-terms memory, auto-encoder and physics-informed neural networks","authors":"Ziyang Zhang , Feifan Zhang , Weixi Gong , Tailai Chen , Luowei Tan , Heng Gui","doi":"10.1016/j.physd.2024.134399","DOIUrl":null,"url":null,"abstract":"<div><div>Several classic reaction-diffusion models using partial differential equations (PDEs) have been established to elucidate the formation mechanism of vegetation patterns. However, predictive modeling of complex spatiotemporal dynamics using traditional numerical methods can be significantly challenging in many practical scenarios. Physics-Informed Neural Networks (PINNs) provide a new approach to predict the solution of PDEs. However, the generalization of PINNs is not satisfactory when pretrained PINNs is directly used in non-trained space (defined as explorations). This may be attributed to the lack of training in the time dimension. Therefore, a framework (LA-PINNs) is proposed to predict the evolutionary solution of the non-dimensional vegetation-sand model. The framework couples neural networks of Long-Short Terms Memory, Auto-Encoder and Physics-Informed Neural Networks. The predictions of LA-PINNs are much better than those of PINNs. Then we studied the effects of hyperparameters on the accuracy of predictions. Based on training in time dimension by LSTM module and pretraining for quick-training strategy, LA-PINNs can improve the accuracy of explorations.</div></div>","PeriodicalId":20050,"journal":{"name":"Physica D: Nonlinear Phenomena","volume":"470 ","pages":"Article 134399"},"PeriodicalIF":2.9000,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physica D: Nonlinear Phenomena","FirstCategoryId":"100","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S016727892400349X","RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/10/9 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"MATHEMATICS, APPLIED","Score":null,"Total":0}
引用次数: 0
Abstract
Several classic reaction-diffusion models using partial differential equations (PDEs) have been established to elucidate the formation mechanism of vegetation patterns. However, predictive modeling of complex spatiotemporal dynamics using traditional numerical methods can be significantly challenging in many practical scenarios. Physics-Informed Neural Networks (PINNs) provide a new approach to predict the solution of PDEs. However, the generalization of PINNs is not satisfactory when pretrained PINNs is directly used in non-trained space (defined as explorations). This may be attributed to the lack of training in the time dimension. Therefore, a framework (LA-PINNs) is proposed to predict the evolutionary solution of the non-dimensional vegetation-sand model. The framework couples neural networks of Long-Short Terms Memory, Auto-Encoder and Physics-Informed Neural Networks. The predictions of LA-PINNs are much better than those of PINNs. Then we studied the effects of hyperparameters on the accuracy of predictions. Based on training in time dimension by LSTM module and pretraining for quick-training strategy, LA-PINNs can improve the accuracy of explorations.
期刊介绍:
Physica D (Nonlinear Phenomena) publishes research and review articles reporting on experimental and theoretical works, techniques and ideas that advance the understanding of nonlinear phenomena. Topics encompass wave motion in physical, chemical and biological systems; physical or biological phenomena governed by nonlinear field equations, including hydrodynamics and turbulence; pattern formation and cooperative phenomena; instability, bifurcations, chaos, and space-time disorder; integrable/Hamiltonian systems; asymptotic analysis and, more generally, mathematical methods for nonlinear systems.