{"title":"Neural network emulator for atmospheric chemical ODE.","authors":"Zhi-Song Liu, Petri Clusius, Michael Boy","doi":"10.1016/j.neunet.2024.107106","DOIUrl":null,"url":null,"abstract":"<p><p>Modelling atmospheric chemistry is complex and computationally intense. Given the recent success of Deep neural networks in digital signal processing, we propose a Neural Network Emulator for fast chemical concentration modelling. We consider atmospheric chemistry as a time-dependent Ordinary Differential Equation. To extract the hidden correlations between initial states and future time evolution, we propose ChemNNE, an Attention based Neural Network Emulator (NNE) that can model the atmospheric chemistry as a neural ODE process. To efficiently capture temporal patterns in chemical concentration changes, we implement sinusoidal time embedding to represent periodic tendencies over time. Additionally, we leverage the Fourier neural operator to model the ODE process, enhancing computational efficiency and facilitating the learning of complex dynamical behaviour. We introduce three physics-informed loss functions, targeting conservation laws and reaction rate constraints, to guide the training optimization process. To evaluate our model, we introduce a unique, large-scale chemical dataset designed for neural network training and validation, which can serve as a benchmark for future studies. The extensive experiments show that our approach achieves state-of-the-art performance in modelling accuracy and computational speed.</p>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"184 ","pages":"107106"},"PeriodicalIF":6.0000,"publicationDate":"2025-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neural Networks","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1016/j.neunet.2024.107106","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Modelling atmospheric chemistry is complex and computationally intense. Given the recent success of Deep neural networks in digital signal processing, we propose a Neural Network Emulator for fast chemical concentration modelling. We consider atmospheric chemistry as a time-dependent Ordinary Differential Equation. To extract the hidden correlations between initial states and future time evolution, we propose ChemNNE, an Attention based Neural Network Emulator (NNE) that can model the atmospheric chemistry as a neural ODE process. To efficiently capture temporal patterns in chemical concentration changes, we implement sinusoidal time embedding to represent periodic tendencies over time. Additionally, we leverage the Fourier neural operator to model the ODE process, enhancing computational efficiency and facilitating the learning of complex dynamical behaviour. We introduce three physics-informed loss functions, targeting conservation laws and reaction rate constraints, to guide the training optimization process. To evaluate our model, we introduce a unique, large-scale chemical dataset designed for neural network training and validation, which can serve as a benchmark for future studies. The extensive experiments show that our approach achieves state-of-the-art performance in modelling accuracy and computational speed.
期刊介绍:
Neural Networks is a platform that aims to foster an international community of scholars and practitioners interested in neural networks, deep learning, and other approaches to artificial intelligence and machine learning. Our journal invites submissions covering various aspects of neural networks research, from computational neuroscience and cognitive modeling to mathematical analyses and engineering applications. By providing a forum for interdisciplinary discussions between biology and technology, we aim to encourage the development of biologically-inspired artificial intelligence.