Benyun Shi;Liu Feng;Hailun He;Yingjian Hao;Yue Peng;Miao Liu;Yang Liu;Jiming Liu
{"title":"用于海面温度预测的基于物理引导的注意力神经网络","authors":"Benyun Shi;Liu Feng;Hailun He;Yingjian Hao;Yue Peng;Miao Liu;Yang Liu;Jiming Liu","doi":"10.1109/TGRS.2024.3457039","DOIUrl":null,"url":null,"abstract":"Accurate prediction of sea surface temperature (SST) is crucial in the field of oceanography, as it has a significant impact on various physical, chemical, and biological processes in the marine environment. In this study, we propose a physics-guided attention-based neural network (PANN) to address the spatiotemporal SST prediction problem. The PANN model incorporates data-driven spatiotemporal convolution operations and the underlying physical dynamics of SSTs using a cross-attention mechanism. First, we construct a spatiotemporal convolution module (SCM) using convolutional long short-term memory (ConvLSTM) to capture the spatial and temporal correlations present in the time series of the SST data. We then introduce a physical constraint module (PCM) to mimic the transport dynamics in fluids based on data assimilation techniques used to solve partial differential equations (PDEs). Consequently, we employ an attention fusion module (AFM) to effectively combine the data-driven and PDE-constrained predictions obtained from the SCM and PCM, aiming at enhancing the accuracy of the predictions. To evaluate the performance of the proposed model, we conduct short-term SST forecasts in the East China Sea (ECS) with forecast lead times ranging from one to ten days, by comparing it with several state-of-the-art models, including ConvLSTM, PredRNN, temporal convolutional transformer network (TCTN), convolutional gated recurrent unit (ConvGRU), and SwinLSTM. The experimental results demonstrate that our proposed model outperforms these models in terms of multiple evaluation metrics for short-term predictions.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":null,"pages":null},"PeriodicalIF":7.5000,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Physics-Guided Attention-Based Neural Network for Sea Surface Temperature Prediction\",\"authors\":\"Benyun Shi;Liu Feng;Hailun He;Yingjian Hao;Yue Peng;Miao Liu;Yang Liu;Jiming Liu\",\"doi\":\"10.1109/TGRS.2024.3457039\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Accurate prediction of sea surface temperature (SST) is crucial in the field of oceanography, as it has a significant impact on various physical, chemical, and biological processes in the marine environment. In this study, we propose a physics-guided attention-based neural network (PANN) to address the spatiotemporal SST prediction problem. The PANN model incorporates data-driven spatiotemporal convolution operations and the underlying physical dynamics of SSTs using a cross-attention mechanism. First, we construct a spatiotemporal convolution module (SCM) using convolutional long short-term memory (ConvLSTM) to capture the spatial and temporal correlations present in the time series of the SST data. We then introduce a physical constraint module (PCM) to mimic the transport dynamics in fluids based on data assimilation techniques used to solve partial differential equations (PDEs). Consequently, we employ an attention fusion module (AFM) to effectively combine the data-driven and PDE-constrained predictions obtained from the SCM and PCM, aiming at enhancing the accuracy of the predictions. To evaluate the performance of the proposed model, we conduct short-term SST forecasts in the East China Sea (ECS) with forecast lead times ranging from one to ten days, by comparing it with several state-of-the-art models, including ConvLSTM, PredRNN, temporal convolutional transformer network (TCTN), convolutional gated recurrent unit (ConvGRU), and SwinLSTM. The experimental results demonstrate that our proposed model outperforms these models in terms of multiple evaluation metrics for short-term predictions.\",\"PeriodicalId\":13213,\"journal\":{\"name\":\"IEEE Transactions on Geoscience and Remote Sensing\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2024-09-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Geoscience and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10672528/\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10672528/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
A Physics-Guided Attention-Based Neural Network for Sea Surface Temperature Prediction
Accurate prediction of sea surface temperature (SST) is crucial in the field of oceanography, as it has a significant impact on various physical, chemical, and biological processes in the marine environment. In this study, we propose a physics-guided attention-based neural network (PANN) to address the spatiotemporal SST prediction problem. The PANN model incorporates data-driven spatiotemporal convolution operations and the underlying physical dynamics of SSTs using a cross-attention mechanism. First, we construct a spatiotemporal convolution module (SCM) using convolutional long short-term memory (ConvLSTM) to capture the spatial and temporal correlations present in the time series of the SST data. We then introduce a physical constraint module (PCM) to mimic the transport dynamics in fluids based on data assimilation techniques used to solve partial differential equations (PDEs). Consequently, we employ an attention fusion module (AFM) to effectively combine the data-driven and PDE-constrained predictions obtained from the SCM and PCM, aiming at enhancing the accuracy of the predictions. To evaluate the performance of the proposed model, we conduct short-term SST forecasts in the East China Sea (ECS) with forecast lead times ranging from one to ten days, by comparing it with several state-of-the-art models, including ConvLSTM, PredRNN, temporal convolutional transformer network (TCTN), convolutional gated recurrent unit (ConvGRU), and SwinLSTM. The experimental results demonstrate that our proposed model outperforms these models in terms of multiple evaluation metrics for short-term predictions.
期刊介绍:
IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.