{"title":"TL-iTransformer:通过 iTransformer 和迁移学习革新海面温度预测","authors":"Wanhai Jia, Shaopeng Guan, Yuewei Xue","doi":"10.1007/s12145-024-01436-x","DOIUrl":null,"url":null,"abstract":"<p>The dynamics of Sea Surface Temperature (SST) are crucial for maintaining the balance of marine ecosystems. While existing artificial intelligence methods offer powerful tools for SST prediction, they struggle with data sparsity issues. To enhance SST prediction accuracy under sparse data conditions, this study proposes an innovative prediction model: TL-iTransformer. This model is based on the iTransformer architecture and incorporates transfer learning techniques specifically tailored for SST prediction. We begin by extracting SST features from data-rich sea areas (source sea areas) using a transfer learning strategy, integrating these features into the iTransformer model for pre-training. This process imparts the model with a priori knowledge and basic prediction capabilities, enabling it to adapt to data-sparse sea areas (target sea areas). The model is then fine-tuned using domain adaptive techniques to accurately capture the data characteristics and distribution patterns of the target sea area. We conducted a series of experiments using a real SST dataset from the sea area of British Columbia, Canada. The results demonstrate that TL-iTransformer maintains the Mean Absolute Error (MAE) and Mean Squared Error (MSE) within 0.144 and 0.356, respectively, under data sparsity conditions. Additionally, it outperforms four mainstream time-series prediction baseline models as the prediction time span increases. The proposed model can effectively address the issue of SST prediction in situations with sparse data.</p>","PeriodicalId":49318,"journal":{"name":"Earth Science Informatics","volume":"295 1","pages":""},"PeriodicalIF":2.7000,"publicationDate":"2024-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"TL-iTransformer: Revolutionizing sea surface temperature prediction through iTransformer and transfer learning\",\"authors\":\"Wanhai Jia, Shaopeng Guan, Yuewei Xue\",\"doi\":\"10.1007/s12145-024-01436-x\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>The dynamics of Sea Surface Temperature (SST) are crucial for maintaining the balance of marine ecosystems. While existing artificial intelligence methods offer powerful tools for SST prediction, they struggle with data sparsity issues. To enhance SST prediction accuracy under sparse data conditions, this study proposes an innovative prediction model: TL-iTransformer. This model is based on the iTransformer architecture and incorporates transfer learning techniques specifically tailored for SST prediction. We begin by extracting SST features from data-rich sea areas (source sea areas) using a transfer learning strategy, integrating these features into the iTransformer model for pre-training. This process imparts the model with a priori knowledge and basic prediction capabilities, enabling it to adapt to data-sparse sea areas (target sea areas). The model is then fine-tuned using domain adaptive techniques to accurately capture the data characteristics and distribution patterns of the target sea area. We conducted a series of experiments using a real SST dataset from the sea area of British Columbia, Canada. The results demonstrate that TL-iTransformer maintains the Mean Absolute Error (MAE) and Mean Squared Error (MSE) within 0.144 and 0.356, respectively, under data sparsity conditions. Additionally, it outperforms four mainstream time-series prediction baseline models as the prediction time span increases. The proposed model can effectively address the issue of SST prediction in situations with sparse data.</p>\",\"PeriodicalId\":49318,\"journal\":{\"name\":\"Earth Science Informatics\",\"volume\":\"295 1\",\"pages\":\"\"},\"PeriodicalIF\":2.7000,\"publicationDate\":\"2024-08-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Earth Science Informatics\",\"FirstCategoryId\":\"89\",\"ListUrlMain\":\"https://doi.org/10.1007/s12145-024-01436-x\",\"RegionNum\":4,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Earth Science Informatics","FirstCategoryId":"89","ListUrlMain":"https://doi.org/10.1007/s12145-024-01436-x","RegionNum":4,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
TL-iTransformer: Revolutionizing sea surface temperature prediction through iTransformer and transfer learning
The dynamics of Sea Surface Temperature (SST) are crucial for maintaining the balance of marine ecosystems. While existing artificial intelligence methods offer powerful tools for SST prediction, they struggle with data sparsity issues. To enhance SST prediction accuracy under sparse data conditions, this study proposes an innovative prediction model: TL-iTransformer. This model is based on the iTransformer architecture and incorporates transfer learning techniques specifically tailored for SST prediction. We begin by extracting SST features from data-rich sea areas (source sea areas) using a transfer learning strategy, integrating these features into the iTransformer model for pre-training. This process imparts the model with a priori knowledge and basic prediction capabilities, enabling it to adapt to data-sparse sea areas (target sea areas). The model is then fine-tuned using domain adaptive techniques to accurately capture the data characteristics and distribution patterns of the target sea area. We conducted a series of experiments using a real SST dataset from the sea area of British Columbia, Canada. The results demonstrate that TL-iTransformer maintains the Mean Absolute Error (MAE) and Mean Squared Error (MSE) within 0.144 and 0.356, respectively, under data sparsity conditions. Additionally, it outperforms four mainstream time-series prediction baseline models as the prediction time span increases. The proposed model can effectively address the issue of SST prediction in situations with sparse data.
期刊介绍:
The Earth Science Informatics [ESIN] journal aims at rapid publication of high-quality, current, cutting-edge, and provocative scientific work in the area of Earth Science Informatics as it relates to Earth systems science and space science. This includes articles on the application of formal and computational methods, computational Earth science, spatial and temporal analyses, and all aspects of computer applications to the acquisition, storage, processing, interchange, and visualization of data and information about the materials, properties, processes, features, and phenomena that occur at all scales and locations in the Earth system’s five components (atmosphere, hydrosphere, geosphere, biosphere, cryosphere) and in space (see "About this journal" for more detail). The quarterly journal publishes research, methodology, and software articles, as well as editorials, comments, and book and software reviews. Review articles of relevant findings, topics, and methodologies are also considered.