{"title":"SSGAN: Cloud removal in satellite images using spatiospectral generative adversarial network","authors":"","doi":"10.1016/j.eja.2024.127333","DOIUrl":null,"url":null,"abstract":"<div><p>Satellite data’s reliability, uniformity, and global scanning capabilities have revolutionized agricultural monitoring and crop management. However, the presence of clouds in satellite images can obscure useful information, rendering them difficult to infer. Aiming at the problem of cloud cover, this study presents a SpatioSpectral Generative Adversarial Network (SSGAN) approach for effectively eliminating cloud cover from multispectral satellite images. It utilizes the Synthetic Aperture Radar (SAR) images as complementary information with the optical images from the Sentinel-2 satellite. The proposed model exploits feature extraction by sub-grouping the 13 channels of Sentinel-2 images based on their electromagnetic wavelength. Experimentally, we demonstrated that the proposed SSGAN model surpasses conventional and state-of-the-art (SOTA) methods and can reconstruct regions obscured by clouds. The subgrouping optimized the utilization of sensor information and improved the performance metrics for reconstructed images. Compared to the state-of-the-art (SOTA) approach, the SSGAN model demonstrates higher performance, achieving a mPSNR of 32.771, mSSIM of 0.880, and correlation coefficient (CC) of 0.889. The SSGAN model was further evaluated under varying conditions, including scenarios without the inclusion of SAR data, where it achieved a mPSNR of 26.825, mSSIM of 0.726, and CC of 0.615. Adding SAR images into the model significantly enhanced its performance, resulting in a mPSNR of 29.932, mSSIM of 0.857, and CC of 0.735. These results indicate that higher mPSNR, mSSIM, and CC values correspond to better image reconstruction quality. Our method enhances the usability of satellite data for crop mapping, crop health monitoring, and crop yield prediction.</p></div>","PeriodicalId":51045,"journal":{"name":"European Journal of Agronomy","volume":null,"pages":null},"PeriodicalIF":4.5000,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"European Journal of Agronomy","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1161030124002545","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRONOMY","Score":null,"Total":0}
引用次数: 0
Abstract
Satellite data’s reliability, uniformity, and global scanning capabilities have revolutionized agricultural monitoring and crop management. However, the presence of clouds in satellite images can obscure useful information, rendering them difficult to infer. Aiming at the problem of cloud cover, this study presents a SpatioSpectral Generative Adversarial Network (SSGAN) approach for effectively eliminating cloud cover from multispectral satellite images. It utilizes the Synthetic Aperture Radar (SAR) images as complementary information with the optical images from the Sentinel-2 satellite. The proposed model exploits feature extraction by sub-grouping the 13 channels of Sentinel-2 images based on their electromagnetic wavelength. Experimentally, we demonstrated that the proposed SSGAN model surpasses conventional and state-of-the-art (SOTA) methods and can reconstruct regions obscured by clouds. The subgrouping optimized the utilization of sensor information and improved the performance metrics for reconstructed images. Compared to the state-of-the-art (SOTA) approach, the SSGAN model demonstrates higher performance, achieving a mPSNR of 32.771, mSSIM of 0.880, and correlation coefficient (CC) of 0.889. The SSGAN model was further evaluated under varying conditions, including scenarios without the inclusion of SAR data, where it achieved a mPSNR of 26.825, mSSIM of 0.726, and CC of 0.615. Adding SAR images into the model significantly enhanced its performance, resulting in a mPSNR of 29.932, mSSIM of 0.857, and CC of 0.735. These results indicate that higher mPSNR, mSSIM, and CC values correspond to better image reconstruction quality. Our method enhances the usability of satellite data for crop mapping, crop health monitoring, and crop yield prediction.
期刊介绍:
The European Journal of Agronomy, the official journal of the European Society for Agronomy, publishes original research papers reporting experimental and theoretical contributions to field-based agronomy and crop science. The journal will consider research at the field level for agricultural, horticultural and tree crops, that uses comprehensive and explanatory approaches. The EJA covers the following topics:
crop physiology
crop production and management including irrigation, fertilization and soil management
agroclimatology and modelling
plant-soil relationships
crop quality and post-harvest physiology
farming and cropping systems
agroecosystems and the environment
crop-weed interactions and management
organic farming
horticultural crops
papers from the European Society for Agronomy bi-annual meetings
In determining the suitability of submitted articles for publication, particular scrutiny is placed on the degree of novelty and significance of the research and the extent to which it adds to existing knowledge in agronomy.