SSGAN: Cloud removal in satellite images using spatiospectral generative adversarial network

IF 4.5 1区 农林科学 Q1 AGRONOMY European Journal of Agronomy Pub Date : 2024-09-13 DOI:10.1016/j.eja.2024.127333
Sushil Ghildiyal , Neeraj Goel , Simrandeep Singh , Sohan Lal , Riazuddin Kawsar , Abdulmotaleb El Saddik , Mukesh Saini
{"title":"SSGAN: Cloud removal in satellite images using spatiospectral generative adversarial network","authors":"Sushil Ghildiyal ,&nbsp;Neeraj Goel ,&nbsp;Simrandeep Singh ,&nbsp;Sohan Lal ,&nbsp;Riazuddin Kawsar ,&nbsp;Abdulmotaleb El Saddik ,&nbsp;Mukesh Saini","doi":"10.1016/j.eja.2024.127333","DOIUrl":null,"url":null,"abstract":"<div><p>Satellite data’s reliability, uniformity, and global scanning capabilities have revolutionized agricultural monitoring and crop management. However, the presence of clouds in satellite images can obscure useful information, rendering them difficult to infer. Aiming at the problem of cloud cover, this study presents a SpatioSpectral Generative Adversarial Network (SSGAN) approach for effectively eliminating cloud cover from multispectral satellite images. It utilizes the Synthetic Aperture Radar (SAR) images as complementary information with the optical images from the Sentinel-2 satellite. The proposed model exploits feature extraction by sub-grouping the 13 channels of Sentinel-2 images based on their electromagnetic wavelength. Experimentally, we demonstrated that the proposed SSGAN model surpasses conventional and state-of-the-art (SOTA) methods and can reconstruct regions obscured by clouds. The subgrouping optimized the utilization of sensor information and improved the performance metrics for reconstructed images. Compared to the state-of-the-art (SOTA) approach, the SSGAN model demonstrates higher performance, achieving a mPSNR of 32.771, mSSIM of 0.880, and correlation coefficient (CC) of 0.889. The SSGAN model was further evaluated under varying conditions, including scenarios without the inclusion of SAR data, where it achieved a mPSNR of 26.825, mSSIM of 0.726, and CC of 0.615. Adding SAR images into the model significantly enhanced its performance, resulting in a mPSNR of 29.932, mSSIM of 0.857, and CC of 0.735. These results indicate that higher mPSNR, mSSIM, and CC values correspond to better image reconstruction quality. Our method enhances the usability of satellite data for crop mapping, crop health monitoring, and crop yield prediction.</p></div>","PeriodicalId":51045,"journal":{"name":"European Journal of Agronomy","volume":"161 ","pages":"Article 127333"},"PeriodicalIF":4.5000,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"European Journal of Agronomy","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1161030124002545","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRONOMY","Score":null,"Total":0}
引用次数: 0

Abstract

Satellite data’s reliability, uniformity, and global scanning capabilities have revolutionized agricultural monitoring and crop management. However, the presence of clouds in satellite images can obscure useful information, rendering them difficult to infer. Aiming at the problem of cloud cover, this study presents a SpatioSpectral Generative Adversarial Network (SSGAN) approach for effectively eliminating cloud cover from multispectral satellite images. It utilizes the Synthetic Aperture Radar (SAR) images as complementary information with the optical images from the Sentinel-2 satellite. The proposed model exploits feature extraction by sub-grouping the 13 channels of Sentinel-2 images based on their electromagnetic wavelength. Experimentally, we demonstrated that the proposed SSGAN model surpasses conventional and state-of-the-art (SOTA) methods and can reconstruct regions obscured by clouds. The subgrouping optimized the utilization of sensor information and improved the performance metrics for reconstructed images. Compared to the state-of-the-art (SOTA) approach, the SSGAN model demonstrates higher performance, achieving a mPSNR of 32.771, mSSIM of 0.880, and correlation coefficient (CC) of 0.889. The SSGAN model was further evaluated under varying conditions, including scenarios without the inclusion of SAR data, where it achieved a mPSNR of 26.825, mSSIM of 0.726, and CC of 0.615. Adding SAR images into the model significantly enhanced its performance, resulting in a mPSNR of 29.932, mSSIM of 0.857, and CC of 0.735. These results indicate that higher mPSNR, mSSIM, and CC values correspond to better image reconstruction quality. Our method enhances the usability of satellite data for crop mapping, crop health monitoring, and crop yield prediction.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
SSGAN:利用空间光谱生成对抗网络去除卫星图像中的云层
卫星数据的可靠性、统一性和全球扫描能力为农业监测和作物管理带来了革命性的变化。然而,卫星图像中云层的存在会掩盖有用信息,使其难以推断。针对云层问题,本研究提出了一种空间光谱生成对抗网络(SSGAN)方法,可有效消除多光谱卫星图像中的云层。它利用合成孔径雷达(SAR)图像作为哨兵-2 卫星光学图像的补充信息。所提出的模型通过对哨兵-2 号卫星图像的 13 个信道进行基于电磁波长的分组来提取特征。实验证明,所提出的 SSGAN 模型超越了传统和最先进的(SOTA)方法,可以重建被云层遮挡的区域。分组优化了传感器信息的利用,提高了重建图像的性能指标。与最先进的(SOTA)方法相比,SSGAN 模型表现出更高的性能,mPSNR 达到 32.771,mSSIM 达到 0.880,相关系数(CC)达到 0.889。SSGAN 模型在不同条件下进行了进一步评估,包括未包含合成孔径雷达数据的情况,其 mPSNR 为 26.825,mSSIM 为 0.726,CC 为 0.615。在模型中加入合成孔径雷达图像后,其性能显著提高,mPSNR 为 29.932,mSSIM 为 0.857,CC 为 0.735。这些结果表明,更高的 mPSNR、mSSIM 和 CC 值对应着更好的图像重建质量。我们的方法提高了卫星数据在作物绘图、作物健康监测和作物产量预测方面的可用性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
European Journal of Agronomy
European Journal of Agronomy 农林科学-农艺学
CiteScore
8.30
自引率
7.70%
发文量
187
审稿时长
4.5 months
期刊介绍: The European Journal of Agronomy, the official journal of the European Society for Agronomy, publishes original research papers reporting experimental and theoretical contributions to field-based agronomy and crop science. The journal will consider research at the field level for agricultural, horticultural and tree crops, that uses comprehensive and explanatory approaches. The EJA covers the following topics: crop physiology crop production and management including irrigation, fertilization and soil management agroclimatology and modelling plant-soil relationships crop quality and post-harvest physiology farming and cropping systems agroecosystems and the environment crop-weed interactions and management organic farming horticultural crops papers from the European Society for Agronomy bi-annual meetings In determining the suitability of submitted articles for publication, particular scrutiny is placed on the degree of novelty and significance of the research and the extent to which it adds to existing knowledge in agronomy.
期刊最新文献
Ex-ante analyses using machine learning to understand the interactive influences of environmental and agro-management variables for target-oriented management practice selection Organo-mineral fertilizer to sustain soil health and crop yield for reducing environmental impact: A comprehensive review Investigation of coupling DSSAT with SCOPE-RTMo via sensitivity analysis and use of this coupled crop-radiative transfer model for sensitivity-based data assimilation Long term analysis on Olive flowering and climatic relationships in central Italy Sustainable effects of nitrogen reduction combined with biochar on enhancing maize productivity and nitrogen utilization
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1