开发一个时空融合框架,用于利用公开的卫星数据在农业地区生成日常无人机图像

IF 10.6 1区 地球科学 Q1 GEOGRAPHY, PHYSICAL ISPRS Journal of Photogrammetry and Remote Sensing Pub Date : 2025-02-01 DOI:10.1016/j.isprsjprs.2024.12.024
Hamid Ebrahimy, Tong Yu, Zhou Zhang
{"title":"开发一个时空融合框架,用于利用公开的卫星数据在农业地区生成日常无人机图像","authors":"Hamid Ebrahimy,&nbsp;Tong Yu,&nbsp;Zhou Zhang","doi":"10.1016/j.isprsjprs.2024.12.024","DOIUrl":null,"url":null,"abstract":"<div><div>Monitoring agricultural areas, given their rapid transformation and small-scale spatial changes, necessitates obtaining dense time series of high-resolution remote sensing data. In this manner, the unmanned aerial vehicle (UAV) that can provide high-resolution images is indispensable for monitoring and assessing agricultural areas, especially for rapidly changing crops like alfalfa. Considering the practical limitations of acquiring daily UAV images, the utilization of spatiotemporal fusion (STF) approaches to integrate publicly available satellite images with high temporal resolution and UAV images with high spatial resolution can be considered an effective alternative. This study proposed an effective STF algorithm that utilizes the Generalized Linear Model (GLM) as the mapping function and is called GLM-STF. The algorithm is designed to use coarse difference images to map fine difference images via the GLM algorithm. It then combines these fine difference images with the original fine images to synthesize daily UAV image at the prediction time. In this study, we deployed a two-step STF process: (1) MODIS MCD43A4 and Harmonized Landsat and Sentinel-2 (HLS) data were fused to produce daily HLS images; and (2) daily HLS data and UAV images were fused to produce daily UAV images. We evaluated the reliability of the deployed framework at three distinct experimental sites that were covered by alfalfa crops. The performance of the GLM-STF algorithm was compared with five benchmark STF algorithms: STARFM, ESTARFM, Fit-FC, FSDAF, and VSDF, by using three quantitative accuracy evaluation metrics, including root mean squared error (RMSE), correlation coefficient (CC), and structure similarity index (SSIM). The proposed STF algorithm yielded the most accurate synthesized UAV images, followed by VSDF, which proved to be the most accurate benchmark algorithm. Specifically, GML-STF achieved an average RMSE of 0.029 (compared to VSDF’s 0.043), an average CC of 0.725 (compared to VSDF’s 0.669), and an average SSIM of 0.840 (compared to VSDF’s 0.811). The superiority of GLM-STF was also observed with the visual comparisons as well. Additionally, GLM-STF was less sensitive to the increase in the acquisition time difference between the reference image pairs and prediction date, indicating its suitability for STF tasks with limited input reference pairs. The developed framework in this study is thus expected to provide high-quality UAV images with high spatial resolution and frequent observations for various applications.</div></div>","PeriodicalId":50269,"journal":{"name":"ISPRS Journal of Photogrammetry and Remote Sensing","volume":"220 ","pages":"Pages 413-427"},"PeriodicalIF":10.6000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Developing a spatiotemporal fusion framework for generating daily UAV images in agricultural areas using publicly available satellite data\",\"authors\":\"Hamid Ebrahimy,&nbsp;Tong Yu,&nbsp;Zhou Zhang\",\"doi\":\"10.1016/j.isprsjprs.2024.12.024\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Monitoring agricultural areas, given their rapid transformation and small-scale spatial changes, necessitates obtaining dense time series of high-resolution remote sensing data. In this manner, the unmanned aerial vehicle (UAV) that can provide high-resolution images is indispensable for monitoring and assessing agricultural areas, especially for rapidly changing crops like alfalfa. Considering the practical limitations of acquiring daily UAV images, the utilization of spatiotemporal fusion (STF) approaches to integrate publicly available satellite images with high temporal resolution and UAV images with high spatial resolution can be considered an effective alternative. This study proposed an effective STF algorithm that utilizes the Generalized Linear Model (GLM) as the mapping function and is called GLM-STF. The algorithm is designed to use coarse difference images to map fine difference images via the GLM algorithm. It then combines these fine difference images with the original fine images to synthesize daily UAV image at the prediction time. In this study, we deployed a two-step STF process: (1) MODIS MCD43A4 and Harmonized Landsat and Sentinel-2 (HLS) data were fused to produce daily HLS images; and (2) daily HLS data and UAV images were fused to produce daily UAV images. We evaluated the reliability of the deployed framework at three distinct experimental sites that were covered by alfalfa crops. The performance of the GLM-STF algorithm was compared with five benchmark STF algorithms: STARFM, ESTARFM, Fit-FC, FSDAF, and VSDF, by using three quantitative accuracy evaluation metrics, including root mean squared error (RMSE), correlation coefficient (CC), and structure similarity index (SSIM). The proposed STF algorithm yielded the most accurate synthesized UAV images, followed by VSDF, which proved to be the most accurate benchmark algorithm. Specifically, GML-STF achieved an average RMSE of 0.029 (compared to VSDF’s 0.043), an average CC of 0.725 (compared to VSDF’s 0.669), and an average SSIM of 0.840 (compared to VSDF’s 0.811). The superiority of GLM-STF was also observed with the visual comparisons as well. Additionally, GLM-STF was less sensitive to the increase in the acquisition time difference between the reference image pairs and prediction date, indicating its suitability for STF tasks with limited input reference pairs. The developed framework in this study is thus expected to provide high-quality UAV images with high spatial resolution and frequent observations for various applications.</div></div>\",\"PeriodicalId\":50269,\"journal\":{\"name\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"volume\":\"220 \",\"pages\":\"Pages 413-427\"},\"PeriodicalIF\":10.6000,\"publicationDate\":\"2025-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0924271624004933\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"GEOGRAPHY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISPRS Journal of Photogrammetry and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0924271624004933","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
引用次数: 0

摘要

由于农业区域的快速变化和小尺度的空间变化,对其进行监测需要获得密集的高分辨率遥感数据时间序列。因此,能够提供高分辨率图像的无人机(UAV)对于农业区域的监测和评估是必不可少的,特别是对于像苜蓿这样快速变化的作物。考虑到获取日常无人机图像的实际局限性,利用时空融合(STF)方法整合公开的高时间分辨率卫星图像和高空间分辨率无人机图像可以被认为是一种有效的替代方案。本研究提出了一种利用广义线性模型(Generalized Linear Model, GLM)作为映射函数的有效STF算法,称为GLM-STF。该算法通过GLM算法将粗差图像映射到细差图像。然后将这些精细差分图像与原始精细图像相结合,合成预测时刻的无人机日常图像。在这项研究中,我们部署了一个两步的STF过程:(1)MODIS MCD43A4和Harmonized Landsat and Sentinel-2 (HLS)数据融合产生每日HLS图像;(2)将HLS日数据与无人机图像融合生成无人机日图像。我们在苜蓿作物覆盖的三个不同的实验地点评估了部署框架的可靠性。采用均方根误差(RMSE)、相关系数(CC)和结构相似度指数(SSIM) 3个定量精度评价指标,将GLM-STF算法与STARFM、ESTARFM、Fit-FC、FSDAF和VSDF 5种基准STF算法的性能进行比较。提出的STF算法合成无人机图像精度最高,其次是VSDF算法,是最精确的基准算法。具体来说,GML-STF的平均RMSE为0.029(与VSDF的0.043相比),平均CC为0.725(与VSDF的0.669相比),平均SSIM为0.840(与VSDF的0.811相比)。通过视觉对比也观察到GLM-STF的优越性。此外,GLM-STF对参考图像对与预测日期之间获取时间差的增加不太敏感,表明其适用于输入参考图像对有限的STF任务。因此,本研究开发的框架有望为各种应用提供具有高空间分辨率和频繁观测的高质量无人机图像。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Developing a spatiotemporal fusion framework for generating daily UAV images in agricultural areas using publicly available satellite data
Monitoring agricultural areas, given their rapid transformation and small-scale spatial changes, necessitates obtaining dense time series of high-resolution remote sensing data. In this manner, the unmanned aerial vehicle (UAV) that can provide high-resolution images is indispensable for monitoring and assessing agricultural areas, especially for rapidly changing crops like alfalfa. Considering the practical limitations of acquiring daily UAV images, the utilization of spatiotemporal fusion (STF) approaches to integrate publicly available satellite images with high temporal resolution and UAV images with high spatial resolution can be considered an effective alternative. This study proposed an effective STF algorithm that utilizes the Generalized Linear Model (GLM) as the mapping function and is called GLM-STF. The algorithm is designed to use coarse difference images to map fine difference images via the GLM algorithm. It then combines these fine difference images with the original fine images to synthesize daily UAV image at the prediction time. In this study, we deployed a two-step STF process: (1) MODIS MCD43A4 and Harmonized Landsat and Sentinel-2 (HLS) data were fused to produce daily HLS images; and (2) daily HLS data and UAV images were fused to produce daily UAV images. We evaluated the reliability of the deployed framework at three distinct experimental sites that were covered by alfalfa crops. The performance of the GLM-STF algorithm was compared with five benchmark STF algorithms: STARFM, ESTARFM, Fit-FC, FSDAF, and VSDF, by using three quantitative accuracy evaluation metrics, including root mean squared error (RMSE), correlation coefficient (CC), and structure similarity index (SSIM). The proposed STF algorithm yielded the most accurate synthesized UAV images, followed by VSDF, which proved to be the most accurate benchmark algorithm. Specifically, GML-STF achieved an average RMSE of 0.029 (compared to VSDF’s 0.043), an average CC of 0.725 (compared to VSDF’s 0.669), and an average SSIM of 0.840 (compared to VSDF’s 0.811). The superiority of GLM-STF was also observed with the visual comparisons as well. Additionally, GLM-STF was less sensitive to the increase in the acquisition time difference between the reference image pairs and prediction date, indicating its suitability for STF tasks with limited input reference pairs. The developed framework in this study is thus expected to provide high-quality UAV images with high spatial resolution and frequent observations for various applications.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
ISPRS Journal of Photogrammetry and Remote Sensing
ISPRS Journal of Photogrammetry and Remote Sensing 工程技术-成像科学与照相技术
CiteScore
21.00
自引率
6.30%
发文量
273
审稿时长
40 days
期刊介绍: The ISPRS Journal of Photogrammetry and Remote Sensing (P&RS) serves as the official journal of the International Society for Photogrammetry and Remote Sensing (ISPRS). It acts as a platform for scientists and professionals worldwide who are involved in various disciplines that utilize photogrammetry, remote sensing, spatial information systems, computer vision, and related fields. The journal aims to facilitate communication and dissemination of advancements in these disciplines, while also acting as a comprehensive source of reference and archive. P&RS endeavors to publish high-quality, peer-reviewed research papers that are preferably original and have not been published before. These papers can cover scientific/research, technological development, or application/practical aspects. Additionally, the journal welcomes papers that are based on presentations from ISPRS meetings, as long as they are considered significant contributions to the aforementioned fields. In particular, P&RS encourages the submission of papers that are of broad scientific interest, showcase innovative applications (especially in emerging fields), have an interdisciplinary focus, discuss topics that have received limited attention in P&RS or related journals, or explore new directions in scientific or professional realms. It is preferred that theoretical papers include practical applications, while papers focusing on systems and applications should include a theoretical background.
期刊最新文献
RS-NormGAN: Enhancing change detection of multi-temporal optical remote sensing images through effective radiometric normalization Simulation-aided similarity-aware feature alignment with meta-adaption optimization for SAR ATR under extended operation conditions GV-iRIOM: GNSS-visual-aided 4D radar inertial odometry and mapping in large-scale environments CIDM: A comprehensive inpainting diffusion model for missing weather radar data with knowledge guidance A novel framework for accurate, automated and dynamic global lake mapping based on optical imagery
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1