{"title":"开发一个时空融合框架,用于利用公开的卫星数据在农业地区生成日常无人机图像","authors":"Hamid Ebrahimy, Tong Yu, Zhou Zhang","doi":"10.1016/j.isprsjprs.2024.12.024","DOIUrl":null,"url":null,"abstract":"<div><div>Monitoring agricultural areas, given their rapid transformation and small-scale spatial changes, necessitates obtaining dense time series of high-resolution remote sensing data. In this manner, the unmanned aerial vehicle (UAV) that can provide high-resolution images is indispensable for monitoring and assessing agricultural areas, especially for rapidly changing crops like alfalfa. Considering the practical limitations of acquiring daily UAV images, the utilization of spatiotemporal fusion (STF) approaches to integrate publicly available satellite images with high temporal resolution and UAV images with high spatial resolution can be considered an effective alternative. This study proposed an effective STF algorithm that utilizes the Generalized Linear Model (GLM) as the mapping function and is called GLM-STF. The algorithm is designed to use coarse difference images to map fine difference images via the GLM algorithm. It then combines these fine difference images with the original fine images to synthesize daily UAV image at the prediction time. In this study, we deployed a two-step STF process: (1) MODIS MCD43A4 and Harmonized Landsat and Sentinel-2 (HLS) data were fused to produce daily HLS images; and (2) daily HLS data and UAV images were fused to produce daily UAV images. We evaluated the reliability of the deployed framework at three distinct experimental sites that were covered by alfalfa crops. The performance of the GLM-STF algorithm was compared with five benchmark STF algorithms: STARFM, ESTARFM, Fit-FC, FSDAF, and VSDF, by using three quantitative accuracy evaluation metrics, including root mean squared error (RMSE), correlation coefficient (CC), and structure similarity index (SSIM). The proposed STF algorithm yielded the most accurate synthesized UAV images, followed by VSDF, which proved to be the most accurate benchmark algorithm. Specifically, GML-STF achieved an average RMSE of 0.029 (compared to VSDF’s 0.043), an average CC of 0.725 (compared to VSDF’s 0.669), and an average SSIM of 0.840 (compared to VSDF’s 0.811). The superiority of GLM-STF was also observed with the visual comparisons as well. Additionally, GLM-STF was less sensitive to the increase in the acquisition time difference between the reference image pairs and prediction date, indicating its suitability for STF tasks with limited input reference pairs. The developed framework in this study is thus expected to provide high-quality UAV images with high spatial resolution and frequent observations for various applications.</div></div>","PeriodicalId":50269,"journal":{"name":"ISPRS Journal of Photogrammetry and Remote Sensing","volume":"220 ","pages":"Pages 413-427"},"PeriodicalIF":10.6000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Developing a spatiotemporal fusion framework for generating daily UAV images in agricultural areas using publicly available satellite data\",\"authors\":\"Hamid Ebrahimy, Tong Yu, Zhou Zhang\",\"doi\":\"10.1016/j.isprsjprs.2024.12.024\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Monitoring agricultural areas, given their rapid transformation and small-scale spatial changes, necessitates obtaining dense time series of high-resolution remote sensing data. In this manner, the unmanned aerial vehicle (UAV) that can provide high-resolution images is indispensable for monitoring and assessing agricultural areas, especially for rapidly changing crops like alfalfa. Considering the practical limitations of acquiring daily UAV images, the utilization of spatiotemporal fusion (STF) approaches to integrate publicly available satellite images with high temporal resolution and UAV images with high spatial resolution can be considered an effective alternative. This study proposed an effective STF algorithm that utilizes the Generalized Linear Model (GLM) as the mapping function and is called GLM-STF. The algorithm is designed to use coarse difference images to map fine difference images via the GLM algorithm. It then combines these fine difference images with the original fine images to synthesize daily UAV image at the prediction time. In this study, we deployed a two-step STF process: (1) MODIS MCD43A4 and Harmonized Landsat and Sentinel-2 (HLS) data were fused to produce daily HLS images; and (2) daily HLS data and UAV images were fused to produce daily UAV images. We evaluated the reliability of the deployed framework at three distinct experimental sites that were covered by alfalfa crops. The performance of the GLM-STF algorithm was compared with five benchmark STF algorithms: STARFM, ESTARFM, Fit-FC, FSDAF, and VSDF, by using three quantitative accuracy evaluation metrics, including root mean squared error (RMSE), correlation coefficient (CC), and structure similarity index (SSIM). The proposed STF algorithm yielded the most accurate synthesized UAV images, followed by VSDF, which proved to be the most accurate benchmark algorithm. Specifically, GML-STF achieved an average RMSE of 0.029 (compared to VSDF’s 0.043), an average CC of 0.725 (compared to VSDF’s 0.669), and an average SSIM of 0.840 (compared to VSDF’s 0.811). The superiority of GLM-STF was also observed with the visual comparisons as well. Additionally, GLM-STF was less sensitive to the increase in the acquisition time difference between the reference image pairs and prediction date, indicating its suitability for STF tasks with limited input reference pairs. The developed framework in this study is thus expected to provide high-quality UAV images with high spatial resolution and frequent observations for various applications.</div></div>\",\"PeriodicalId\":50269,\"journal\":{\"name\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"volume\":\"220 \",\"pages\":\"Pages 413-427\"},\"PeriodicalIF\":10.6000,\"publicationDate\":\"2025-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0924271624004933\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"GEOGRAPHY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISPRS Journal of Photogrammetry and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0924271624004933","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
引用次数: 0
摘要
由于农业区域的快速变化和小尺度的空间变化,对其进行监测需要获得密集的高分辨率遥感数据时间序列。因此,能够提供高分辨率图像的无人机(UAV)对于农业区域的监测和评估是必不可少的,特别是对于像苜蓿这样快速变化的作物。考虑到获取日常无人机图像的实际局限性,利用时空融合(STF)方法整合公开的高时间分辨率卫星图像和高空间分辨率无人机图像可以被认为是一种有效的替代方案。本研究提出了一种利用广义线性模型(Generalized Linear Model, GLM)作为映射函数的有效STF算法,称为GLM-STF。该算法通过GLM算法将粗差图像映射到细差图像。然后将这些精细差分图像与原始精细图像相结合,合成预测时刻的无人机日常图像。在这项研究中,我们部署了一个两步的STF过程:(1)MODIS MCD43A4和Harmonized Landsat and Sentinel-2 (HLS)数据融合产生每日HLS图像;(2)将HLS日数据与无人机图像融合生成无人机日图像。我们在苜蓿作物覆盖的三个不同的实验地点评估了部署框架的可靠性。采用均方根误差(RMSE)、相关系数(CC)和结构相似度指数(SSIM) 3个定量精度评价指标,将GLM-STF算法与STARFM、ESTARFM、Fit-FC、FSDAF和VSDF 5种基准STF算法的性能进行比较。提出的STF算法合成无人机图像精度最高,其次是VSDF算法,是最精确的基准算法。具体来说,GML-STF的平均RMSE为0.029(与VSDF的0.043相比),平均CC为0.725(与VSDF的0.669相比),平均SSIM为0.840(与VSDF的0.811相比)。通过视觉对比也观察到GLM-STF的优越性。此外,GLM-STF对参考图像对与预测日期之间获取时间差的增加不太敏感,表明其适用于输入参考图像对有限的STF任务。因此,本研究开发的框架有望为各种应用提供具有高空间分辨率和频繁观测的高质量无人机图像。
Developing a spatiotemporal fusion framework for generating daily UAV images in agricultural areas using publicly available satellite data
Monitoring agricultural areas, given their rapid transformation and small-scale spatial changes, necessitates obtaining dense time series of high-resolution remote sensing data. In this manner, the unmanned aerial vehicle (UAV) that can provide high-resolution images is indispensable for monitoring and assessing agricultural areas, especially for rapidly changing crops like alfalfa. Considering the practical limitations of acquiring daily UAV images, the utilization of spatiotemporal fusion (STF) approaches to integrate publicly available satellite images with high temporal resolution and UAV images with high spatial resolution can be considered an effective alternative. This study proposed an effective STF algorithm that utilizes the Generalized Linear Model (GLM) as the mapping function and is called GLM-STF. The algorithm is designed to use coarse difference images to map fine difference images via the GLM algorithm. It then combines these fine difference images with the original fine images to synthesize daily UAV image at the prediction time. In this study, we deployed a two-step STF process: (1) MODIS MCD43A4 and Harmonized Landsat and Sentinel-2 (HLS) data were fused to produce daily HLS images; and (2) daily HLS data and UAV images were fused to produce daily UAV images. We evaluated the reliability of the deployed framework at three distinct experimental sites that were covered by alfalfa crops. The performance of the GLM-STF algorithm was compared with five benchmark STF algorithms: STARFM, ESTARFM, Fit-FC, FSDAF, and VSDF, by using three quantitative accuracy evaluation metrics, including root mean squared error (RMSE), correlation coefficient (CC), and structure similarity index (SSIM). The proposed STF algorithm yielded the most accurate synthesized UAV images, followed by VSDF, which proved to be the most accurate benchmark algorithm. Specifically, GML-STF achieved an average RMSE of 0.029 (compared to VSDF’s 0.043), an average CC of 0.725 (compared to VSDF’s 0.669), and an average SSIM of 0.840 (compared to VSDF’s 0.811). The superiority of GLM-STF was also observed with the visual comparisons as well. Additionally, GLM-STF was less sensitive to the increase in the acquisition time difference between the reference image pairs and prediction date, indicating its suitability for STF tasks with limited input reference pairs. The developed framework in this study is thus expected to provide high-quality UAV images with high spatial resolution and frequent observations for various applications.
期刊介绍:
The ISPRS Journal of Photogrammetry and Remote Sensing (P&RS) serves as the official journal of the International Society for Photogrammetry and Remote Sensing (ISPRS). It acts as a platform for scientists and professionals worldwide who are involved in various disciplines that utilize photogrammetry, remote sensing, spatial information systems, computer vision, and related fields. The journal aims to facilitate communication and dissemination of advancements in these disciplines, while also acting as a comprehensive source of reference and archive.
P&RS endeavors to publish high-quality, peer-reviewed research papers that are preferably original and have not been published before. These papers can cover scientific/research, technological development, or application/practical aspects. Additionally, the journal welcomes papers that are based on presentations from ISPRS meetings, as long as they are considered significant contributions to the aforementioned fields.
In particular, P&RS encourages the submission of papers that are of broad scientific interest, showcase innovative applications (especially in emerging fields), have an interdisciplinary focus, discuss topics that have received limited attention in P&RS or related journals, or explore new directions in scientific or professional realms. It is preferred that theoretical papers include practical applications, while papers focusing on systems and applications should include a theoretical background.